cloud data engineer

Cotality

<div>At Cotality, we are driven by a single mission&mdash;to make the property industry faster, smarter, and more people-centric. Cotality is the trusted source for property intelligence, with unmatched precision, depth, breadth, and insights across the entire ecosystem. Our talented team of 5,000 employees globally uses our network, scale, connectivity and technology to drive the largest asset class in the world. Join us as we work toward our vision of fueling a thriving global property ecosystem and a more resilient society.
Cotality is committed to cultivating a diverse and inclusive work culture that inspires innovation and bold thinking; it's a place where you can collaborate, feel valued, develop skills and directly impact the real estate economy. We know our people are our greatest asset. At Cotality, you can be yourself, lift people up and make an impact. By putting clients first and continuously innovating, we're working together to set the pace for unlocking new possibilities that better serve the property industry.
Job Description:
In India, we operate as Next Gear India Private Limited, a fully-owned subsidiary of Cotality with offices in Kolkata, West Bengal, and Noida, Uttar Pradesh. Next Gear India Private Limited plays a vital role in Cotality's Product Development capabilities, focusing on creating and delivering innovative solutions for the Property &amp; Casualty (P&amp;C) Insurance and Property Restoration industries. 
While Next Gear India Private Limited operates under its own registered name in India, we are seamlessly integrated into the Cotality family, sharing the same commitment to innovation, quality, and client success. 
When you join Next Gear India Private Limited, you become part of the global Cotality team. Together, we shape the future of property insights and analytics, contributing to a smarter and more resilient property ecosystem through cutting-edge technology and insights.
We are seeking a skilled and motivated Senior Azure Cloud Data Engineer to join our cloud engineering team. In this role, you will design, develop, and maintain scalable data systems and cloud-based solutions using Microsoft Azure. This role is ideal for someone who thrives at the intersection of data and cloud, with responsibilities split evenly between data a nd cloud engineering. You will play a key role in shaping our cloud data strategy, mentoring junior engineers, and driving best practices across the organization.
<h2 class="jobSectionHeader">Key Responsibilities:
</h2><h3 class="jobSectionHeader">Data Engineering:
</h3><ul><li>Design data architectures that support scalability, security, and performance spanning multiple cloud environments.
</li><li>Leverage cloud-native services for data storage, processing, and analytics.
</li><li>Implement data integration solutions to enable seamless flow of information across the organization. Ensure data integration processes are efficient, reliable, and maintain data integrity.
</li><li>Optimize data architectures for performance and scalability.
</li><li>Implement solutions that handle increasing data volumes and user demands.
</li></ul><h3 class="jobSectionHeader">Cloud Engineering
</h3><ul><li>Design and manage cloud data infrastructure using Infrastructure as Code (IaC) tools such as Terraform, Bicep, or ARM templates.
</li><li>Automate deployments and workflows using Azure DevOps, Runbooks, and Logic Apps.
</li><li>Monitor and optimize cloud resources using Azure Monitor, Log Analytics, and Application Insights.
</li></ul>Job Qualifications:
<h2 class="jobSectionHeader">Required skills and qualifications
</h2><ul><li>3+ years of hands - on experience in data engineering and cloud infrastructure roles, with a strong focus on Azure.
</li><li>Proven experience designing and implementing enterprise-grade data platforms. Deploy and manage cloud data infrastructure in Azure ecosystem.
</li><li>Experience in data architecture, database design, and cloud technologies.
</li><li>Data Technologies: SQL server, PostGres, NoSQL (ElasticSearch, Redis), ETL data pipelines
</li><li>Cloud technologies: Azure SQL managed Instance, Azure Monitor, Log Analytics, Application Insights, Azure DevOps
</li><li>Programming Languages: Powershell, TSQL, SQL, YAML
</li><li>Strong understanding of data modeling, warehousing, and big data concepts.
</li><li>Experience with CI/CD pipelines, version control, and automated testing in cloud environments.
</li></ul><h2 class="jobSectionHeader">Preferred skills and qualifications
</h2><ul><li>Bachelor&rsquo;s degree in Computer Science, Information Technology, or related field strongly preferred
</li><li>Microsoft Certified: Azure Data Engineer Associate (DP-203) or Azure Solutions Architect Expert.
</li><li>Experience with Agile/Scrum
</li><li>Familiarity with the Azure Data Factory
</li></ul><div>Thrive with Cotality
</div><div>At Cotality, we&rsquo;re committed to supporting your whole self- at work and beyond. Our India benefits package is thoughtfully designed to promote your well-being, financial security, and professional growth. From comprehensive health coverage to flexible leave, retirement planning, and mental health support, we help you thrive every step of the way.
</div><div>Highlights include:
</div><div><ul><li>Health &amp; Wellness: Company-paid Mediclaim Insurance, routine dental and vision care (including LASIK and cataract), annual health check-ups, and maternity benefits.
</li></ul></div><div><ul><li>Mental Health: Access to 12 free sessions with top therapists and coaches for you and your dependents via Lyra.
</li></ul></div><div><ul><li>Leave &amp; Time Off: 11 paid holidays (state-specific), 10 well-being half days, paid sick, maternity, paternity, caregiving, bereavement, and volunteer time off.
</li></ul></div><div><ul><li>Family Support: Coverage available for spouse, children, and parents or in-laws; includes maternity and parental leave.
</li></ul></div>Financial Benefits:
<ul><li>&#8377;10,400 annual well-being account
</li><li>&#8377;15,000 medical reimbursement allowance
</li><li>&#8377;19,200 conveyance allowance
</li><li>House Rent Allowance with tax benefits
</li></ul>Insurance &amp; Protection:
<ul><li>Group Term Life and Personal Accident Insurance at 5x annual salary (company-paid)
</li></ul>Retirement &amp; Savings:
<ul><li>Provident Fund with employer matching
</li><li>Optional National Pension Scheme (NPS) contributions (pre-tax)
</li></ul>Extras: Performance bonuses, recognition rewards, and exclusive employee discounts.
Cotality's Diversity Commitment:
Cotality is fully committed to employing a diverse workforce and creating an inclusive work environment that embraces everyone&rsquo;s unique contributions, experiences and values. We offer an empowered work environment that encourages creativity, initiative and professional growth and provides a competitive salary and benefits package. We are better together when we support and recognize our differences. 
Equal Opportunity Employer Statement:
Cotality is an Equal Opportunity employer committed to attracting and retaining the best-qualified people available, without regard to race, ancestry, place of origin, colour, ethnic origin, citizenship, creed, sex, sexual orientation, record of offences, age, marital status, family status or disability. Cotality maintains a Drug-Free Workplace. 
Please apply on our website for consideration. 
By providing your telephone number, you agree to receive automated (SMS) text messages at that number from Cotality regarding all matters related to your application and, if you are hired, your employment and company business. Message &amp; data rates may apply. You can opt out at any time by responding STOP or UNSUBSCRIBING and will automatically be opted out company-wide.</div>

Senior Azure Cloud Data Engineer

Willware Technologies

Role: GCP Data EngineerLocation: BangaloreExperience: 8+ yearsKey Responsibilities:Design, develop, and maintain data pipelines using GCP-native tools and frameworks.Build scalable ETL/ELT processes using Apache Airflow (Cloud Composer) and BigQuery.Implement real-time and batch data ingestion using Pub/Sub and Cloud Dataflow or alternative tools.Develop and manage microservices for data processing using Cloud Run.Use Git for version control and collaborative development.Optimize and monitor data workflows to ensure high availability and performance.Work closely with data analysts, data scientists, and other engineers to support data needs and integration across teams.Document technical solutions, pipelines, and workflows clearly for team collaboration and maintenance.Must-Have Skills:Strong experience with Google Cloud Platform (GCP) services, especially:BigQueryCloud Pub/SubCloud Composer (Airflow)Cloud RunProficiency in Python and SQL for data transformation and orchestration.Experience with version control tools like Git.Solid understanding of data warehousing concepts, ETL/ELT workflows, and best practices.Experience building and deploying production-grade data pipelines.Job Type: Contractual / TemporaryPay: &#8377;556,713.79 - &#8377;1,940,694.30 per yearWork Location: In person

GCP Data Engineer

Markitzen

Job Title: Azure Data EngineerExperience: 7 &ndash; 10 yearsLocation: NoidaBudget: Up to &#8377;25 LPAEmployment Type: Full-TimeRole Overview:We are seeking an experienced Azure Data Engineer responsible for designing, implementing, and optimizing cloud-based data pipelines and architectures using Azure Data Factory (ADF), Synapse Analytics, and ADLS. The candidate will collaborate closely with analytics and data science teams to build end-to-end business intelligence (BI) solutions, mentor junior developers, and ensure data quality, performance, and compliance across large-scale environments.Key Responsibilities:Collaborate with business analytics and data science teams to gather requirements and deliver end-to-end BI solutions.Design, develop, and optimize data pipelines using Hadoop, Spark, and Azure data services (Blob Storage, SQL Database, Event Hubs, ADF, Synapse Analytics, Databricks).Develop and maintain data models and curated datasets for analytics and reporting.Write and maintain high-quality code using SQL, Python, Scala, and automation tools (PowerShell, Azure CLI).Implement and enforce data governance, security, and compliance measures in collaboration with privacy teams.Troubleshoot and tune query performance, data ingestion pipelines, and resource utilization.Drive operational excellence by implementing best practices for scalable and cost-effective cloud data architectures.Stay current with emerging Big Data and Cloud technologies and apply innovations to improve data solutions.Provide mentorship and guidance to junior engineers and data developers.Required Qualifications:Bachelor&rsquo;s degree in Computer Science, Information Technology, or related field.10+ years of experience in data architecture, engineering, or BI.Minimum 5 years of hands-on experience with distributed systems like Hadoop, Spark.Proven expertise in Azure ecosystem, including Blob Storage, SQL Database, Event Hubs, Data Factory, Synapse Analytics, HDInsight.Strong programming proficiency in Python, Java, or Scala.Deep understanding of data modeling, metadata management, and SQL performance tuning.Excellent analytical, problem-solving, and communication skills.Experience using BI reporting tools (e.g., Power BI, Tableau).Preferred Skills:Hands-on experience with Databricks for data transformation and analytics.Knowledge of well-architected, fault-tolerant data pipeline design principles.Experience designing cost-optimized and scalable cloud data solutions.Familiarity with Machine Learning, Generative AI, and LLM integrations.Relevant Microsoft Azure certifications (Data Engineer, Solutions Architect, or AI Engineer).Work Mode:Work from Office (Noida)Notice Period:Immediate Joiners preferredShift Timings:General ShiftJob Types: Full-time, PermanentPay: Up to &#8377;2,500,000.00 per yearWork Location: In person

Azure Data Engineer

Bridgenext

<div><h2 class="jobSectionHeader">Azure Data Engineer</h2>
<div>Job ID: Clo-ETP-Ind-1099</div>
Location: India,Pune
<div>Job Summary: We are seeking a skilled and experienced Cloud Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining data solutions on the Azure/AWS cloud platforms. The candidate should have a strong background in data engineering, including ETL processes, data warehousing, and database management. The role requires expertise in Databricks other relevant technologies. The Data Engineer will collaborate with cross-functional teams to ensure the successful delivery of scalable and efficient data solutions. 
Minimum 3-5 Years of Experience in Data Integration platform on cloud (Azure preferred) 
Responsibilities:<ul><li>Solution Design and Architecture:</li><li>Collaborate with stakeholders to understand business requirements and design scalable data solutions on the cloud platforms.</li><li>Create and maintain data architecture diagrams and documentation.</li><li>Data Ingestion and ETL:</li><li>Develop and implement ETL processes using Databricks, and other relevant tools.</li><li>Design and optimize data pipelines to ensure efficient data processing and transformation.</li><li>Data Storage and Management:</li><li>Implement and manage Relational Databases, Snowflake and other data sources.</li><li>Ensure data integrity, security, and compliance with industry best practices and organizational standards.</li><li>Data Transformation and Processing:</li><li>Utilize Databricks and other tools for data transformation and processing.</li><li>Optimize queries and data processing workflows for performance and efficiency.</li><li>Monitoring and Optimization:</li><li>Implement monitoring solutions to track the performance and health of data solutions.</li><li>Identify and resolve performance bottlenecks and optimize data processing workflows.</li><li>Collaboration and Communication:</li><li>Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders.</li><li>Communicate effectively with technical and non-technical audiences, providing insights and recommendations.</li><li>Automation and Scripting:</li><li>Develop scripts and automation processes to streamline data engineering tasks.</li></ul> 
Qualifications:<ul><li>
Bachelor&rsquo;s degree in Computer Science, Information Technology, or a related field.</li><li>
Proven experience as a Data Engineer with Azure/AWS cloud technologies.</li><li>
In-depth knowledge of Databricks, and other relevant Azure services.</li><li>
Strong proficiency in SQL, Python, and/or other scripting languages.</li><li>
Experience with data modeling, schema design, and database performance tuning.</li><li>
Familiarity with data warehousing concepts and best practices.</li><li>
Excellent problem-solving and analytical skills.</li><li>
Effective communication and collaboration skills.</li></ul> 
If you meet these qualifications and are excited about the opportunity to work with cutting-edge cloud technologies to solve complex data challenges, we encourage you to apply. Join our team and be a key contributor to the success of our data-driven initiatives.</div></div>

Varishtha Infotech

Job Title: AWS Data Engineer Location: Navi Mumbai , Work From Office 5daysExperience: 6+ YearsBudget: 18-20 LPAJob Summary:We are looking for a skilled AWS Data Engineer (Lead) to join our team in Mumbai. The ideal candidate will have 6+ years of experience in designing, building, and optimizing datapipelines and workflows using AWS cloud technologies. You should be proficient in SQL, PySpark, and Python and have hands-on experience with AWS services like Redshift, EMR, Airflow, CloudWatch, and S3.Key Responsibilities:&middot; 	Design, develop, and maintain scalable ETL/ELT data pipelines using AWS cloud technologies.&middot; 	Work with PySpark and SQL to process large datasets efficiently.&middot; 	Manage AWS services such as Apache Airflow, Redshift, EMR, CloudWatch, and S3 for data processing and orchestration.&middot; 	Implement CI/CD pipelines using Azure DevOps for seamless deployment and automation.&middot; 	Monitor and optimize data workflows for performance, cost, and reliability.&middot; 	Utilize Jupyter Notebooks for data exploration and analysis.&middot; 	Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to ensure smooth data integration.&middot; 	Implement Unix commands and Git for version control and automation.&middot; 	Ensure best practices for data governance, security, and compliance in cloud environments.Required Skills:Programming Scripting:&middot; 	SQL, PySpark, Python AWS Tools Services:&middot; 	Apache Airflow (Workflow Orchestration)&middot; 	Redshift (Data Warehousing)&middot; 	EMR (Big Data Processing)&middot; 	CloudWatch (Monitoring C Logging)&middot; 	S3 (Data Storage)&middot; 	Jupyter Notebooks (Data Exploration)DevOpss CI/CD:&middot; 	Azure DevOps (CI/CD Pipelines)&middot; 	Git (Version Control)&middot; 	Unix Commands (Shell Scripting)Preferred Qualifications:&middot; 	Experience in performance tuning data pipelines and SQL queries.&middot; 	Knowledge of data lake and data warehouse architecture.&middot; 	Strong problem-solving skills with the ability to troubleshoot data pipeline issues.&middot; 	Understanding data security, encryption, and access control in cloud environments.Job Types: Full-time, PermanentPay: &#8377;1,800,000.00 - &#8377;2,000,000.00 per yearAbility to commute/relocate:<ul><li>Navi Mumbai, Maharashtra: Reliably commute or planning to relocate before starting work (Required)</li></ul>Application Question(s):<ul><li>Notice period</li><li>Current CTC</li><li>Expected CTC</li></ul>Experience:<ul><li>Data Engineer: 6 years (Required)</li><li>Programming Scripting:	SQL, PySpark, Python : 5 years (Required)</li><li>AWS Tools Services: 5 years (Required)</li><li>DevOpss CI/CD: 4 years (Required)</li></ul>Work Location: In person

AWS Data Engineer

Augusta HiTech Software

<ul><div>Industry: IT
Qualification: Any Degree
Required Skills: Data Engineering, SQL, ETL Tools, Cloud Platform (Azure Preferred)
Working Shift: 2PM to 11PM IST
City: Coimbatore
Country: India<div><div><div><div>
Name of the position: Data Engineer</div></div><div><div>
Location: Coimbatore</div></div><div><div>
No. of resources needed: 01</div></div><div><div>
Mode: Fulltime</div></div><div><div>
Years of experience: 1+ Years</div></div><div><div>
Shift: UK shift (2pm to 11pm)</div></div><div></div> 
About the Role 
We are looking for a passionate Junior Data Engineer with strong skills in Java and SQL, and some hands-on experience in data engineering or ETL development. 
 You will work alongside senior engineers to build, maintain, and optimize data pipelines and data integration workflows across cloud platforms such as Azure and Snowflake. 
 This role is ideal for candidates with a software development background who are eager to grow their career in data engineering and analytics using modern tools and technologies. 
 
Key Responsibilities 
<ul><div>
Develop and maintain data ingestion and transformation pipelines using Java, SQL, and ETL tools.</div><div>
Work on data extraction, transformation, and loading (ETL/ELT) processes from multiple sources (databases, APIs, flat files, etc.).</div><div>
Collaborate with senior engineers to design and optimize data models in Snowflake or other cloud data warehouses.</div><div>
Write complex SQL queries and stored procedures for data validation, transformation, and analysis.</div><div>
Support Azure Data Factory (ADF), DBT, or similar tools for workflow orchestration.</div><div>
Participate in data quality checks, performance optimization, and troubleshooting.</div><div>
Maintain documentation, ensure code versioning with Git, and assist with CI/CD pipeline integration.</div><div>
Work closely with analysts to ensure reliable, high-quality data delivery for reporting and analytics.</div></ul>
Required Skills &amp; Qualifications 
<ul><div>
Bachelor&rsquo;s degree in Computer Science, Information Technology, or related field.</div><div>
1&ndash;3 years of experience in software development or data engineering.</div><div>
Strong programming knowledge in Java (OOPs, JDBC, APIs, Collections).</div><div>
Proficient in SQL and relational database concepts.</div><div>
Basic hands-on experience with ETL tools (Azure Data Factory, DBT, FiveTran, Talend, etc.).</div><div>
Understanding of data warehousing, data modeling (Star/Snowflake schemas), and data pipelines.</div><div>
Familiarity with cloud platforms (Azure preferred, AWS optional).</div><div>
Strong analytical and problem-solving abilities with good communication skills.</div></ul></div></div></div></ul><div></div>

Data Engineer

Cognizant Technology Solutions

<div>Skills- AWS Data Engineer
Experience: 9 to 13 years
Location: AIA-Pune
We are seeking skilled and dynamic Cloud Data Engineers specializing in AWS, Databricks. The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions.
Key Responsibilities:<ul><li>Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS.</li></ul>
- Implement data ingestion and transformation processes to facilitate efficient data warehousing. - Utilize cloud services to enhance data processing capabilities:<ul><li>AWS: Glue, Athena, Lambda, Redshift, Step Functions, DynamoDB, SNS.</li></ul>
- Optimize Spark job performance to ensure high efficiency and reliability. - Stay proactive in learning and implementing new technologies to improve data processing frameworks. - Collaborate with cross-functional teams to deliver robust data solutions. - Work on Spark Streaming for real-time data processing as necessary.
Qualifications:
- 5-8 years of experience in data engineering with a strong focus on cloud environments. - Proficiency in PySpark or Spark is mandatory. - Proven experience with data ingestion, transformation, and data warehousing. - In-depth knowledge and hands-on experience with cloud services(AWS): - Demonstrated ability in performance optimization of Spark jobs. - Strong problem-solving skills and the ability to work independently as well as in a team. - Cloud Certification (AWS) is a plus. - Familiarity with Spark Streaming is a bonus.</div>

Search 10000+ Cloud data engineer jobs near you this November. New roles added regularly across leading industries. Apply today.

10000 cloud data engineer jobs NEAR_ME

Senior Azure Cloud Data Engineer

GCP Data Engineer

Azure Data Engineer

Azure Data Engineer

AWS Data Engineer

Data Engineer

AWS Data Engineer