data engineer

Aqilea (formerly Soltia)

<div>We are a consulting company with a bunch of technology-interested and happy people!
We love technology, we love design and we love quality. Our diversity makes us unique and creates an inclusive and welcoming workplace where each individual is highly valued. 
 
With us, each individual is her/himself and respects others for who they are and we believe that when a fantastic mix of people gather and share their knowledge, experiences and ideas, we can help our customers on a completely different level.
We are looking for you who want to grow with us! 
 
With us, you have great opportunities to take real steps in your career and the opportunity to take great responsibility.
We are seeking a skilled and forward-thinking Data Engineer to join our Emerging Tech team.
Company : Aqilea India
Employment Type: Full Time
Location: Bangalore(Hybrid)
Experience: 5 to 7 years
About the Role:
We are seeking a skilled Data Engineer with strong expertise in building and optimizing data pipelines, managing large-scale datasets, and enabling data-driven decision-making. The ideal candidate should have solid experience in SQL, Python, and cloud-based data platforms, with a focus on Google Cloud Platform (GCP).
Job Description Data Engineer (Azure &amp; GCP)
Employment Type: Full Time 
Location: Bangalore (Hybrid) 
Experience: 5 to 7 years
About the Role:
We are looking for a Data Engineer with strong expertise in Azure Data Platform and GCP BigQuery to design, build, and optimize cloud-based data solutions. The ideal candidate will have hands-on experience in managing end-to-end data pipelines, cloud integration, and data lake architectures, along with a deep understanding of modern data engineering practices.
Key Responsibilities:<ul>
<li>Design, develop, and maintain data pipelines and ETL workflows across Azure and GCP environments.</li>
<li>Work extensively with BigQuery for data modeling, query optimization, and partitioning strategies.</li>
<li>Develop and orchestrate workflows using Azure Data Factory or equivalent tools.</li>
<li>Write optimized SQL and Python scripts for data ingestion, transformation, and validation.</li>
<li>Manage and integrate large datasets from diverse cloud and on-premises sources.</li>
<li>Implement and maintain data lake architectures supporting both structured and unstructured data.</li>
<li>Ensure compliance with best practices for cloud security, IAM policies, encryption, and networking.</li>
<li>Participate in designing and maintaining CI/CD pipelines for data solutions using Git.</li>
<li>Collaborate closely with cross-functional teams to define data requirements and deliver scalable solutions.</li>
<li>Troubleshoot data issues, perform root cause analysis, and continuously optimize system performance.</li></ul>
Required Skills &amp; Experience:<ul>
<li>5 to 7 years of professional experience in data engineering with a focus on Azure Data Platform.</li>
<li>Strong expertise in GCP BigQuery (data modeling, query optimization, and performance tuning).</li>
<li>Hands-on experience with Azure Data Factory or other ETL/ELT orchestration tools.</li>
<li>Proficiency in SQL, Python, and scripting for data workflows and automation.</li>
<li>Strong understanding of data lake concepts, data architecture, and data governance.</li>
<li>Familiarity with cloud networking, security, encryption, and IAM principles.</li>
<li>Experience working with CI/CD and version control tools like Git.</li>
<li>Excellent analytical and problem-solving skills with high attention to detail.</li></ul>
Preferred Qualifications:<ul>
<li>Certifications such as:</li>
<li><ul><li>Microsoft Certified: Azure Data Engineer Associate</li>
<li>Google Cloud Professional Data Engineer</li>
</ul></li><li>Experience using Terraform or other Infrastructure-as-Code (IaC) frameworks.</li></ul>
Notice Period: Immediate to 15 Days Only
Work Location : Bangalore(Hybrid)</div>

Data Engineer 1

SB Infowaves

We are seeking a skilled Data Engineer (Good exposure in Power BI) to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate will work closely with data analysts, data scientists, and business stakeholders to ensure data is reliable, accessible, and efficient for analytics and decision-making.Key Responsibilities<ul><li>Design, develop, and maintain robust ETL/ELT pipelines for structured and unstructured data.</li><li>Build and manage data warehouses, data lakes, and real-time data platforms.</li><li>Ensure data quality, consistency, and security across all data systems.</li><li>Optimize database performance and implement best practices for scalability and reliability.</li><li>Collaborate with data analysts, BI developers, and data scientists to understand data needs.</li><li>Automate workflows, monitoring, and error handling in data pipelines.</li><li>Work with cloud platforms (AWS, Azure, GCP) and modern data tools to deliver end-to-end solutions.</li><li>Implement governance standards and contribute to data documentation.</li></ul>Required Skills &amp; Qualifications<ul><li>Bachelor&rsquo;s/Master&rsquo;s degree in Computer Science, Information Systems, or related field.</li><li>Proven experience as a Data Engineer / ETL Developer / Database Engineer.</li><li>Strong knowledge of SQL, Python, and/or Scala/Java.</li><li>Hands-on experience with data integration tools (e.g., Apache Spark, Kafka, Airflow, Talend, Informatica).</li><li>Proficiency in cloud data services: AWS Redshift, Azure Synapse, Google BigQuery, or Snowflake.</li><li>Solid understanding of data modeling, warehousing concepts, and big data technologies (Hadoop, Hive, etc.).</li><li>Experience with CI/CD pipelines, Git, Docker, Kubernetes is a plus.</li><li>Excellent problem-solving, analytical, and communication skills.</li></ul>Job Type: Full-timePay: &#8377;600,000.00 - &#8377;900,000.00 per yearExperience:<ul><li>Data Engineer: 3 years (Preferred)</li></ul>Work Location: In person

Data Engineer

CAI (Computer Aid, Inc.)

Req number: R6413
 
Employment type: Full time
 
Worksite flexibility: Remote Who we are
 CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.
 
Job Summary We are seeking a motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in building cloud-based data lake and analytics architectures using AWS and Databricks and is proficient in Python programming for data processing and automation. This is a Full-time and Remote position.
 
Job Description
 We are looking for a Data Engineer that has experience in building data products using Databricks and related technologies. This position will be Full-time and Remote position.
 What You’ll Do
 
Design, develop, and maintain data lakes and data pipelines on AWS using ETL frameworks and Databricks
 
Integrate and transform large-scale data from multiple heterogeneous sources into a centralized data lake environment
 
Implement and manage Delta Lake architecture using Databricks Delta or Apache Hudi
 
Develop end-to-end data workflows using PySpark, Databricks Notebooks, and Python scripts for ingestion, transformation, and enrichment
 
Design and develop data warehouses and data marts for analytical workloads using Snowflake, Redshift, or similar systems
 
Design and evaluate data models (Star, Snowflake, Flattened) for analytical and transactional systems
 
Optimize data storage, query performance, and cost across the AWS and Databricks ecosystem
 
Build and maintain CI/CD pipelines for Databricks notebooks, jobs, and Python-based data processing scripts
 
Collaborate with data scientists, analysts, and stakeholders to deliver high-performance, reusable data assets
 
Maintain and manage code repositories (Git) and promote best practices in version control, testing, and deployment
 
Participate in making major technical and architectural decisions for data engineering initiatives
 
Monitor and troubleshoot Databricks clusters, Spark jobs, and ETL processes for performance and reliability
 
Coordinate with business and technical teams through all phases of the software development life cycle
 What You'll Need
 Required
 
5+ years of experience building and managing Data Lake Architecture on AWS Cloud
 
3+ years of experience with AWS Data services such as S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS, and Redshift
 
3+ years of experience building Data Warehouses on Snowflake, Redshift, HANA, Teradata, or Exasol
 
3+ years of hands-on experience working with Apache Spark or PySpark, on Databricks
 
3+ years of experience implementing Delta Lakes using Databricks Delta or Apache Hudi
 
3+ years of experience in ETL development using Databricks, AWS Glue, or other modern frameworks
 
Proficiency in Python for data engineering, automation, and API integrations.
 
Experience in Databricks Jobs, Workflows, and Cluster Management
 
Experience with CI/CD pipelines and Infrastructure as Code (IaC) tools like Terraform or CloudFormation is a plus
 
Bachelor’s degree in computer science, Information Technology, Data Science, or related field
 Physical Demands
 
This role involves mostly sedentary work, with occasional movement around the office to attend meetings, etc.
 
Ability to perform repetitive tasks on a computer, using a mouse, keyboard, and monitor
 
Reasonable accommodation statement
 If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.

Riskonnect Inc.

<div><div><div><div>Data Engineer &ndash; Microsoft Fabric &amp; Advanced Analytics
Summary
We are seeking a skilled Data Engineer with hands-on experience in Microsoft Fabric and advanced analytics platforms. The ideal candidate will design, optimize, and maintain data models and data pipelines to support reporting, analytics, and data science needs across the enterprise. You will collaborate closely with data scientists, analytics developers, engineers, and business stakeholders to deliver robust, scalable solutions using tools such as Power BI, Dataflows, Lakehouses, SQL endpoints, and other modern data engineering technologies.
Key Responsibilities
<ul><li>Work closely with data scientists, analytics developers, and business teams to establish data needs and architect scalable solutions.
</li><li>Design, develop, and optimize data pipelines using Microsoft Fabric and other relevant technologies to handle large-scale data workflows.
</li><li>Assemble large, complex data sets that meet functional and non-functional business requirements.
</li><li>Create, manage, and automate ETL (Extract, Transform, Load) processes to integrate data from a variety of sources into unified data warehouses or lakes.
</li><li>Build and maintain efficient data models and schemas, ensuring data is structured for maximum performance and scalability.
</li><li>Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability and performance.
</li><li>Implement best practices for ensuring data quality, consistency, and integrity across all systems.
</li><li>Ensure compliance with global data privacy, security, and regulatory standards.
</li><li>Collaborate with cross-functional teams to ensure smooth data flow and availability for analytics and reporting.
</li><li>Regularly optimize data processes for performance improvements and cost management.
</li><li>Utilize orchestration tools to automate workflows and scheduling of data processes.
</li><li>Document all data processes, architectures, and solutions to facilitate knowledge sharing and future maintenance.
</li>Other duties as assigned. 
<li>
</li></ul>Required Qualifications
<ul><li>Bachelor&rsquo;s degree in Computer Science , Engineering, Information Technology, or a related quantitative field, or equivalent relevant work experience.
</li><li>Strong experience in Microsoft Fabric (e.g., One Lake, Data Pipelines, Dataflows, Lakehouses , SQL endpoints).
</li><li>Experience with cloud-based data services, including Azure Data Lake, Azure SQL Database, or Azure Data Factory.
</li><li>3+ years&rsquo; experience with relational databases and data integration (SQL, Data Warehouse, Data Lake, ETL, Talend, Data Mapping, etc.).
</li><li>2+ years utilizing Data Science tools (Python) for data engineering.
</li><li>Familiarity with ETL tools and pipelines, with hands-on experience using Microsoft Fabric&rsquo;s built-in ETL features.
</li><li>Knowledge of Data Lakehouse concepts and best practices.
</li><li>Experience with data integration, including REST APIs, file systems, and external databases.
</li><li>Strong knowledge of data lifecycle management, data governance, and global privacy practices.
</li><li>Experience with Git for version control, including branching and merging in a collaborative environment.
</li><li>Experience with CI/CD pipelines for data engineering projects.
</li><li>Strong interpersonal communication, problem-solving, troubleshooting, and organizational skills.
</li><li>Ability to work in an agile, collaborative environment with cross-functional teams.
</li><li>Proven ability to drive technical projects from initial concept to implementation with minimal oversight.
</li>Passionate about data quality and process improvement. 
<li>
</li></ul>Preferred Qualifications
<ul><li>Microsoft Azure certification, especially in data engineering or cloud technologies.
</li><li>Experience with Power BI and predictive modeling.
</li><li>Experience with Snowflake or other cloud data warehouse platforms.
</li><li>Familiarity with Striim or similar data integration tools.</li></ul></div></div></div></div>

Augusta HiTech Software

<ul><div>Industry: IT
Qualification: Any Degree
Required Skills: Data Engineering, SQL, ETL Tools, Cloud Platform (Azure Preferred)
Working Shift: 2PM to 11PM IST
City: Coimbatore
Country: India<div><div><div><div>
Name of the position: Data Engineer</div></div><div><div>
Location: Coimbatore</div></div><div><div>
No. of resources needed: 01</div></div><div><div>
Mode: Fulltime</div></div><div><div>
Years of experience: 1+ Years</div></div><div><div>
Shift: UK shift (2pm to 11pm)</div></div><div></div> 
About the Role 
We are looking for a passionate Junior Data Engineer with strong skills in Java and SQL, and some hands-on experience in data engineering or ETL development. 
 You will work alongside senior engineers to build, maintain, and optimize data pipelines and data integration workflows across cloud platforms such as Azure and Snowflake. 
 This role is ideal for candidates with a software development background who are eager to grow their career in data engineering and analytics using modern tools and technologies. 
 
Key Responsibilities 
<ul><div>
Develop and maintain data ingestion and transformation pipelines using Java, SQL, and ETL tools.</div><div>
Work on data extraction, transformation, and loading (ETL/ELT) processes from multiple sources (databases, APIs, flat files, etc.).</div><div>
Collaborate with senior engineers to design and optimize data models in Snowflake or other cloud data warehouses.</div><div>
Write complex SQL queries and stored procedures for data validation, transformation, and analysis.</div><div>
Support Azure Data Factory (ADF), DBT, or similar tools for workflow orchestration.</div><div>
Participate in data quality checks, performance optimization, and troubleshooting.</div><div>
Maintain documentation, ensure code versioning with Git, and assist with CI/CD pipeline integration.</div><div>
Work closely with analysts to ensure reliable, high-quality data delivery for reporting and analytics.</div></ul>
Required Skills &amp; Qualifications 
<ul><div>
Bachelor&rsquo;s degree in Computer Science, Information Technology, or related field.</div><div>
1&ndash;3 years of experience in software development or data engineering.</div><div>
Strong programming knowledge in Java (OOPs, JDBC, APIs, Collections).</div><div>
Proficient in SQL and relational database concepts.</div><div>
Basic hands-on experience with ETL tools (Azure Data Factory, DBT, FiveTran, Talend, etc.).</div><div>
Understanding of data warehousing, data modeling (Star/Snowflake schemas), and data pipelines.</div><div>
Familiarity with cloud platforms (Azure preferred, AWS optional).</div><div>
Strong analytical and problem-solving abilities with good communication skills.</div></ul></div></div></div></ul><div></div>

Encora

<div>Important Information 
 
Location: Gurugram/Delhi-NCR preferred 
Experience: Senior (6+ to 9 years of work experience), Lead (10+ years of work experience) 
Job Mode: Full-time 
 
Job Summary

We are seeking a talented and motivated Data Engineer with requisite years of hands-on experience to join our growing data team. The ideal candidate will have experience working with large datasets, building data pipelines, and utilizing AWS public cloud services to support the design, development, and maintenance of scalable data architectures. This is an excellent opportunity for individuals who are passionate about data engineering and cloud technologies and want to make an impact in a dynamic and innovative environment.

Responsibilities and Duties&middot;
<ul>
<li>Data Pipeline Development: Design, develop, and optimize end-to-end data pipelines for extracting, transforming, and loading (ETL) large volumes of data from diverse sources into data warehouses or lakes.</li>
<li>Cloud Infrastructure Management: Implement and manage data processing and storage solutions in AWS (Amazon Web Services) using services like S3, Redshift, Lambda, Glue, Kinesis, and others.</li>
<li>Data Modeling: Collaborate with data scientists, analysts, and business stakeholders to define data requirements and design optimal data models for reporting and analysis.</li>
<li>Performance Tuning &amp; Optimization: Identify bottlenecks and optimize query performance, pipeline processes, and cloud resources to ensure cost-effective and scalable data workflows.</li>
<li>Automation &amp; Scripting: Develop automated data workflows and scripts to improve operational efficiency using Python, SQL, or other scripting languages.</li>
<li>Collaboration &amp; Documentation: Work closely with data analysts, data scientists, and other engineering teams to ensure data availability, integrity, and quality. Document processes, architectures, and solutions clearly.</li>
<li>Data Quality &amp; Governance: Ensure the accuracy, consistency, and completeness of data. Implement and maintain data governance policies to ensure compliance and security standards are met.</li>
<li>Troubleshooting &amp; Support: Provide ongoing support for data pipelines and troubleshoot issues related to data integration, performance, and system reliability.</li>
</ul>
Qualifications and Skills

Essential Skills:
<ul>
<li>Experience: Senior (6+ to 9 years) or Lead (10+ years) of professional experience as a Data Engineer, with a strong background in building and optimizing data pipelines and working with large-scale datasets.</li>
<li>AWS Experience: Hands-on experience with AWS cloud services, particularly S3, Lambda, Glue, Redshift, RDS, and EC2.</li>
<li>ETL Processes: Strong understanding of ETL concepts, tools, and frameworks. Experience with data integration, cleansing, and transformation.</li>
<li>Programming Languages: Proficiency in Python, SQL, and other scripting languages (e.g., Bash, Scala, Java).</li>
<li>Data Warehousing: Experience with relational and non-relational databases, including data warehousing solutions like AWS Redshift, Snowflake, or similar platforms.</li>
<li>Data Modeling: Experience in designing data models, schema design, and data architecture for analytical systems.</li>
<li>Version Control &amp; CI/CD: Familiarity with version control tools (e.g., Git) and CI/CD pipelines.</li>
<li>Problem-Solving: Strong troubleshooting skills, with an ability to optimize performance and resolve technical issues across the data pipeline.</li>
</ul>
Desirable Skills:
<ul>
<li>Big Data Technologies: Experience with Hadoop, Spark, or other big data technologies.</li>
<li>Containerization &amp; Orchestration: Knowledge of Docker, Kubernetes, or similar containerization/orchestration technologies.</li>
<li>Data Security: Experience implementing security best practices in the cloud and managing data privacy requirements.</li>
<li>Data Streaming: Familiarity with data streaming technologies such as AWS Kinesis or Apache Kafka.</li>
<li>Business Intelligence Tools: Experience with BI tools (Tableau, Quicksight) for visualization and reporting.</li>
<li>Agile Methodology: Familiarity with Agile development practices and tools (Jira, Trello, etc.)</li>
</ul>
About Encora 
 
Encora is the preferred digital engineering and modernization partner of some of the world's leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora's technology practices include Product Engineering &amp; Development, Cloud Services, Quality Engineering, DevSecOps, Data &amp; Analytics, Digital Experience, Cybersecurity, and AI &amp; LLM Engineering. 
 
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.</div>

Quadrabay Verification Services

Position SummaryWe are seeking a skilled Data Engineer with strong expertise in building and managing ETL/ELT pipelines using PySpark within an AWS cloud environment. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data workflows to support multiple data sources, while ensuring seamless integration with Power BI for reconciliation, reporting, and advanced analytics.Key Responsibilities&middot; Data Pipeline Developmento Design, develop, and maintain scalable ETL/ELT pipelines using PySpark.o Implement data ingestion from multiple data sources (Finance, CRM, Payment Gateways, etc.) into AWS Data Lake/Warehouse.o Ensure efficient data partitioning, schema management, and optimization for large datasets.&middot; Cloud &amp; Infrastructure (AWS)o Leverage AWS services (S3, Glue, EMR, Redshift, Lambda, Step Functions) for data engineering workflows.o Implement data security, access control, and compliance in line with organizational standards.o Automate deployments using CI/CD pipelines.&middot; Data Integration &amp; Reportingo Prepare curated datasets for Power BI dashboards and reports.o Enable reconciliation processes by providing granular, auditable datasets.o Collaborate with BI developers to ensure data accuracy, integrity, and performance in reporting.&middot; Collaboration &amp; Processo Work closely with Business Analysts, Data Scientists, and ERP functional teams to understand requirements.o Participate in data governance initiatives, ensuring metadata, lineage, and quality controls are implemented.o Provide support for ad-hoc analytics requests from stakeholders.Required Skills &amp; Qualifications&middot; Technical Skillso Strong programming in Python with deep knowledge of PySpark.o Proven experience in ETL/ELT pipeline development in distributed environments.o Expertise in AWS data services (S3, Glue, EMR, Redshift, Athena, Lambda, Kinesis).o Proficiency in SQL (analytical queries, optimization, tuning).o Familiarity with Power BI integration (Direct Query, Dataflows, Gateways).&middot; Data Engineering Practiceso Experience with data lakes, warehouses, and star/snowflake schema design.o Knowledge of data quality frameworks, reconciliation processes, and auditability controls.o Hands-on experience with workflow orchestration tools.&middot; Soft Skillso Strong problem-solving and analytical skills.o Ability to collaborate across IT, business, and analytics teams.o Clear communication for technical and non-technical stakeholders.Preferred Qualifications&middot; Experience with ERP data models (Finance, CRM - Reconciliation).&middot; Exposure to machine learning data preparation (feature engineering, training/test datasets).&middot; Certification(s):o AWS Certified Data Analytics &ndash; Specialtyo Databricks/Spark Developer Certificationo Microsoft Power BI Data Analyst AssociateJob Type: Full-timeAbility to commute/relocate:<ul><li>Ajman: Reliably commute or planning to relocate before starting work (Preferred)</li></ul>Application Question(s):<ul><li>Availability to start immediately </li><li>Visa Status</li></ul>Experience:<ul><li>Data Engineer: 3 years (Preferred)</li></ul>Language:<ul><li>English (Preferred)</li></ul>

Search 10000+ Data engineer jobs near you this November. New roles added regularly across leading industries. Apply today.

10000 data engineer jobs NEAR_ME

Data Engineer 1

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer