data pipeline engineer

Infosys

<div><h2 class="jobSectionHeader"><b>Job Description:</b></h2><br>
<ul>
<li>We are seeking an experienced Data Engineer with strong expertise in Azure Data Services Big Data technologies and ETL ELT processes</li>
<li>The ideal candidate will have domain knowledge in CPG and Manufacturing sectors along with hands on experience in data governance data modeling and cloud based data engineering</li>
<li>This role involves building scalable data pipelines integrating industrial data platforms and enabling advanced analytics for smarter decision making</li></ul><br>
<h2 class="jobSectionHeader"><b>
Key Responsibilities:</b></h2><br>
<ul>
<li>Design and develop data pipelines using Azure Data Factory Azure Databricks and Azure Data Lake Gen2</li>
<li>Implement ETL ELT processes data integration techniques and data governance standards</li>
<li>Work with Big Data technologies such as Apache Spark and PySpark for large scale data processing</li>
<li>Gather engineer and prepare data for analytics and business insights</li>
<li>Integrate systems and data across diverse environments ensuring seamless connectivity</li>
<li>Build solutions to extract and consolidate data from multiple sources sales inventory product customer databases</li>
<li>Collaborate with ML Engineers Data Scientists and business stakeholders to enable automation and advanced analytics</li>
<li>Contribute to coding standards and best practices for data engineering workloads</li>
<li>Support modernization initiatives aligned with Industry 4</li>
<li>0 and ISA 95 standards</li></ul><br>
<h2 class="jobSectionHeader"><b>
Technical Requirements:</b></h2><br>
<ul>
<li>5 7 years of experience in data engineering and data governance within industrial domains CPG Manufacturing</li>
<li>Strong knowledge of Azure Data Services Azure Data Factory Azure Databricks Azure Data Lake Gen2</li>
<li>Expertise in ETL processes data integration tools and pipeline development</li>
<li>Proficiency in Python SQL and Apache Spark</li>
<li>Understanding of Industry 4</li>
<li>0 ISA 95 standards and maintenance strategies</li>
<li>Familiarity with AI ML concepts and ability to work with advanced analytics teams</li>
<li>Experience with DevOps CI CD for data pipeline automation</li></ul><br>
<h2 class="jobSectionHeader"><b>
Additional Responsibilities:</b></h2><br>
<ul>
<li>Good to have</li>
<li>Exposure to data modeling data warehousing and cloud architecture</li>
<li>Knowledge of business intelligence tools and statistical programming</li>
<li>Ability to research and implement new tools for automation and optimization</li></ul><br>
<h2 class="jobSectionHeader"><b>
Preferred Skills:</b></h2>
Technology-&gt;Data Engineering-&gt;Databricks,Technology-&gt;Cloud Integration-&gt;Azure Data Factory (ADF),Technology-&gt;Cloud Platform-&gt;Azure Analytics Services-&gt;Azure Data Lake,Technology-&gt;Consulting - Data Governance-&gt;Data Governance,Technology-&gt;Database-&gt;Data Modeling,Technology-&gt;OpenSystem-&gt;Python - OpenSystem</div>

Data Engineer

Cywarden, Inc.

<p><b>Job Title:</b> Data Engineer</p><p><b>Experience:</b> 3+ Years<br/><b>Location:</b> Mohali<br/><b>Employment Type:</b> Full-time (US Shifts)</p><p><b>Job Summary</b></p><p>We are seeking a skilled and detail-oriented <b>Data Engineer</b> with <b>3+ years of hands-on experience</b> in designing, building, and maintaining scalable data pipelines and data platforms. The ideal candidate will work closely with data analysts, data scientists, and product teams to ensure high-quality, reliable, and secure data solutions that support business decision-making.</p><p><b>Key Responsibilities</b></p><ul><li>Design, develop, and maintain scalable <b>ETL/ELT pipelines</b> for structured and unstructured data</li><li>Build and optimize <b>data warehouses and data lakes</b></li><li>Ensure data quality, integrity, and reliability across multiple data sources</li><li>Collaborate with cross-functional teams to understand data requirements and deliver solutions</li><li>Optimize database performance, queries, and data storage</li><li>Implement data governance, security, and compliance best practices</li><li>Monitor data pipelines and troubleshoot issues in production environments</li><li>Document data architectures, workflows, and processes</li></ul><p><b>Required Skills &amp; Qualifications</b></p><ul><li><b>3+ years of experience</b> as a Data Engineer or in a similar role</li><li>Strong proficiency in <b>SQL</b> and <b>Python</b></li><li>Hands-on experience with <b>ETL tools</b> and data pipeline frameworks (Airflow, Talend, dbt, etc.)</li><li>Experience with <b>relational and NoSQL databases</b></li><li>Solid understanding of <b>data modeling</b>, warehousing, and schema design</li><li>Experience working with <b>cloud platforms</b> (AWS / Azure / GCP)</li><li>Familiarity with <b>big data technologies</b> (Spark, Hadoop) is a plus</li><li>Strong problem-solving and analytical skills</li></ul><p>Job Type: Full-time</p><p>Pay: ₹525,949.58 - ₹993,621.83 per year</p><p>Work Location: In person</p>

Data Engineer (3+ Years)

Pragma Edge

<div></div><div><div><div><div><div><div><div><div><div><div><div><div><div><ul><div><div>Job Category - IT</div>
</div><div></div><div><div>Job Type - Full Time</div>
</div><div></div><div><div>No of openings: 01</div>
</div><div></div><div><div>Experience : 6 to 8 Years</div>
</div><div></div><div><div>Job Location - Hyderabad</div>
</div></ul></div></div></div></div></div></div></div></div></div></div><div></div><div><div><div><div><div><div><div>Senior IT Data Engineer</div>
</div></div><div><div><p>The Senior IT Data Engineers are experts in data streaming, building data pipelines that support real-time data refreshes and are cost-optimized for computing resources. They deeply understand data security, implementing row-level and column-level security measures.
</p><p>This role typically involves leading the implementation of complex projects, using advanced big data technologies, and ensuring robust data pipeline orchestration across multiple systems.</p>
</div></div><div><div><div>Job Responsibilities</div>
</div></div><div><div><ul><li>Lead the design and orchestration of complex data pipelines and ETL processes, focusing on optimizing data models.</li><li>
Architect scalable data solutions, including data warehousing and big data technologies, and ensure alignment with organizational goals.</li><li>
Implement advanced data governance frameworks and ensure robust data security measures.</li><li>
Optimize cloud costs by strategically using cloud resources and efficient data architectures.</li><li>
Lead the development of data visualization strategies, ensuring they contribute to data-driven decision-making at a strategic level.</li><li>
Design and deploy enterprise-scale data visualization solutions, optimizing performance within tools.</li><li>
Oversee complex data pipeline orchestration and ensure seamless integration across systems.</li><li>
Interact with 3rd party vendors to incorporate new functionality and evaluate tools.</li><li>
Resolve complex escalations and situations, driving effective resolutions.</li><li>
Ensure adherence to data privacy and security practices to protect sensitive information.</li><li>
Communicate effectively with stakeholders to understand and address their needs through data visualization.</li><li>
Perform other assigned job-related duties that align with our organization&rsquo;s vision, mission, and values and fall within your scope of practice.</li></ul>
</div></div><div><div><div>Qualifications</div>
</div></div><div><div><ul><li>Education: Bachelor&rsquo;s Degree or relevant experience.</li><li>
Preferred Certification(s): Any relevant IT Certification.</li><li>
Experience: 5+ years of relevant and practical experience.</li></ul><p><b>
Special Skills:</b></p><ul><li>
Advanced skills in data streaming and real-time data processing.</li><li>
Expertise in designing complex data architectures and scalable systems.</li><li>
Deep knowledge of big data technologies and extensive experience with data security measures.</li><li>
Ability to lead data architecture reviews and approvals.</li></ul><p><b>
Soft Skills:</b></p><ul><li>
Project Management: Learning and understanding complex data initiatives from conception to completion.</li><li>
Mentorship: Guiding junior team members in their professional development.</li><li>
Strategic Thinking: Aligning data solutions with broader organizational goals.</li><li>
Communication: Articulating data strategies to both technical and non-technical stakeholders.</li><li>
Problem-Solving: Resolving complex data challenges and escalations.</li><li>
Adaptability: Staying current with rapidly evolving data technologies and best practices.</li><li>
Creativity: Innovating new approaches to data pipeline design and optimization.</li></ul></div></div></div></div></div></div></div></div></div><p></p>

ClientServer Technology Solutions LLC

<p><b>Job Title: Data Engineer (1&ndash;3 Years Experience)</b></p><p><b>Location:Hyderabad</b></p><p><b>Work Mode: Work From Office</b></p><p><b>Job Summary:</b></p><p>We are looking for a detail-oriented <b>Data Engineer</b> with <b>1 to 3 years of experience</b> to design, build, and maintain scalable data pipelines and data platforms. The ideal candidate should have strong technical skills in data processing, databases, and cloud technologies, and be eager to work with large datasets to support analytics and business intelligence needs.</p><p><b>Key Responsibilities:</b></p><ul><li>Design, develop, and maintain <b>ETL/ELT pipelines</b> for structured and unstructured data</li><li>Build and optimize data workflows for data ingestion, transformation, and storage</li><li>Work with large-scale datasets from multiple sources</li><li>Ensure data quality, integrity, and reliability</li><li>Collaborate with data analysts, data scientists, and product teams</li><li>Optimize database performance and query efficiency</li><li>Support data warehouse and data lake solutions</li><li>Monitor and troubleshoot data pipeline issues</li><li>Document data architecture, pipelines, and processes</li></ul><p>Required Skills &amp; Qualifications</p><ul><li>Bachelor&rsquo;s degree in Computer Science, Engineering, IT, or a related field</li><li>1&ndash;3 years of experience in <b>Data Engineering or related roles</b></li><li>Strong knowledge of <b>SQL</b> and relational databases</li><li>Experience with <b>Python, Java, or Scala</b> for data processing</li><li>Familiarity with <b>ETL tools</b> and data integration frameworks</li><li>Experience with <b>data warehouses</b> (Snowflake, Redshift, BigQuery, etc.)</li><li>Basic understanding of <b>cloud platforms</b> (AWS, Azure, or GCP)</li><li>Knowledge of data modeling concepts (star/snowflake schema)</li></ul><p><b>Preferred Skills (Good to Have):</b></p><ul><li>Experience with <b>Apache Spark, Hadoop, Kafka, or Airflow</b></li><li>Exposure to <b>Big Data technologies</b></li><li>Experience with <b>NoSQL databases</b> (MongoDB, Cassandra, DynamoDB)</li><li>Familiarity with <b>Docker and Kubernetes</b></li><li>Understanding of data security, governance, and compliance</li><li>Cloud data certifications or relevant training</li></ul><p>Job Type: Full-time</p><p>Pay: ₹200,000.00 - ₹300,000.00 per year</p><p>Work Location: In person</p>

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><p><b>Azure Data Engineer</b></p>
<p><b>Location: Bangalore</b></p>
<p><b>Experience :</b><b> 5 - 10 years</b></p>
<p><b>Job Description :</b></p>
<div><b>Data Engineer with expertise in Snowflake, Apache Airflow, SQL and Python.</b><br>
<b>Responsible for designing, implementing, and optimizing our data infrastructure on Snowflake and Airflow.</b><br>
<b>Work closely with cross-functional teams to ensure that our data pipelines, models, and analytics capabilities are robust, scalable, and meet business needs.</b><br>
<ul><li><b>Design, implement, and maintain Snowflake and Airflow ETL/ELT data pipelines and architecture.</b></li></ul><b>
Must have experience in AWS services usage like S3, IAM, Lambda and MWAA.</b><br>
<b>Optimize Snowflake performance by fine-tuning queries, storage, and data organization.</b><br>
<b> Ingesting data from Amazon S3 buckets into Snowflake</b><br>
<b> Good to have experience in usage of Git/Bitbucket and CI/CD for Jenkins build pipeline and release process.</b></div>
</div></div></div><div><div><div><b>Location</b></div>
<div>Bengaluru</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>387237</div>
</div><div><div><b>Desired Skills</b></div>
<div>Python | SQL</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF ENGINEERING</div></div></div><div></div>

Snowflake Data Engineer

Capgemini

<div><div><div><p>RIYADH</p><div>
Data Engineer</div><p>
</p></div></div><div></div><div><div><div><div><div><p>
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world&rsquo;s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&amp;D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.</p><div><div><div><div>
Your Role</div></div><div><p>
We are looking for a skilled and detail-oriented Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will ensure the efficient flow of data across systems to support analytics and business intelligence in manufacturing operations.</p><p><b>
You will be accountable for:</b></p><ul><li>
Designing, developing, and maintaining robust ETL/ELT pipelines for data ingestion and transformation.</li><li>
Optimizing data storage and retrieval for performance and scalability.</li><li>
Ensuring data quality, integrity, and security across systems.</li><li>
Collaborating with data scientists, analysts, and IT teams to support data needs.</li><li>
Implementing and managing data architecture and infrastructure on cloud or on-prem platforms.</li><li>
Monitoring and troubleshooting data pipeline issues and system performance.</li><li>
Maintaining documentation of data flows, schemas, and system configurations.</li><li>
Supporting real-time data processing and integration with IoT and manufacturing systems.</li></ul></div></div><div><div><div>
Your Profile</div></div><div><ul><li>
Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Information Systems, or a related field.</li><li>
2&ndash;5 years of experience in data engineering or software development, preferably in manufacturing.</li><li>
Proficiency in SQL, Python, and data pipeline tools (e.g., Apache Airflow, Talend).</li><li>
Experience with cloud data platforms (e.g., Azure Data Factory, AWS Glue, GCP Dataflow).</li><li>
Knowledge of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).</li><li>
Familiarity with big data technologies (e.g., Hadoop, Spark) and real-time streaming (e.g., Kafka).</li><li>
Strong understanding of data modeling, database design, and system integration.</li><li>
Excellent collaboration and communication skills.</li></ul></div></div><div><div><div>
What You&rsquo;ll Love About Working Here
</div></div><div></div><div><div><ul><li><p>Flexible Work Arrangements&mdash;Work remotely or adjust work hours for a balanced lifestyle.
</p></li></ul></div><div><ul><li><p>Career Growth Opportunities&mdash;Access diverse roles and career development programs.
</p></li></ul></div><div><ul><li><p>Training &amp; Certifications&mdash;Equip yourself with valuable certifications in emerging technologies.
</p></li></ul></div></div></div></div><p>Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.</p></div></div><div><div><div>
<div><div>Ref. code</div><div>
284564-en_US</div></div><div><div>
Posted on</div><div>
17 Jul 2025</div></div><div><div>
Experience level</div><div>
Experienced Professionals</div></div><div><div>
Contract type</div><div>
Fixed Term Contract</div></div><div><div>
Location</div><div>
RIYADH</div></div><div><div>
Business unit</div><div>
Engineering and RandD Services</div></div><div><div>
Brand</div><div>
Capgemini Engineering</div></div><div><div>
Professional communities</div><div>
Software Engineering</div></div></div></div></div></div></div></div></div><p></p>

APPTESTIFY GLOBAL SERVICES PVT LTD

<p><b>Role: Databricks Engineer</b></p><p><b>Location:</b> Remote<br/><b>Experience:</b> 5+ Years</p><p><b>About the Role:</b></p><p>We are looking for an experienced <b>Databricks Engineer</b> with strong expertise in big data processing and analytics. The ideal candidate will work closely with data engineers, data scientists, and business stakeholders to design, develop, and optimize scalable data solutions using Databricks.</p><p><b>Key Responsibilities:</b></p><ul><li>Design, develop, and maintain scalable data pipelines using <b>Databricks</b></li><li>Work with <b>Apache Spark (PySpark/Scala)</b> for large-scale data processing</li><li>Optimize Databricks jobs for performance, cost, and reliability</li><li>Integrate data from multiple sources (structured &amp; unstructured)</li><li>Implement data transformation, cleansing, and validation processes</li><li>Collaborate with cross-functional teams to deliver data-driven solutions</li><li>Ensure data quality, security, and governance best practices</li><li>Troubleshoot and resolve data pipeline and performance issues</li></ul><p><b>Required Skills &amp; Qualifications:</b></p><ul><li>5+ years of experience in <b>Data Engineering / Big Data</b> roles</li><li>Strong hands-on experience with <b>Databricks</b></li><li>Proficiency in <b>Apache Spark, PySpark, or Scala</b></li><li>Experience with <b>SQL</b> and data modeling concepts</li><li>Familiarity with cloud platforms (<b>Azure / AWS / GCP</b>)</li><li>Experience working with <b>ETL/ELT pipelines</b></li><li>Knowledge of data lakes, Delta Lake, and big data ecosystems</li><li>Good understanding of data warehousing and analytics concepts</li></ul><p><b>Nice to Have:</b></p><ul><li>Databricks certifications</li><li>Experience with <b>Delta Live Tables</b> and <b>Unity Catalog</b></li><li>Exposure to CI/CD for data pipelines</li><li>Experience supporting analytics and ML workloads</li></ul><p>Job Types: Full-time, Contractual / Temporary<br/>Contract length: 12 months</p><p>Pay: ₹70,000.00 - ₹80,000.00 per month</p><p>Work Location: Remote</p>

Databricks Engineer/5+ years/Remote

Search 10000+ Data pipeline engineer jobs near you this January. New roles added regularly across leading industries. Apply today.

10000 data pipeline engineer jobs NEAR_ME

Data Engineer

Data Engineer (3+ Years)

Data Engineer

Data Engineer

Snowflake Data Engineer

Data Engineer

Databricks Engineer/5+ years/Remote