data pipeline engineer

Everforce Software India Pvt.LTD

<p><b>Job Title: Senior Data Pipeline Engineer</b></p><p>Location: Remote | Chennai, India</p><p>Duration: 6+ months (extendable based on performance)</p><p>Experience Required: 8+ years</p><p>Work Timing: Flexible (supporting US &amp; India)</p><p><b>Job Overview</b></p><p>We are seeking an experienced Senior Data Pipeline Engineer with strong expertise in modern data platforms. The ideal candidate will have hands-on experience in building, optimising, and scaling large-scale batch and real-time data pipelines using cutting-edge technologies. This role involves working with cross-functional teams to deliver reliable, high-quality data solutions for enterprise-grade applications.</p><p><b>Key Responsibilities</b></p><p>- Design, develop, and maintain scalable and reliable data pipelines for both batch and real-time workloads.</p><p>- Implement real-time event streaming and data ingestion using Apache Kafka.</p><p>- Build and optimise ETL/ELT workflows on Databricks and integrate with Snowflake for analytics and reporting.</p><p>- Write efficient, production-ready code in Python, Node.js, and Java.</p><p>- Collaborate with data scientists, analysts, and business stakeholders to deliver consistent data solutions.</p><p>- Ensure data quality, governance, and security across platforms.</p><p>- Monitor, debug, and optimise distributed data systems for high performance.</p><p>- Lead and mentor junior engineers, promoting best practices in data engineering.</p><p><b>Required Qualifications</b></p><p>- 8+ years of professional experience in data engineering or software engineering.</p><p>- Strong expertise in PySpark for distributed data processing.</p><p>- Hands-on experience with Apache Kafka for data streaming.</p><p>- Proficiency with Databricks for big data and ML-driven workloads.</p><p>- Experience with Snowflake for cloud data warehousing.</p><p>- Advanced programming skills in Python, with proficiency in Node.js and Java.</p><p>- Solid knowledge of ETL/ELT frameworks, data modelling, and pipelines.</p><p>- Strong understanding of distributed systems and cloud-based architectures.</p><p>- Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Engineering, or a related field.</p><p><b>Preferred Skills</b></p><p>- Experience with cloud platforms (AWS, Azure, GCP).</p><p>- Knowledge of CI/CD pipelines and containerization (Docker, Kubernetes).</p><p>- Familiarity with MLOps and data science workflows.</p><p>- Strong system design and debugging skills in large-scale environments.</p><p>- Excellent communication and problem-solving abilities.</p><p><b>What We Offer</b></p><p>- Opportunity to design and scale enterprise-grade data infrastructure.</p><p>- Competitive compensation with career growth opportunities.</p><p>- Flexible and collaborative work environment.</p><p>Job Type: Contractual / Temporary<br/>Contract length: 6 months</p><p>Work Location: In person</p>

Senior Data Pipeline Engineer

Terex Corporation

<div><div>Job Description:</div><div><div><div>
Position - Data Engineer</div></div><div></div><div><div><br>
Position Overview:</div></div><div><div>
The successful Engineer will be responsible for expanding and optimizing our Telematic data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder who enjoys optimizing data systems and building them from the ground up. The Engineer will support our application developers, database architects, data analysts and data scientists on company initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even reshaping our company&rsquo;s data architecture to support our next generation of products and data initiatives.</div></div><div></div><div><div><br>
Responsibilities:</div></div><div><ul><li><div>
Create and maintain data pipelines and code pipelines.</div></li></ul></div><div><ul><li><div>
Assemble large, complex data sets that meet functional / non-functional business requirements.</div></li></ul></div><div><ul><li><div>
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.</div></li></ul></div><div><ul><li><div>
Define the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies and services.</div></li></ul></div><div><ul><li><div>
Support data sets in analytics tools to provide actionable insights into operational efficiency and other key business performance metrics.</div></li></ul></div><div><ul><li><div>
Work with stakeholders to assist with data-related technical issues and support their data needs.</div></li></ul></div><div><ul><li><div>
Work with data and analytics experts to strive for greater functionality in our data systems.</div></li></ul></div><div></div><div><div><br>
Required Qualifications:</div></div><div><ul><li><div>
Bachelor&rsquo;s Degree with 3-5 years relevant work experience as a data engineer</div></li></ul></div><div><ul><li><div>
Strong problem-solving skills with an emphasis on data value</div></li></ul></div><div><ul><li><div>
Experience working with and creating data architectures</div></li></ul></div><div><ul><li><div>
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.</div></li></ul></div></div><div><div><ul><li><div>
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.</div></li></ul></div><div><ul><li><div>
Strong analytic skills related to working with unstructured datasets.</div></li></ul></div><div><ul><li><div>
Build processes supporting data transformation, data structures, metadata, dependency and workload management.</div></li></ul></div><div><ul><li><div>
A successful history of manipulating, processing and extracting value from large, disconnected datasets including business systems like PLM, ERP, and MES</div></li></ul></div><div><ul><li><div>
Experience supporting and working with cross-functional teams in a dynamic environment.</div></li></ul></div><div><ul><li><div>
Experience using the following software/tools:</div></li></ul></div><div><ul><li><div>
Experience with big data tools:, Kafka</div></li></ul></div><div><ul><li><div>
Experience with relational SQL and NoSQL databases, including Redshift, Oracle.</div></li></ul></div><div><ul><li><div>
Experience using AWS cloud services: Redshift, S3, Data Pipeline, Elasticsearch, Glue, EMR, Athena</div></li></ul></div><div></div><div><div><br>
Preferred Qualifications:</div></div><div><ul><li><div>
Strong project management and organizational skills</div></li></ul></div><div><ul><li><div>
Experience with Agile Scrum teams and associated tools</div></li></ul></div><div><ul><li><div>
5-7 years of experience manipulating data sets and data pipelines</div></li></ul></div><div><ul><li><div>
Coding knowledge and experience with several languages and environments</div></li></ul></div><div><ul><li><div>
Experience preparing data for visualizations for stakeholders using: Qlikview, QuickSight, Tableau, Business Objects, etc.</div></li></ul></div><div><ul><li><div>
Working knowledge of message queuing, stream processing, and highly scalable &lsquo;big data&rsquo; data stores.</div></li></ul></div><div></div><div><div><br>
Language:</div></div><div><ul><li><div>
Fluent English Required</div></li></ul></div></div><div></div><div><br>
If you are interested in an open position but feel you may not meet all the listed qualifications, we still encourage you to apply.</div><div></div><div>
About Terex:</div><div>
Terex Corporation is a global industrial equipment manufacturer of materials processing machinery, waste and recycling solutions, mobile elevating work platforms (MEWPs), and equipment for the electric utility industry. We design, build, and support products used in maintenance, manufacturing, energy, minerals and materials management, construction, waste and recycling, and the entertainment industry. We provide best-in-class lifecycle support to our customers through our global parts and services organization, and offer complementary digital solutions, designed to help our customers maximize their return on their investment. Certain Terex products and solutions enable customers to reduce their impact on the environment including electric and hybrid offerings that deliver quiet and emission-free performance, products that support renewable energy, and products that aid in the recovery of useful materials from various types of waste. Our products are manufactured in North America, Europe, and Asia Pacific and sold worldwide.</div><div></div><div>
Additional Information:</div><div>
We are passionate about producing equipment that helps improve the lives of people around the world and providing our team members with a rewarding career and the opportunity to make an impact. We are committed to recruiting, engaging, developing, and retaining team members at all levels of our global workforce. Our culture is defined by our Terex Way Values &ndash; Integrity, Respect, Improvement, Servant Leadership, Courage, and Citizenship. Our values are the driving force behind our commitment to maintain an inclusive, supportive, non-discriminatory, and safe workplace for all team members. To that end, we are committed to actively foster a culture where every team member feels valued, listened to, and appreciated. We are committed to being fair and impartial in our decisions. As an Equal Opportunity Employer, employment decisions are made without regard to race, color, religion, national origin, sex, sexual orientation, gender identity or expression, age, disability, protected veteran status or other characteristics protected by law. If you are a qualified individual with a disability, including disabled veterans, you may request a reasonable accommodation if you are unable or limited in your ability to access job openings or apply for a job on this site as a result of your disability. You can request reasonable accommodations by contacting the recruiting department (person or department) at<i> </i><div>Globaltalentacquisitions@terex.com</div><i>.</i></div><div></div><div>
The Company offers competitive salaries, advancement opportunities, and a full range of benefits, including paid vacation, 401(k), medical, dental, and vision.</div></div><div></div>

Data Engineer

<div><h4 class="jobSectionHeader"><b>Job Description</b></h4>
<p></p><div><p>Key Responsibilities:<br>
&#61623; Develop, construct, test and maintain architectures<br>
&#61623; Align architecture with business requirements<br>
&#61623; Data acquisition<br>
&#61623; Develop data set processes<br>
&#61623; Use programming language and tools<br>
&#61623; Identify ways to improve data reliability, efficiency and quality<br>
&#61623; Conduct research for industry and business questions<br>
&#61623; Use large data sets to address business issues<br>
&#61623; Deploy sophisticated analytics programs, machine learning and statistical methods<br>
&#61623; Prepare data for predictive and prescriptive modeling<br>
&#61623; Find hidden patterns using data<br>
&#61623; Use data to discover tasks that can be automated<br>
&#61623; Deliver updates to stakeholders based on analytics<br>
&#61623; Assemble large, complex data sets that meet functional / non-functional business requirements.<br>
&#61623; Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.<br>
&#61623; Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Any ETL Tool.<br>
&#61623; Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.<br>
&#61623; Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.<br>
&#61623; Keep our data separated and secure across national boundaries through multiple data centers and Cloud.<br>
&#61623; Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.<br>
&#61623; Work with data and analytics experts to strive for greater functionality in our data systems.</p>
<p>
Candidate Qualifications:<br>
Business Knowledge/Technical Skills:<br>
&#61623; Bachelor of Computer Science or Engineering<br>
&#61623; 2+ Years&rsquo; Experience<br>
&#61623; Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.<br>
&#61623; Experience building and optimizing &lsquo;big data&rsquo; data pipelines, architectures and data sets.<br>
&#61623; Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.<br>
&#61623; Strong analytic skills related to working with unstructured datasets.<br>
&#61623; Build processes supporting data transformation, data structures, metadata, dependency and workload management.<br>
&#61623; A successful history of manipulating, processing and extracting value from large disconnected datasets.<br>
&#61623; Working knowledge of message queuing, stream processing, and highly scalable &lsquo;big data&rsquo; data stores.<br>
&#61623; Strong project management and organizational skills.<br>
&#61623; Experience supporting and working with cross-functional teams in a dynamic environment.</p></div><p></p>
<h4 class="jobSectionHeader"><b>Skills</b></h4>
<p></p><div><p>For experience Data engineer<br>
&#61623; For experience Data engineer<br>
&#61623; Experience with big data tools: Hadoop, Spark, Kafka, etc.<br>
&#61623; Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.<br>
&#61623; Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.<br>
&#61623; Experience with AWS cloud services: EC2, EMR, RDS, Redshift<br>
&#61623; Experience with stream-processing systems: Storm, Spark-Streaming, etc.<br>
&#61623; Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc</p></div><p></p>
<h4 class="jobSectionHeader"><b>Education</b></h4>
<div><p>Bachelor degree of Engineering</p></div></div><p></p>
<br><div></div><div><div><h4 class="jobSectionHeader"><b>Job Details</b></h4>
<div><div>Job Location</div>
<div>Cairo, Egypt</div>
</div><div><div>Job Role</div>
<div>Information Technology</div>
</div><div><div>Employment Status</div>
<div>Full time</div>
</div><div><div>Employment Type</div>
<div>Employee</div>
</div></div><div><h4 class="jobSectionHeader"><b>Preferred Candidate</b></h4>
<div><div>Career Level</div>
<div>Entry Level</div>
</div><div><div>Years of Experience</div>
<div>Min: 2 Max: 5</div>
</div><div><div>Residence Location</div>
<div>Cairo, Egypt</div>
</div><div><div>Nationality</div>
<div>Egypt</div>
</div><div><div>Degree</div>
<div>Bachelor's degree</div></div></div></div>

PeopleGrove

<div><div><p><div><p>Data Engineer</p><div><div><b>
Mumbai Metropolitan Region</b></div><div><b>Engineering /</b></div><div><b>Full Time (Remote) /</b></div><div><b>Remote</b></div></div></div><p>
</p></p></div><div><div><div>
We are looking for a skilled <b>Data Engineer</b> to design, build, and maintain the pipelines and models that power our analytics, reporting, and machine learning initiatives. You&rsquo;ll be central to transforming raw data into reliable, actionable insights by integrating diverse sources into a unified data platform.</div><div></div><div><br>
This is a hands-on role where you&rsquo;ll own the <b>end-to-end data flow</b> &mdash; from ingestion and transformation to modeling and optimization &mdash; ensuring that data across the company is <b>high-quality, consistent, and scalable</b>.</div></div><div><div><h3 class="jobSectionHeader"><b>
Key Responsibilities</b></h3><ul><ul><li>
Design, develop, and maintain data ingestion, transformation, and modeling pipelines.</li><li>
Build and optimize data models to support analytics, dashboards, and KPIs.</li><li>
Deliver data models for use by ML Engineers, Data Analysts, and Data Scientists.</li><li>
Ensure data quality, reliability, and governance across ingestion and transformation workflows.</li><li>
Collaborate cross-functionally on initiatives requiring clean, well-structured data.</li><li>
Continuously improve performance, scalability, and maintainability of data workflows.</li></ul></ul></div></div><div><div><h3 class="jobSectionHeader"><b>
Core Technologies</b></h3><ul><ul><li><b>
Fivetran</b> &ndash; for automated, scalable data ingestion.</li><li><b>
Snowflake</b> &ndash; as our centralized, cloud-native data warehouse.</li><li><b>
GraphQL</b> &ndash; for flexible, application-agnostic data consumption.</li></ul></ul></div></div><div><div><h3 class="jobSectionHeader"><b>
Required Qualifications</b></h3><ul><ul><li>
4+ years of experience in data engineering, with strong pipeline and modeling expertise.</li><li>
Deep knowledge of <b>data warehousing</b> and <b>data modeling</b> in cloud platforms (e.g., Snowflake).</li><li>
Hands-on experience with <b>Fivetran</b> and <b>GraphQL</b>.</li><li>
Strong skills in <b>SQL</b> and <b>Python</b> for data manipulation and pipeline development.</li><li>
Familiarity with <b>AWS</b> and <b>Google Cloud</b> environments.</li><li>
Understanding of <b>data governance, schema evolution, and CI/CD practices</b>.</li></ul></ul></div></div><div><div><h3 class="jobSectionHeader"><b>
Preferred Qualifications</b></h3><ul><ul><li>
Experience with <b>Snowpark AI / Cortex</b> or similar AI-enabled data platforms.</li><li>
Exposure to <b>Connector SDK</b> for building custom connectors.</li><li>
Knowledge of <b>data security, replication, and failover strategies</b>.</li><li>
Experience working with <b>educational data platforms or LMS systems</b>.</li></ul></ul></div></div><div><div>
At PeopleGrove, we don&rsquo;t just accept difference &mdash; we celebrate it, we support it, and we thrive on it for the benefit of our employees, our products, and our community. PeopleGrove is proud to be an equal opportunity workplace.</div><div></div><div><br>
If you need assistance or an accommodation due to a disability, you may contact us at careers@peoplegrove.com</div></div></div></div><p></p>

Ashra Technologies

<p>Greetings from Ashra Technologies</p><p>We are hiring...</p><p>Job Role: Azure Data Engineer</p><p>Experience:8+years</p><p>Locations: Pune,Mumbai,Chennai,Bangalore</p><p>Job Description:</p><p>Experience in credit rating (Structured Finance Domain) is a must.</p><p>Min 8 years of relevant exp is required.</p><p>We are seeking a highly skilled <b>Senior Data Engineer</b> with deep expertise in <b>Databricks</b>, <b>PySpark</b>, and <b>data architecture</b> to join our data engineering team. The ideal candidate will have hands-on experience implementing <b>medallion architecture</b>, building scalable pipelines, and integrating data across diverse enterprise systems.</p><p><b>Key Responsibilities</b></p><ul><li>Design and develop scalable data pipelines using <b>Databricks</b>, <b>PySpark</b>, and <b>SQL</b></li><li>Implement and optimize <b>medallion architecture</b> (bronze, silver, gold layers) for structured and semi-structured data</li><li>Utilize <b>Lakehouse connectors</b>, <b>Delta Live Tables (DLT)</b>, and <b>Delta Sharing</b> for real-time and batch data processing</li><li>Extract data from various enterprise systems including <b>Salesforce (SFDC)</b>, <b>SAP</b>, and other <b>cloud applications</b></li><li>Integrate curated datasets from Databricks into <b>downstream systems</b> such as data warehouses, reporting tools, and APIs</li><li>Apply <b>SCD Type 2</b> logic for slowly changing dimensions using Databricks best practices</li><li>Ensure data quality, lineage, and governance across the pipeline lifecycle</li><li>Collaborate with cross-functional teams in Agile environments to deliver high-impact data solutions</li></ul><p><b>Required Skills:</b></p><ul><li>Proven expertise in Databricks, PySpark</li><li>Working knowledge of SQL with ability to support and troubleshoot existing queries.</li><li>Strong analytical thinking and problem-solving skills</li><li>Excellent communication and stakeholder engagement abilities</li></ul><p>If interested can contact 8688322631/or share your CV to: chandrika@ashratech.com</p><p>Job Type: Full-time</p><p>Pay: &#8377;470,047.17 - &#8377;3,200,000.00 per year</p><p>Experience:</p><ul><li>Azure: 8 years (Required)</li><li>Azure Databricks: 7 years (Required)</li><li>Python: 2 years (Required)</li><li>Pyspark: 2 years (Required)</li></ul><p>Work Location: In person</p>

Azure Data Engineer

Ecolab

<div><p>Lead Databricks Data Engineer</p><p>
Ecolab is looking for a Data Engineer to be part of a dynamic team that's at the forefront of technological innovation. We're leveraging cutting-edge AI to create novel solutions that optimize operations for our clients, particularly within the restaurant industry. Our work is transforming how restaurants operate, making them more efficient and sustainable.</p><p>
 As a key player in our new division, you'll have the unique opportunity to help shape its culture and direction. Your contributions will directly impact the success of our innovative projects and help define the future of our product offerings. Additionally, you will experience the best of both worlds with this team at Ecolab: the agility and creativity of a startup paired with the stability and resources of a global leader. Our collaborative environment fosters innovation while providing the support and security you need to thrive.</p><p><b>
Responsibilities</b></p><ul><li>
Design, develop, and maintain scalable and robust data pipelines on Databricks (Spark SQL, PySpark, Delta Lake).</li><li>
Collaborate with data scientists and analysts to understand data requirements and deliver solutions.</li><li>
Optimize and troubleshoot existing data pipelines for performance and reliability.</li><li>
Ensure data quality and integrity across various data sources.</li><li>
Implement data security and compliance best practices.</li><li>
Monitor data pipeline performance, implement data quality checks, and conduct necessary maintenance and updates.</li><li>
Document data pipeline processes and technical specifications.</li></ul><ul><li>
Implement robust pipeline orchestration using tools like Databricks Workflows, dbt, or similar.</li><li>
Generate and maintain data quality reports and dashboards.</li><li>
Implement Infrastructure as Code (IaC) principles for managing Databricks infrastructure.</li></ul><p><b>
Minimum Qualifications</b></p><ul><li>
Bachelor&rsquo;s degree and 8 years work experience; or no degree and 12 years combined education and equivalent work experience.</li><li>
3 years of experience (work or educational) with a data engineering focus.</li><li>
Proven experience in Databricks (Delta Lake, Workflows, Asset Bundles).</li><li>
Proven experience in distributed data processing technologies (Spark SQL, PySpark).</li><li>
Strong knowledge in designing and developing ETL pipelines.</li><li>
Experience with data quality monitoring and reporting.</li><li>
Experience working in a collaborative environment with data scientists and software engineers.</li></ul><p><b>
Preferred Qualifications</b></p><ul><li>
Master&rsquo;s degree (MS) in Computer Science or related engineering field.</li><li>
Proficiency in Databricks (Delta Lake, Workflows, Asset Bundles).</li><li>
Proficiency in distributed data processing technologies (Spark SQL, PySpark).</li><li>
Experience with pipeline orchestration tools (Databricks Workflows, dbt, etc.).</li><li>
Experience with data visualization tools (e.g., Tableau, Power BI).</li><li>
Working experience with machine learning platforms and tools.</li><li>
Experience with real-time data streaming technologies (e.g., Kafka, Kinesis).</li></ul><p><b><br>
Our Commitment to a Culture of Inclusion &amp; Belonging</b><br>
Ecolab is committed to fair and equal treatment of associates and applicants and furthering the principles of Equal Opportunity to Employment. We will recruit, hire, promote, transfer and provide opportunities for advancement based on individual qualifications and job performance in all matters affecting employment, compensation, benefits, working conditions, and opportunities for advancement. Ecolab will not discriminate against any associate or applicant for employment because of race, religion, color, creed, national origin,citizenship status, sex, sexual orientation, gender identity and expressions, genetic information, marital status, age, or disability.</p></div>

Lead AI Platform Engineer

Arting Digital Private Limited

<div><div>Position-Data Engineer (Snowflake+DBT+Airflow)<br>
</div><div>
Location- Pune,Ahmedabad<br>
</div><div>
Experience-5yr<br>
</div><div>
working Mode- Hybrid<br>
</div><div>
Skills-Snowflake, Apache Airflow,Terraform<div> ,</div> DBT,Git, SQL,<div> </div>Spark<div> </div>and<div> </div>Python , <div>Data Warehousing, CIi/CD Pipelines</div></div><div></div><div><div><div><b><br>
Key Responsibilities:</b><br>
</div></div></div><div><div><ul><li>Design, implement, and optimize data pipelines and workflows using Apache Airflow</li></ul></div></div><div><div><ul><li>Develop incremental and full-load strategies with monitoring, retries, and logging</li></ul></div></div><div><div><ul><li>Build scalable data models and transformations in dbt, ensuring modularity, documentation,</li></ul></div><div><div>
and test coverage<br>
</div></div></div><div><div><ul><li>Develop and maintain data warehouses in Snowflake</li></ul></div></div><div><div><ul><li>Ensure data quality, integrity, and reliability through validation frameworks and automated</li></ul></div><div><div>
testing<br>
</div></div></div><div><div><ul><li>Tune performance through clustering keys, warehouse scaling, materialized views, and query</li></ul></div><div><div>
optimization.<br>
</div></div></div><div><div><ul><li>Monitor job performance and resolve data pipeline issues proactively</li></ul></div></div><div><div><ul><li>Build and maintain data quality frameworks (null checks, type checks, threshold alerts).</li></ul></div></div><div><div><ul><li>Partner with data analysts, scientists, and business stakeholders to translate reporting and</li></ul></div><div><div>
analytics requirements into technical specifications.<br>
</div></div></div><div><div><div><b>
Qualifications:</b><br>
<div></div>
</div></div></div><div><div><ul><li>Snowflake</li></ul><div> </div>(data<div> </div>modeling,<div> </div>performance<div> </div>tuning,<div> </div>access<div> </div>control,<div> </div>external<div> </div>tables,<div> </div>streams<div> </div>&amp;<br>
<div></div>
</div><div><div>
tasks)<br>
</div></div></div><div><div><ul><li>Apache</li></ul><div> </div>Airflow<div> </div>(DAG<div> </div>design,<div> </div>task<div> </div>dependencies,<div> </div>dynamic<div> </div>tasks,<div> </div>error<div> </div>handling)<br>
</div><div><div>
dbt<div> </div>(Data<div> </div>Build<div> </div>Tool)<div> </div>(modular<div> </div>SQL<div> </div>development,<div> </div>jinja<div> </div>templating,<div> </div>testing,<div> </div>documentation)<br>
</div></div></div><div><div><ul><li>Proficiency</li></ul><div> </div>in<div> </div>SQL,<div> </div>Spark<div> </div>and<div> </div>Python<br>
</div></div><div><div><ul><li>Experience</li></ul><div> </div>building<div> </div>data<div> </div>pipelines<div> </div>on<div> </div>cloud<div> </div>platforms<div> </div>like<div> </div>AWS,<div> </div>GCP,<div> </div>or<div> </div>Azure<br>
</div></div><div><div><ul><li>Strong</li></ul><div> </div>knowledge<div> </div>of<div> </div>data<div> </div>warehousing<div> </div>concepts<div> </div>and<div> </div>ELT<div> </div>best<div> </div>practices<br>
</div></div><div><div><ul><li>Familiarity</li></ul><div> </div>with<div> </div>version<div> </div>control<div> </div>systems<div> </div>(e.g.,<div> </div>Git)<div> </div>and<div> </div>CI/CD<div> </div>practices<br>
</div></div><div><div><ul><li></li></ul></div>
&lt;/</div></div>

Data Engineer (Snowflake+DBT+Airflow)

Search 10000+ Data pipeline engineer jobs near you this September. New roles added regularly across leading industries. Apply today.

10000 data pipeline engineer jobs NEAR_ME

Senior Data Pipeline Engineer

Data Engineer

Data Engineer

Data Engineer

Azure Data Engineer

Lead AI Platform Engineer

Data Engineer (Snowflake+DBT+Airflow)