data pipeline engineer

Pyx Health

<div><div>Pyx Health is looking for a motivated and technically solid Healthcare Data Engineer to join our growing Data &amp; Analytics team. In this role, you will contribute to building and maintaining our data infrastructure on Azure, work alongside senior engineers to develop reliable data pipelines, and collaborate with analytics teams to engineer data foundations that support our healthcare solutions. You will work with Databricks, Airflow, Python, and SQL to implement and improve data workflows in a collaborative, high-growth environment. Only candidates residing in the USA may apply.

KEY RESPONSIBILITIES
</div>
Pipeline Development &amp; Maintenance
<ul><li> Build and maintain data pipelines for ingesting, transforming, and cleaning healthcare data in the Azure cloud using Databricks, PySpark, and Delta Lake</li></ul>
<ul><li> Implement pipeline logic from defined specifications, with guidance from senior engineers on architectural decisions</li></ul>
<ul><li> Build reusable testing frameworks to ensure pipeline reliability</li></ul>
<ul><li> Monitor pipelines for failures and performance issues, escalating complex problems appropriately</li></ul>

Orchestration &amp; Automation
<ul><li> Develop and maintain Airflow DAGs with appropriate error handling and retry logic</li></ul>
<ul><li> Support deployment and configuration of pipelines via Astronomer on Azure using the Astro CLI</li></ul>
<ul><li> Contribute to improving pipeline reliability and reducing manual intervention</li></ul>

Data Modeling &amp; Storage
<ul><li> Implement data models for efficient storage and retrieval using Delta Lake, including merge/upsert patterns</li></ul>
<ul><li> Design and optimize Delta Lake tables for analytic workloads</li></ul>
<ul><li> Leverage Unity Catalog for data governance, organization, and security</li></ul>
<ul><li> Apply Change Data Capture (CDC) patterns under the direction of senior team members</li></ul>
<ul><li> Write and optimize T-SQL and Databricks SQL scripts, stored procedures, and ETL support</li></ul>

Azure Infrastructure
<ul><li> Work within the Azure ecosystem including ADLS Gen2, Key Vaults, Logic Apps, and Azure DevOps</li></ul>
<ul><li> Follow established security and scalability standards when building data infrastructure</li></ul>
<ul><li> Support infrastructure tasks with guidance from senior engineers on architecture</li></ul>

Data Quality &amp; Monitoring
<ul><li> Ensure scripts and datasets are well-documented to support enterprise data governance</li></ul>
<ul><li> Design, implement and continuously improve automated data quality monitoring, reconciliation, and alerting to ensure reliable downstream reporting</li></ul>
<ul><li> Troubleshoot and resolve pipeline failures, documenting root causes and resolutions</li></ul>

Collaboration &amp; Documentation
<ul><li> Work closely with data scientists, analysts, and business stakeholders to understand reporting requirements, troubleshoot issues, and improve data assets</li></ul>
<ul><li> Participate in code reviews, incorporating feedback to improve code quality</li></ul>
<ul><li> Document pipelines, processes, and implementation decisions clearly and consistently</li></ul>
<ul><li> Stay current with data engineering technologies, particularly in the healthcare space</li></ul><div>

QUALIFICATIONS
</div>
<ul><li> 2&ndash;4 years of experience as a Data Engineer or in a closely related data role</li></ul>
<ul><li> Hands-on experience with Azure cloud services (ADLS, Databricks, or similar)</li></ul>
<ul><li> Working knowledge of SQL for scripting and data modeling including T-SQL, Spark, and Databricks SQL</li></ul>
<ul><li> Ability to contribute to technical projects with moderate oversight</li></ul>
<ul><li> Strong communication skills &mdash; comfortable asking questions and providing updates to cross-functional partners</li></ul>
<ul><li> Familiarity with CI/CD concepts, Git, and version control workflows</li></ul>
<ul><li> Solid problem-solving skills with a systematic approach to debugging</li></ul>
<ul><li> Familiarity with healthcare data standards and regulations (HIPAA, HL7, etc.) is a plus</li></ul>
<ul><li> Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent work experience)</li></ul>
<div>
MUST HAVES
</div>
<ul><li> Databricks SQL (Mid): Delta Lake fundamentals, basic merge/upsert patterns, familiarity with CDC concepts.</li></ul>
<ul><li> Python (Mid): Pipeline logic, data transformation, SQL scripting; some PySpark/Spark DataFrame experience.</li></ul>
<ul><li> Databricks Spark Notebooks (Mid): Notebook-based development, basic cluster usage, Delta table operations.</li></ul>
<ul><li> Airflow Python Development (Mid): Ability to write and maintain DAGs; understanding of error handling and retry patterns.</li></ul>
<ul><li> Airflow Astro Configuration (Foundational): Familiarity with Astronomer or willingness to learn; basic Astro CLI usage.</li></ul>
<ul><li> Azure Ecosystem (Foundational): Working knowledge of ADLS Gen2, Key Vaults, and Azure DevOps.</li></ul>
<ul><li> T-SQL (Foundational&ndash;Mid): Basic stored procedures, SQL Server querying, and data manipulation.</li></ul> 


 NICE TO HAVES
<ul><li> Azure Data Factory (Foundational): Basic familiarity with pipeline authoring and triggers.</li></ul>
<ul><li> Git + Azure DevOps CI/CD (Foundational): Experience with branching, pull requests, peer review processes, and version control best practices as well as deploying production data pipelines using CI/CD workflows.</li></ul></div>

Data Engineer

Swan Global WLL

Data Engineer (AMI)JOB PURPOSEThe role holder is responsible for designing, building, and maintaining the data infrastructure required to support AMI data collection, processing, storage, and analytics. The role ensures data availability, performance, scalability, and reliability for operational and analytical users.CORE RESPONSIBILITIES<ul><li>Designs, builds, and maintains scalable data infrastructure supporting AMI systems.</li><li>Develops and manages data pipelines integrating multiple data sources into AMI platforms.</li><li>Ensures data quality, consistency, availability, and performance for AMI monitoring and analytics teams.</li><li>Designs, optimizes, and maintains databases capable of handling large-scale metering data volumes.</li><li>Supports real-time and batch data processing requirements.</li><li>Collaborates with IT, cybersecurity, and operations teams to ensure secure and reliable data flow.</li><li>Monitors system performance and resolves data pipeline issues and bottlenecks.</li><li>Documents data architecture, workflows, and operational procedures.</li><li>Ensures compliance with IT governance, information security, and ISO standards.</li><li>Supports disaster recovery and business continuity planning related to data systems.</li><li>Performs other duties assigned by management.</li></ul>EDUCATION, EXPERIENCE &amp; SKILLSQualifications / CertificationsBachelor&rsquo;s degree in Computer Science, Information Systems, or a related discipline.Cloud / Data Engineering certification (AWS, Azure, or GCP).ExperienceMinimum 9 years of relevant experience in data engineering or similar roles.Key Skills<ul><li>Expertise in data pipeline design and development.</li><li>Proficiency with databases and big data technologies (Hadoop, Spark).</li><li>Strong analytical, problem-solving, and system optimization skills..</li><li>Written and Spoken English is essential; Arabic is preferred.</li></ul>Job Type &quot;Office-based technical role with coordination across IT and operations teams.Work Location: In person

Data Engineer (AMI)

Apple

At Apple, the content that reaches hundreds of millions of people: music, films, books, podcasts, and apps, is underpinned by sophisticated data systems that run quietly and reliably at scale. The ASE Content Data Engineering team builds and maintains the reporting infrastructure, data pipelines, and data models that keep Apple's online media platform informed, compliant, and moving forward. 
 
We are looking for a Software Development Engineer - Data to join our Reporting &amp; Data Models team. In this role, you will modernize and automate legacy data pipelines, build new reporting solutions, maintain a large and complex reporting estate across Oracle and cloud-native platforms, and help deliver compliance extracts that meet real-world legal deadlines across multiple jurisdictions. If you enjoy working on systems that matter, where your engineering choices directly impact operational accuracy, regulatory compliance, and business intelligence for one of the world's largest media platforms, we would love to hear from you. 
 
Description 
 
The ASE Content Data Engineering team is responsible for the internal business intelligence infrastructure that powers Apple's online media store. The data models and reports developed by this team supply information to engineering, business operations, and external content providers regarding the status of online media, including workflow status, availability, and incoming and outgoing volume. 
 
This engineer will own and evolve a large portfolio of data pipelines and reporting systems, driving the ongoing migration from legacy infrastructure to modern pipeline orchestration and cloud-based storage, while also delivering net-new reports and data models in response to business, engineering, and regulatory needs. The role demands a blend of engineering rigor, data fluency, and a strong reliability mindset: the team's reports directly support legal and compliance obligations with hard, externally-imposed deadlines. 
 
The ideal candidate brings a bias toward automation and self-healing pipelines over manual intervention, and is comfortable managing a broad portfolio of concurrent work, balancing urgent pipeline fixes against longer-horizon migration and enhancement projects. They can independently troubleshoot and resolve ambiguous, production-impacting issues under time pressure, and communicate technical findings clearly to non-engineering stakeholders across legal, business operations, and content provider teams. Knowledge of or genuine curiosity about online media is a plus.&quot;,&quot;responsibilities&quot;:&quot;Design, build, and maintain automated data pipelines and reporting systems across a hybrid stack spanning Oracle, Spark, Hadoop, and cloud object storage 
 
Drive the migration of legacy report jobs to modern pipeline orchestration and cloud infrastructure, ensuring reliability, observability, and maintainability 
 
Investigate and resolve pipeline failures, performance bottlenecks, and data quality issues across a large, interdependent reporting estate covering all content domains 
 
Develop and maintain legal and regulatory-compliance reports where accuracy, auditability, and on-time delivery are non-negotiable 
 
Onboard and publish curated datasets from operational data stores to the Apple Data Lakehouse, ensuring proper data governance, lineage documentation, and PII tagging 
 
Extend and enhance internal content data platform models across all content domains: propagating schema changes, adding new columns and descriptors, and maintaining the accuracy of the platform's content-intelligence surface 
 
Execute controlled, legally-gated production data modifications and archival/deletion programs under change control and with required legal approval 
 
Contribute to the evolution of AI-assisted data tooling (e.g., Text-to-SQL), automating and accelerating how stakeholders access and query content data 
 
Preferred Qualifications 
 
Familiarity with Iceberg / Parquet-based table formats 
 
Proficiency in macOS and Linux server environments 
 
Experience using GenAI tools (e.g., Claude, OpenAI tools) to accelerate engineering tasks 
 
Familiarity with cloud object storage migration patterns (HDFS to S3) 
 
Experience with EKS or other cloud-based compute platforms 
 
Familiarity with Trino or other distributed SQL query engines 
 
Experience with Flink or Flink SQL for stream-based data processing 
 
Familiarity with GenAI-assisted data access patterns (e.g., MCP servers, Text-to-SQL, LLM-assisted data documentation) 
 
Familiarity with Tableau or similar data visualization and dashboarding tools 
 
Experience with shell scripting for automation and pipeline support 
 
Experience with Java development 
 
Minimum Qualifications 
 
Minimum 1 year of experience as a Software Engineer, Data Engineer, or equivalent role 
 
Strong experience with Spark and Spark SQL, including performance tuning and resource optimization 
 
Strong experience with Hadoop, HDFS, and/or S3-compatible object storage 
 
Hands-on experience with Python scripting for data processing and automation 
 
Experience writing SQL and PL/SQL on Oracle, including query optimization 
 
Experience building and maintaining automated data pipelines and job scheduling systems (e.g. Airflow) 
 
Experience with CI/CD workflows and version-controlled deployment of data pipeline code 
 
Hands-on experience with Kubernetes for container-based workload execution 
 
Bachelor's degree in Computer Science, Software Engineering, Data Science, or a related technical field OR Hands-on engineering experience and a demonstrable track record of building and maintaining production data systems are weighted equally alongside formal academic credentials. 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $225,300, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Software Development Engineer - Data

Elevate Aviation Group

<div>
 Job Type
 
 
 Full-time
 
 
 
 Description
 
 
 
 
 Job Title-
 
 Data Engineer
 
 
 
 Department-
 
 Systems &amp; Technology
 
 
 
 Reports to-
 
 VP, Software Engineering
 
 
 
 Location-
 
 Plano, TX
 
 
 
 Who We Are-
 
 
 
 Founded in 1995,
 
 Elevate Aviation Group
 
 is the parent organization uniting Elevate Jet, Private Jet Services (PJS), and Elevate MRO under one standard of aviation excellence. We operate in the space between small operators and faceless corporations &ndash; large enough to deliver global capability, yet agile enough to provide true personal service. As we enter our fourth decade, we&rsquo;re revolutionizing how we approach the market, combining decades of operational expertise with modern technology to deliver certainty, safety, and seamless experiences across every stage of private aviation &ndash; from charter to acquisition, management, and maintenance.
 
 
 
 Summary Of Position
 
 
 
 Elevate Aviation Group is seeking a Data Engineer to join our technology team in a role where you'll design and build the data infrastructure powering our aviation technology platforms. As a Data Engineer, you'll take ownership of building and maintaining the data systems that transform raw data into actionable insights. You'll develop scalable ETL/ELT pipelines, optimize database performance, architect data warehouses, and solve complex data engineering challenges that directly impact our client-facing products and analytics. This role combines hands-on development with strategic infrastructure decisions, offering the opportunity to own our data systems end-to-end while growing your technical expertise in a fast-paced environment. If you're passionate about building robust data solutions and want to make a tangible impact in aviation technology, we'd like to hear from you.
 
 
 
 Essential Duties &amp; Responsibilities
 
 
 
 <ul>
 <li>
 Design and develop scalable data pipelines and infrastructure
 </li>
 <li>
 Architect data systems that handle large volumes of structured and unstructured data
 </li>
 <li>
 Plan data storage solutions and database systems aligned with business needs
 </li>
 <li>
 Monitor and troubleshoot data pipelines to ensure reliability and performance
 </li>
 <li>
 Design and manage databases
 </li>
 <li>
 Build and maintain data warehouses, data lakes, or data mesh architectures
 </li>
 <li>
 Work with Product and Engineering to understand data requirements
 </li>
 <li>
 Provide data access and infrastructure support to end users
 </li>
 <li>
 Document systems, processes, and data lineage
 </li>
 <li>
 Implement data validation and quality checks
 </li>
 <li>
 Maintain data governance and compliance standards
 
 
 </li>
 </ul>
 
 Knowledge, Skills &amp; Abilities-
 
 
 
 <ul>
 <li>
 Strong understanding of data architecture, data pipeline design, and ETL/ELT frameworks
 </li>
 <li>
 Proficiency in SQL for complex query optimization, database design, and performance tuning
 </li>
 <li>
 Expertise in programming languages such as Python, Java, or Scala for data pipeline development
 </li>
 <li>
 Familiarity with cloud platforms AWS, Google Cloud, and/or Azure for data infrastructure and deployment
 </li>
 <li>
 Experience designing and implementing data warehouses, data lakes, or modern data stack architectures
 </li>
 <li>
 Proficiency with both relational databases (PostgreSQL, MySQL, SQL Server) and NoSQL databases (MongoDB, Cassandra)
 </li>
 <li>
 Ability to develop, test, and troubleshoot data pipelines to ensure reliability, performance, and data quality
 </li>
 <li>
 Knowledge of data modeling, schema design, and dimensional modeling best practices
 </li>
 <li>
 Understanding of data governance, data lineage, and metadata management concepts
 </li>
 <li>
 Excellent analytical and problem-solving skills to design scalable solutions and resolve complex data engineering challenges
 </li>
 <li>
 Strong communication skills to collaborate effectively with engineers, analysts, and business stakeholders
 
 
 </li>
 </ul>
 
 Education &amp; Experience-
 
 
 
 <ul>
 <li>
 A bachelor&rsquo;s degree in computer science, data analytics, software engineering, information technology, or related field
 </li>
 <li>
 At least four years of experience in master data management, data analytics, data engineering, or a related area
 
 
 </li>
 </ul>
 
 Schedule &amp; Travel-
 
 
 
 <ul>
 <li>
 Standard business hours are expected in this role.
 </li>
 <li>
 Ability to travel as required up to 10%
 
 
 </li>
 </ul>
 
 Benefits
 
 
 
 Elevate Aviation Group offers a comprehensive total rewards package that includes:
 
 
 <ul>
 <li>
 Health &amp; Welfare: Medical, dental, and vision insurance; employer-paid life and AD&amp;D insurance; employee assistance program (EAP)
 </li>
 <li>
 Retirement: 401(k) plan with employer match up to 5%
 </li>
 <li>
 Paid Time Off: Vacation, sick leave, and paid holidays
 </li>
 <li>
 Additional Compensation: Annual discretionary bonus
 </li>
 <li>
 Other Benefits: None
 
 
 </li>
 </ul>
 
 Miscellaneous-
 
 
 
 <ul>
 <li>
 FLSA Status- Exempt
 </li>
 <li>
 Lifting requirements- Up to 20 lbs
 </li>
 <li>
 U.S. work authorization is a precondition of employment. Applicants must be authorized to work for ANY employer in the U.S., both now and at all future times. We are unable to sponsor or take over sponsorship of an employment Visa at this time.
 </li>
 </ul>
</div>

The Paper Store

<div>TPS Group Holdings, a family of brands including The Paper Store, Uncharted, and Gifts &amp; More, is all about transforming daily routines into joyful escapes that inspire and surprise. Our mission is to connect with every customer through carefully chosen products, immersive shopping experiences, and service that goes the extra mile &mdash; creating a space that sparks joy with every visit.
Position Overview: We are seeking an experienced Data Engineer to own and optimize end-to-end data pipeline operations across our Snowflake data warehouse environment. This is a highly technical, hands-on role focused on building, maintaining, and scaling production-grade ETL pipelines.
Direct experience withwith SSIS, and Snowflake is required. This role is best suited for someone who has built and supported enterprise data pipelines using these platforms and is comfortable working in a production environment.
The Data Engineer will be responsible for ensuring operational visibility, data quality, and the overall reliability of our data ecosystem. This is not a general analytics or BI role; it requires strong ETL engineering expertise and the ability to support a growing, evolving data environment.
What You Will Own<ul><li>
Be a TPS Brand Ambassador by contributing to a positive culture, encouraging open communication, and maintaining confidential information as required.</li><li>
Design, develop, and maintain production-grade ETL pipelines using Matillion and SSIS.</li><li>
Build, optimize, and maintain data models within Snowflake.</li><li>
Develop and maintain data pipelines that support efficient data extraction, transformation, and loading processes.</li><li>
Integrate new data sources into enterprise data pipelines.</li><li>
Monitor data infrastructure for performance, reliability, and operational visibility.</li><li>
Ensure data quality and integrity through validation, cleansing, error handling, and data controls.</li><li>
Improve the performance, scalability, and robustness of existing data infrastructure.</li><li>
Design and optimize data storage solutions, including data warehouses and data lake environments.</li><li>
Partner with data analysts, data architects, software engineers, and business partners to understand data requirements and deliver reliable data sets.</li><li>
Support business intelligence needs by ensuring data is accurate, accessible, and structured for reporting and decision-making.</li><li>
Implement data security measures and access controls to protect sensitive information.</li><li>
Automate and improve data processes and workflows for scalability and efficiency.</li><li>
Document data pipelines, processes, standards, and best practices for knowledge sharing.</li><li>
Partner with cross-functional teams to support data governance, compliance, and data-driven decision-making.</li><li>
Stay current on industry trends and emerging technologies in data engineering.</li><li>
Provide technical guidance and support to junior team members, if applicable.</li><li>
Continuously optimize data architecture to support the company&rsquo;s evolving data needs.</li></ul>
What We Are Looking For<ul><li>
2+ years of relevant data engineering experience</li><li>
Hands-on experience with Matillion is a plus</li><li>
Hands-on experience with Snowflake is required</li><li>
Experience with SSIS or similar ETL tools is required</li><li>
Strong SQL skills, including writing queries, joins, stored procedures, and data transformations</li><li>
Experience building, maintaining, and supporting ETL pipelines in a production environment</li><li>
Proficiency in data modeling and database management</li><li>
Experience with data warehousing and cloud-based data platforms</li><li>
Strong programming skills, such as Python, Java, or SQL</li><li>
Understanding of data quality, data validation, error handling, and data governance practices</li><li>
Ability to troubleshoot pipeline failures, performance issues, and data discrepancies</li><li>
Strong documentation skills and attention to detail</li><li>
A team-player mindset, including the willingness to pivot as business needs change and assist others to meet deadlines</li><li>
Ability to work 3+ days per week at the Corporate Office in Acton, MA</li></ul>
Compensation &amp; Benefits<ul><li>
Base salary: $80,000 - $100,000, commensurate with experience</li><li>
Comprehensive benefits package including medical, dental, vision, and 401(k)</li><li>
Paid time off and company holidays</li><li>
Associate discount across TPS Group brands</li></ul>
TPS Group Holdings LLC is an equal opportunity employer. We are committed to building a diverse and inclusive team that reflects the communities we serve. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, age, veteran status, disability, or any other characteristic protected by applicable law.</div>

Karsun Solutions LLC

<div>Overview:
<div>
Summary</div><div>
The candidate must have a successful track record in handling complex data pipelines for high transaction volume application and reporting/analytics data with minimal supervision. The candidate will be expected to support a variety of structured and semi-structured data in streaming and batch frameworks for both migration from and synchronization with legacy systems. The Senior Data Engineer provides support to the Application database design to aid in eliminating data duplication and enabling selective event-based and schedule-based data transfer to endpoints within the cloud and legacy environment as required. The Senior Data Engineer drives towards programmatic pipeline generation and orchestration to enhance repeatability and rapid deployment, using Databricks, PySpark, and Airflow, out-of-the-box thinking, AWS native capabilities, and CI/CD tools while utilizing established design patterns, specifically the Medallion architecture.</div>
Responsibilities:
<div>
What You'll Be Doing:</div><ul><li>
Designs, implements, and operates data management systems using Databricks and PySpark.</li><li>
Defines and adheres to best practices for implementing the Medallion architecture diligently across all data layers.</li><li>
Orchestrates complex data pipelines and workflows using Apache Airflow.</li><li>
Works with product and application owners, data stewards, and business/data analysts to determine, create, and populate required data in an optimal, reliable, and measurable manner.</li><li>
Assists the Data Architects and technical leads in designing how data will be stored, accessed, used, integrated, and managed by different data regimes and digital systems.</li><li>
Plans, designs, and optimizes data throughput and query performance.</li><li>
Participates in the employment of backend database technologies, their configuration and utilization, and the optimization of the full data pipeline infrastructure to support the actual content, volume, ETL, and periodicity of data to match expected responsiveness.</li><li>
Utilizes identified COTS, Python, PySpark, and AWS tools and services as needed.</li><li>
Creates and executes medium to complex SQL scripts to validate and test data prior to and during the lifecycle of reports and dataset development.</li></ul> 
<div></div>
Qualifications and Education:
<div>
Required Qualifications:</div><ul><li><div>
BA or BS degree in CS, Computer Engineering, Information Technology, or a related field.</div></li><li><div>
Databricks Certified Data Engineer (Associate or Professional) or equivalent experience.</div></li><li><div>
5+ years of hands-on experience with PySpark, Python, and various Python toolkits and libraries for data processing and pipelines.</div></li><li><div>
Proven experience and deep understanding of the Medallion architecture, with the ability to define and adhere to best practices diligently.</div></li><li><div>
Hands-on experience orchestrating complex data workflows using Apache Airflow.</div></li><li><div>
5+ years of experience and ability to create complex SQL queries and functions.</div></li><li><div>
3+ years of work experience on AWS-based datasources such as RDS, Athena, Redshift.</div></li><li><div>
2+ years of hands-on experience in creating ETL and data pipeline design patterns for modular and reliable ETL with robust error management and alerting.</div></li><li><div>
1+ year of experience in Java and Linux scripting is essential.</div></li><li><div>
1+ year of experience working with CI/CD tools including Git for ETL and scripts repository.</div></li><li><div>
1+ year of experience using complex data sets and formats such as JSON, AVRO, parquet.</div></li><li><div>
1+ year of experience in data profiling and quality management.</div></li></ul>
Compensation:
<div>
The proposed salary range for this role is $****** to $******* USD. The salary range provided is a good faith estimate representative of all experience levels. Karsun considers several factors when extending an offer, including but not limited to, the role, function and associated responsibilities, a candidate&rsquo;s work experience, location, education/training, and key skills.</div></div>

Senior Data Engineer

CVS Health

<div>We&rsquo;re building a world of health around every individual &mdash; shaping a more connected, convenient and compassionate health experience. At CVS Health&reg;, you&rsquo;ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger &ndash; helping to simplify health care one person, one family and one community at a time.
Position Summary
We are hiring a fully remote Data Engineer with strong SQL and Python experience to join our Data Engineering team. You will contribute to the design, development, and maintenance of data pipelines and platform infrastructure that power a new internal self-service application. Working alongside senior engineers, you will help modernize how data is ingested, transformed, and served &mdash; enabling application teams across the company to own and manage their data with greater speed and reliability. This is an opportunity to grow your data engineering skills on a high-visibility platform initiative with direct impact on data quality and accessibility.
About this Role
This is a fully remote position open to candidates anywhere in the US. This role is well-suited for a detail-oriented engineer who takes pride in building reliable, well-tested data pipelines and is eager to deepen their expertise in modern data platforms. You will work with growing autonomy on well-defined tasks, collaborating closely with senior engineers who will provide guidance, mentorship, and code review. You are expected to ask good questions, communicate blockers promptly, and take ownership of your contributions from implementation through production monitoring. You will have access to AI development tools &mdash; including Claude, Snowflake CoCo, and Copilot &mdash; to assist across all phases of the SDLC.
You will contribute to a platform that provides:<ul><li>
Self-Service Data Ingestion &mdash; Build and maintain the pipelines that enable application teams to register Kafka topics, update schemas, and ingest data, reducing lead times from weeks to minutes.</li><li>
Automated Monitoring &amp; Incident Management &mdash; Implement standardized logging, alerting, and escalation to improve pipeline reliability and issue resolution.</li><li>
Data Preview Capabilities &mdash; Support features that allow application engineers to preview how their data will appear in the warehouse before it reaches production.</li></ul>
About the Project: The Data Self-Service Platform
The Data Self-Service Platform addresses critical challenges in our current data operations. Today, data ingestion is often manual and ticket-driven, leading to delays and limiting self-service for application teams. You will help build a platform that empowers data owners to ingest, transform, and serve their data &mdash; giving them full control and accountability for data quality. This platform will enable data producers and consumers to collaborate efficiently, address issues directly, and streamline testing changes.
Key Responsibilities<ul><li>
Build, maintain, and improve data pipelines and ETL/ELT processes using Python, contributing to reliability, scalability, and observability.</li><li>
Write and optimize SQL queries to support data ingestion, transformation, troubleshooting, and validation across the data warehouse.</li><li>
Contribute to data modeling efforts and help maintain the integrity and structure of datasets within the Snowflake data platform.</li><li>
Integrate with Kafka-driven event streams to support real-time and near-real-time data ingestion under the guidance of senior engineers.</li><li>
Write clean, well-tested code; ensure thorough unit and integration test coverage for pipeline components you build.</li><li>
Participate in code reviews, giving and receiving constructive feedback to uphold team quality standards.</li><li>
Contribute to CI/CD workflows using GitHub Actions and validate pipeline correctness post-deployment.</li><li>
Implement logging and observability instrumentation for pipelines you own, and respond to production alerts as part of team on-call rotation.</li><li>
Communicate blockers and progress clearly; escalate issues with appropriate urgency.</li><li>
Leverage AI development tools (Claude, Snowflake CoCo, Copilot) to improve development speed and code quality.</li><li>
Actively seek out mentorship and coaching from senior engineers; share learnings with teammates.</li></ul>
Required Qualifications<ul><li>
2 years of professional data engineering or software development experience.</li><li>
Strong, demonstrated proficiency in SQL &mdash; including writing, optimizing, and troubleshooting complex queries against large datasets.</li><li>
Experience working with at least one cloud data warehouse or data platform (Snowflake, BigQuery, Amazon Redshift, Azure Synapse Analytics, or Databricks).</li><li>
Proficiency with Git-based version control, including branching, pull requests, and code review workflows.</li><li>
Familiarity with CI/CD concepts and participation in automated deployment workflows (GitHub Actions).</li></ul>
Preferred Qualifications<ul><li>
Hands-on experience building and maintaining data pipelines or ETL/ELT processes using Python.</li><li>
Familiarity with Snowflake &mdash; any exposure to querying, schema concepts, or warehouse basics is a plus; it is a core platform tool for this team.</li><li>
Experience writing unit and integration tests for data pipeline components.</li><li>
Any exposure to DBT (Data Build Tool) or similar transformation frameworks; DBT is a key part of our data workflow and familiarity is a strong plus.</li><li>
Familiarity with Kafka or similar event-streaming platforms (RabbitMQ, AWS SNS/SQS).</li><li>
Familiarity with containerized development (Docker).</li><li>
Basic exposure to Terraform or infrastructure-as-code concepts.</li><li>
Awareness of structured logging, pipeline health checks, and monitoring/alerting tooling.</li><li>
Familiarity with REST API integration patterns.</li><li>
Experience with AI-enhanced development tools such as Claude, Snowflake CoCo, or Copilot.</li></ul>
Education<ul><li>
Bachelor of Science in Computer Science, Data Engineering, Information Systems, or a related field, or equivalent work experience.</li></ul>
Anticipated Weekly Hours
40
Time Type
Full time
Pay Range
The typical pay range for this role is:
$64,890.00 - $173,040.00
This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above. 
Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.
Great benefits for great people
We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families. 
This full‑time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well‑being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility. 
Additional details about available benefits are provided during the application process and on Benefits Moments. 
We anticipate the application window for this opening will close on: 07/31/2026
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.</div>

Search 6712+ Data pipeline engineer jobs near you this August. New roles added regularly across leading industries. Apply today.

6712 data pipeline engineer jobs Near Me

Data Engineer

Data Engineer (AMI)

Software Development Engineer - Data

Data Engineer

Data Engineer

Senior Data Engineer

Data Engineer