cloud data engineer

West Shore Home

Position: Cloud Data Engineer
 Location: Mechanicsburg, PA (ONSITE)
 Schedule: Monday-Friday, 8:00AM-5:00PM (Full-Time)
 
Who We Are: 
West Shore Home is a technology-driven and industry-leading home improvement company specializing in high-quality and convenient remodels of Bathrooms, Flooring, Windows, and Doors. West Shore Home operates in over 40+ locations nationwide and is home to over 3,000 employees!
 
Purpose of Position: 
As a Data Engineer at West Shore Home, you will design, develop, test, deploy, and monitor data pipelines using Azure Data Factory, Databricks, and Synapse Analytics required for ELT/ETL from a wide variety of data sources, systems, and platforms that will create solutions and support key stakeholders in informed decision-making across the enterprise.
 
Key Role Accountabilities: 
<ul>
<li>Design, develop, test, deploy, and monitor scalable code with Python and SQL and data pipelines using Azure Data Factory, Databricks, dbt, and Synapse Analytics required for ELT/ETL from a wide variety of data sources.</li>
<li>Create and design solutions from clean, protected, and effective data management practices that directly support informed decision making and innovation.</li>
<li>Build data quality dashboards and/or monitoring tools to utilize the data pipeline, providing active monitoring and actionable insights into overall data quality and data governance.</li>
<li>Integrate source systems with information management solutions and target systems for automated migration processes, e.g., source-of-record systems with data warehouses or other systems using common web API frameworks and web services.</li>
</ul>
Minimum Requirements: 
<ul>
<li>Bachelor’s degree required, with a degree in a related field preferred.</li>
<li>Minimum of 3+ years of experience with enterprise data management, integration, and transformation tools including Azure Data Factory, Databricks, dbt, Azure Storage, Azure SQL DB, Alteryx, Retool, and Power BI.</li>
<li>Solid understanding of Git-based version control and experience with GitHub, Azure DevOps, or similar.</li>
<li>Proven subject matter expert for how systems handle data and develop ELT/ETL solutions based on best practices, their experience, and knowledge of the Company’s goals.</li>
</ul>
Benefits: 
<ul>
<li>Comprehensive Health Insurance options (Medical, Dental, Vision, Accident, Life, Critical Illness, Short and Long-Term Disability)</li>
<li>401(k) Retirement Plan with company match</li>
<li>HSA plan with company match</li>
<li>Paid holidays and paid time off (PTO)</li>
<li>Employee Referral Program</li>
<li>Employee Discount Program</li>
<li>Paid training and unlimited professional growth potential</li>
</ul>
Please note: Applicants must be authorized to work in the United States at the time of their application on a full-time basis. The Company will not sponsor applicants for work visas.
 
Culture and Community: 
We believe that when employees feel valued and supported, they perform at their best. Our dedication to fostering a strong, value-driven culture has consistently earned us the Top Workplaces USA award as one of the nation’s top employers, including recognition in Leadership, Purpose & Values, and Compensation & Benefits.
 West Shore Home strives to Bring Happiness to Every Home® and that goes beyond our customers and employees. We support positive change in our communities by volunteering, giving back, and supporting nonprofits that make a difference. Learn more here: https://westshorehome.com/community/
 #LI-RM1
 
It is the policy of West Shore Home to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. All employees are subject to a pre-employment screening process including a background check and drug screen. In addition, we will provide reasonable accommodations for qualified individuals with disabilities. If you require reasonable accommodation in completing the application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to your recruiter.

Cloud Data Engineer

Redlinux

Freelancing OpportunityJob Title: Senior GCP Data EngineerExperience: 7+ YearsJob SummaryWe are seeking a highly experienced GCP Data Engineer with strong expertise in BigQuery, Cloud SQL, Apache Airflow, and Apache NiFi. The ideal candidate will design, build, and maintain scalable data pipelines and cloud-based data platforms, ensuring high performance, reliability, and data quality.Key Responsibilities<ul><li>Design, develop, and optimize data pipelines on Google Cloud Platform (GCP).</li><li>Build and manage large-scale data solutions using BigQuery and Cloud SQL.</li><li>Orchestrate workflows and data pipelines using Apache Airflow.</li><li>Develop, manage, and optimize data ingestion and flow using Apache NiFi.</li><li>Ensure data accuracy, consistency, and performance across pipelines.</li><li>Implement monitoring, logging, and troubleshooting for data workflows.</li><li>Collaborate with data analysts, data scientists, and application teams.</li><li>Apply best practices for security, cost optimization, and scalability on GCP.</li><li>Support production issues and perform root cause analysis.</li></ul>Required Skills &amp; Qualifications<ul><li>7+ years of experience in data engineering or cloud data platforms.</li><li>Strong hands-on experience with GCP services, especially BigQuery and Cloud SQL.</li><li>Extensive experience with Apache Airflow for workflow orchestration.</li><li>Strong experience with Apache NiFi for data ingestion and integration.</li><li>Proficiency in SQL and Python.</li><li>Experience with ETL/ELT design, data modeling, and performance tuning.</li><li>Familiarity with CI/CD pipelines and version control (Git).</li><li>Strong problem-solving and communication skills.</li></ul>Job Types: Part-time, Freelance Contract length: 12 monthsPay: ₹30,000.00 - ₹40,000.00 per monthBenefits:<ul><li>Work from home</li></ul>Experience:<ul><li>total work: 7 years (Required)</li></ul>Shift availability:<ul><li>Night Shift (Required)</li><li>Overnight Shift (Required)</li></ul>Work Location: Remote

GCP Data Engineer

Taraki

<div>
 
 About The Job
 
 
 
 <ul>
 <li>
 Build and maintain data pipelines using Python and Apache Spark.
 </li>
 <li>
 Orchestrate workflows using Airflow and Google Cloud Workflows (CloudFlow).
 </li>
 <li>
 Develop, deploy, and manage containerized data services using Docker and Cloud Run.
 </li>
 <li>
 Design, optimize, and monitor datasets and queries in BigQuery.
 </li>
 <li>
 Ingest, transform, and integrate external data through REST APIs.
 </li>
 <li>
 Manage data lifecycle and storage using Google Cloud Storage (GCS).
 </li>
 <li>
 Implement data quality, monitoring, and observability best practices.
 </li>
 <li>
 Collaborate with cross-functional engineering, product, and data science teams.
 
 
 
 </li>
 </ul>
 
 Requirements
 
 
 
 <ul>
 <li>
 2&ndash;4+ years of experience as a Data Engineer or similar role.
 </li>
 <li>
 Strong proficiency in Python, SQL, and Spark/PySpark.
 </li>
 <li>
 Hands-on experience with Airflow and cloud-native orchestration (e.g., Cloud Workflows).
 </li>
 <li>
 Experience with Docker, containers, and deploying services in Cloud Run.
 </li>
 <li>
 Skilled with BigQuery, GCS, and general GCP data tooling.
 </li>
 <li>
 Experience working with REST APIs and building ingestion integrations.
 </li>
 <li>
 Solid understanding of data modeling, ETL/ELT pipelines, and distributed systems.
 
 
 
 </li>
 </ul>
 
 Bonus:
 
 Experience with healthcare data standards (FHIR, HL7) or regulated environments.
 
 
 
 Benefits
 
 
 
 <ul>
 <li>
 Competitive salary and performance-based incentives
 </li>
 <li>
 Flexible work arrangements
 </li>
 <li>
 Paid time off and public holidays
 </li>
 <li>
 Professional development opportunities (training, workshops, certifications)
 </li>
 <li>
 Supportive, collaborative, and mission-driven work culture
 
 </li>
 </ul>
</div>

Data Engineer - Marham

<div></div><div><div><div><div><ul><div>15 - 25 Years</div>
<div></div><div>1 Opening</div>
 <div>Trivandrum</div></ul></div><div> 
<div><div>
</div></div></div></div><div></div><div><h3 class="jobSectionHeader">Role description</h3>
<div><div><div><div>Job Title: Senior Data Engineer &amp; AI Engineer / Architect
<h3 class="jobSectionHeader">Hiring Location</h3>
<ul>
<li>Bangalore, Hyderabad, Chennai, Trivandrum, Kochi, Pune, Noida, Gurgaon
</li>
</ul><h3 class="jobSectionHeader">Experience Range</h3>
<ul>
<li>8&ndash;14 years of experience in Data Engineering, Analytics, and AI/ML roles
</li>
</ul>Key Responsibilities
<ul>
<li>Architect, design, and maintain scalable and resilient data pipelines and enterprise data models supporting analytics, AI, and business intelligence use cases.
</li>
<li>Design, build, and optimize ETL/ELT frameworks using Azure Data Factory (ADF) and cloud-native integration patterns.
</li>
<li>Develop and manage cloud data platforms using Snowflake for high-performance and cost-efficient analytics.
</li>
<li>Design and implement advanced AI/ML solutions, including deep learning, NLP, large language models (LLMs), and generative AI.
</li>
<li>Lead AI research, experimentation, and prototyping to solve complex business problems and drive automation.
</li>
<li>Build and operationalize end-to-end ML pipelines, covering data preparation, feature engineering, model deployment, and monitoring.
</li>
<li>Develop executive dashboards and analytical applications delivering actionable business insights.
</li>
<li>Implement CI/CD pipelines to automate data and AI workflows for reliability and faster releases.
</li>
<li>Collaborate with engineering, analytics, product, and business teams to ensure system integration and alignment with business goals.
</li>
<li>Define and enforce best practices for data engineering, AI, governance, quality, security, and observability.
</li>
<li>Stay current with emerging data, AI, and LLM technologies to drive innovation.
</li>
</ul>Must-Have Skills
<ul>
<li>Strong proficiency in Python for data engineering, analytics, and machine learning.
</li>
<li>Hands-on experience with Snowflake for cloud data warehousing and analytics.
</li>
<li>Experience designing and building data pipelines using Azure Data Factory (ADF) or equivalent ETL/ELT tools.
</li>
<li>Solid experience with AI/ML techniques, including deep learning, NLP, and LLMs / Generative AI.
</li>
<li>Proven experience delivering AI-driven and analytical solutions for real-world business problems.
</li>
<li>Strong understanding of enterprise data modeling, data quality, and scalable pipeline design.
</li>
<li>Experience implementing CI/CD pipelines for data and ML workflows using modern DevOps practices.
</li>
<li>Experience building dashboards using Tableau or Power BI.
</li>
<li>Experience working on cloud platforms (Azure preferred; AWS/GCP acceptable).
</li>
<li>Strong communication skills with the ability to translate technical concepts into business insights.
</li>
</ul>Good-to-Have Skills
<ul>
<li>Experience with MLOps practices, including model deployment, monitoring, and observability.
</li>
<li>Experience working with telecom network data (5G, LTE, VoLTE, SMS, data usage, roaming).
</li>
<li>Familiarity with vector databases, embeddings, and RAG (Retrieval-Augmented Generation) patterns.
</li>
<li>Experience integrating LLMs with enterprise data and applications.
</li>
<li>Experience working in Agile environments and large-scale enterprise systems.
</li>
</ul>If you want, I can also:
<ul>
<li>Shorten this to a 1-page JD
</li>
<li>Create a client-facing or campus-hiring version
</li>
<li>Align it to Data Architect / AI Architect / Staff Engineer titles</li></ul></div></div> 
<div> 
 
</div></div></div><div></div><h3 class="jobSectionHeader">Skills</h3>
<div>data engineering,data science,cloud data engineering,etl,data pipelines,</div></div></div></div>
 <div><h3 class="jobSectionHeader">About UST</h3>
<div>UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world&rsquo;s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients&rsquo; organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact&mdash;touching billions of lives in the process.</div></div>

Data Architect I - Data Engineer

Infosys

<div><h2 class="jobSectionHeader">Job Description:</h2> 
<ul>
<li>We are seeking an experienced Data Engineer with strong expertise in Azure Data Services Big Data technologies and ETL ELT processes</li>
<li>The ideal candidate will have domain knowledge in CPG and Manufacturing sectors along with hands on experience in data governance data modeling and cloud based data engineering</li>
<li>This role involves building scalable data pipelines integrating industrial data platforms and enabling advanced analytics for smarter decision making</li></ul> 
<h2 class="jobSectionHeader">
Key Responsibilities:</h2> 
<ul>
<li>Design and develop data pipelines using Azure Data Factory Azure Databricks and Azure Data Lake Gen2</li>
<li>Implement ETL ELT processes data integration techniques and data governance standards</li>
<li>Work with Big Data technologies such as Apache Spark and PySpark for large scale data processing</li>
<li>Gather engineer and prepare data for analytics and business insights</li>
<li>Integrate systems and data across diverse environments ensuring seamless connectivity</li>
<li>Build solutions to extract and consolidate data from multiple sources sales inventory product customer databases</li>
<li>Collaborate with ML Engineers Data Scientists and business stakeholders to enable automation and advanced analytics</li>
<li>Contribute to coding standards and best practices for data engineering workloads</li>
<li>Support modernization initiatives aligned with Industry 4</li>
<li>0 and ISA 95 standards</li></ul> 
<h2 class="jobSectionHeader">
Technical Requirements:</h2> 
<ul>
<li>5 7 years of experience in data engineering and data governance within industrial domains CPG Manufacturing</li>
<li>Strong knowledge of Azure Data Services Azure Data Factory Azure Databricks Azure Data Lake Gen2</li>
<li>Expertise in ETL processes data integration tools and pipeline development</li>
<li>Proficiency in Python SQL and Apache Spark</li>
<li>Understanding of Industry 4</li>
<li>0 ISA 95 standards and maintenance strategies</li>
<li>Familiarity with AI ML concepts and ability to work with advanced analytics teams</li>
<li>Experience with DevOps CI CD for data pipeline automation</li></ul> 
<h2 class="jobSectionHeader">
Additional Responsibilities:</h2> 
<ul>
<li>Good to have</li>
<li>Exposure to data modeling data warehousing and cloud architecture</li>
<li>Knowledge of business intelligence tools and statistical programming</li>
<li>Ability to research and implement new tools for automation and optimization</li></ul> 
<h2 class="jobSectionHeader">
Preferred Skills:</h2>
Technology-&gt;Data Engineering-&gt;Databricks,Technology-&gt;Cloud Integration-&gt;Azure Data Factory (ADF),Technology-&gt;Cloud Platform-&gt;Azure Analytics Services-&gt;Azure Data Lake,Technology-&gt;Consulting - Data Governance-&gt;Data Governance,Technology-&gt;Database-&gt;Data Modeling,Technology-&gt;OpenSystem-&gt;Python - OpenSystem</div>

Data Engineer

Yugn

About the role:We are seeking a talented Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Google Cloud Platform (GCP), BigQuery, Python, and SQL, and will be responsible for designing and maintaining scalable data solutions that power business insights.Responsibility:Design, develop, and maintain robust data pipelines and ETL workflows.Manage large-scale datasets using GCP and BigQuery for optimal performance.Write clean, efficient Python and SQL code for data processing and transformation.Collaborate with data analysts, scientists, and business teams to ensure data quality and availability.Optimize workflows for scalability, cost-efficiency, and performance.Skills/Qualifications:3&ndash;4 years of professional experience as a Data Engineer.Hands-on expertise in GCP, BigQuery, Python, and SQL.Strong understanding of data warehousing concepts, ETL processes, and cloud architecture.Proficiency in data modeling, performance tuning, and query optimization.Familiarity with CI/CD pipelines, version control (Git), and workflow orchestration tools (e.g., Airflow).Excellent problem-solving skills, attention to detail, and ability to work in cross-functional teams.Strong communication and collaboration skills.Nice-to-Have:Experience with Apache Spark for distributed data processing.Knowledge of Kubernetes for container orchestration and deployment.Exposure to Machine Learning pipelines and integration with data workfloJob Types: Full-time, PermanentPay: ₹1,200,000.00 - ₹2,500,000.00 per yearBenefits:<ul><li>Health insurance</li><li>Provident Fund</li></ul>Work Location: In person

TechBiz Global GmbH

<div>At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking an Data Engineer to join one of our clients' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you. 
Key Responsibilities:<ul><li>Design, develop, and maintain data ingestion pipelines using Kafka Connect and</li></ul>
Debezium for real-time and batch data integration.<ul><li>Ingest data from MySQL and PostgreSQL databases into AWS S3, Google Cloud</li></ul>
Storage (GCS), and BigQuery.<ul><li>Implement best practices for data modeling, schema evolution, and efficient partitioning</li></ul>
in the Bronze Layer.<ul><li>Ensure reliability, scalability, and monitoring of Kafka Connect clusters and connectors.</li><li>Collaborate with cross-functional teams to understand source systems and downstream</li></ul>
data requirements.<ul><li>Optimize data ingestion processes for performance and cost efficiency.</li><li>Contribute to automation and deployment scripts using Python and cloud-native tools.</li><li>Stay updated with emerging data lake technologies such as Apache Hudi or Apache</li></ul>
Iceberg.
Required Skills and Qualifications:<ul><li>5+ years of hands-on experience as a Data Engineer or similar role.</li><li>Strong experience with Apache Kafka and Kafka Connect (sink and source</li></ul>
connectors).<ul><li>Experience with Debezium for change data capture (CDC) from RDBMS.</li><li>Proficiency in working with MySQL and PostgreSQL.</li><li>Hands-on experience with AWS S3, GCP BigQuery, and GCS.</li><li>Proficiency in Python for automation, data handling, and scripting.</li><li>Understanding of data lake architectures and ingestion patterns.</li><li>Solid understanding of ETL/ELT pipelines, data quality, and observability practices.</li></ul>
Good to Have:<ul><li>Experience with containerization (Docker, Kubernetes).</li><li>Familiarity with workflow orchestration tools (Airflow, Dagster, etc.).</li><li>Exposure to infrastructure-as-code tools (Terraform, CloudFormation).</li><li>Familiarity with data versioning and table</li></ul></div>

Search 10000+ Cloud data engineer jobs near you this January. New roles added regularly across leading industries. Apply today.

10000 cloud data engineer jobs NEAR_ME

Cloud Data Engineer

GCP Data Engineer

Data Engineer - Marham

Data Architect I - Data Engineer

Data Engineer

Data Engineer

Data Engineer