cloud data engineer

Cognizant Technology Solutions

<div>About the role:
As a GCP Data Engineer, you will make an impact by designing and implementing scalable data pipelines and orchestration workflows on Google Cloud Platform (GCP). You will be a valued member of the Data Engineering team and work collaboratively with cloud architects, DevOps engineers, and business stakeholders to deliver high-performance data solutions.
In this role, you will:<ul><li>
Build and maintain streaming and batch data pipelines using GCP services such as Dataflow, Pub/Sub, and Cloud Storage</li><li>
Develop and manage workflow orchestration using Apache Airflow and Cloud Composer</li><li>
Design and optimize relational databases, particularly Cloud SQL and PostgreSQL</li><li>
Collaborate with DevOps teams to implement CI/CD pipelines and containerized deployments using Docker and Kubernetes</li><li>
Apply data modeling best practices to support analytics and business intelligence initiatives</li></ul>
Work model:
We strive to provide flexibility wherever possible. Based on this role&rsquo;s business requirements, this is a remote position open to qualified applicants in The United States. Regardless of your working arrangement, we are here to support a healthy work-life balance through our various wellbeing programs.
The working arrangements for this role are accurate as of the date of posting. This may change based on the project you&rsquo;re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.
What you need to have to be considered:<ul><li>
Proven experience as a Data Engineer with a focus on Google Cloud Platform</li><li>
Hands-on expertise with GCP services: Dataflow, Pub/Sub, Cloud Storage, Cloud Composer</li><li>
Strong proficiency in workflow orchestration using Apache Airflow</li><li>
Experience with relational databases such as Cloud SQL or PostgreSQL</li><li>
Solid understanding of ETL processes, data modeling, and pipeline architecture</li></ul>
These will help you stand out:<ul><li>
Familiarity with DevOps practices, CI/CD pipelines, and containerization using Docker and Kubernetes</li><li>
Experience working in agile environments and cross-functional teams</li><li>
GCP certifications (e.g., Professional Data Engineer or Cloud Architect)</li><li>
Knowledge of data governance and security best practices in cloud environments</li></ul>
We're excited to meet people who share our mission and can make an impact in a variety of ways. Don't hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role.
Salary and Other Compensation:
Applications will be accepted until October 27, 2025
The annual salary for this position is between $ 100,000 - $ 117,000 depending on experience and other qualifications of the successful candidate.
This position is also eligible for Cognizant&rsquo;s discretionary annual incentive program, based on performance and subject to the terms of Cognizant&rsquo;s applicable plans.
Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:<ul><li>
Medical/Dental/Vision/Life Insurance</li><li>
Paid holidays plus Paid Time Off</li><li>
401(k) plan and contributions</li><li>
Long-term/Short-term Disability</li><li>
Paid Parental Leave</li><li>
Employee Stock Purchase Plan</li></ul>
Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
#LI-KV1 #CB #Ind123</div>

GCP Data Engineer

INNONEXIS TECHNOLOGY PRIVATE LIMITED

# We&rsquo;re Hiring: Freelance Data EngineerWe are looking for a talented Freelance Data Engineer to help us design, build, and optimize scalable data pipelines and platforms. # Key Responsibilities:Design, develop, and maintain ETL pipelines and workflowsWork with structured and unstructured data across multiple sourcesImplement and optimize data solutions on AWS (Glue, Lambda, EMR, S3, EC2, ECR, Batch)Integrate and manage data in Snowflake, MySQL, SalesforceCollaborate with data scientists, analysts, and business teams to deliver data-driven solutionsEnsure high performance, reliability, and security in data workflowsWork on CI/CD pipelines and containerization with Docker &amp; GitHub# Skills &amp; Tools:# AWS (Glue, Lambda, EMR, S3, EC2, ECR, Batch) # Snowflake, MySQL, Salesforce # Python, PySpark, SQL # Apache Airflow, Kafka, ETL, CI/CD. # GitHub, Docker# What We&rsquo;re Looking For:3+ years of experience as a Data Engineer (or similar role)Strong expertise in building data pipelines and working with big data toolsHands-on experience with AWS cloud services and data warehousesProficiency in Python, SQL, PySparkAvailable to work on a freelance/contract basisExcellent problem-solving and collaboration skills# Location: Remote (Freelance) # Engagement: Contract / FreelanceIf you&rsquo;re passionate about working with data, cloud, and modern data engineering tools, we&rsquo;d love to hear from you!# Apply now: hr@innonexis.comNOTE -: Salary negotiable according to&#8203; interview.Job Types: Full-time, PermanentPay: &#8377;40,000.00 - &#8377;50,000.00 per monthWork Location: Remote

Data engineer

<div>Before you apply to a job, select your language preference from the options available at the top right of this page.
Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrow&mdash;people with a unique combination of skill + passion. If you have the qualities and drive to lead yourself or teams, there are roles ready to cultivate your skills and take you to the next level.
Job Description:
Job Description
We're seeking a talented Data Engineer with hands-on experience in the Google Cloud data ecosystem and a proven track record of working with Vector Database, Knowledge Graphs like Neo4j and StarDog. You'll be instrumental in designing, building, and maintaining our data infrastructure and pipelines, enabling critical insights and supporting data-driven initiatives across the organization.
Responsibilities<ul><li>
Data Pipeline Development: Design, build, and optimize robust and scalable data pipelines to ingest, transform, and load data from various sources into our data warehouse and knowledge graphs.</li><li>
Cloud Data Stack Expertise: Implement and manage data solutions using Google Cloud Platform (GCP) services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, Spanner and Dataproc and Azure Cloud Services</li><li>
Knowledge Graph Engineering: Develop and maintain data models, ingest data, and create efficient queries within Neo4j and/or Stardog. Leverage your expertise to build and expand our enterprise knowledge graph.</li><li>
Data Quality &amp; Governance: Implement best practices for data quality, data validation, and data governance, ensuring data accuracy, consistency, and reliability.</li><li>
Performance Optimization: Continuously monitor and optimize the performance of data pipelines and database queries, identifying and resolving bottlenecks.</li><li>
Collaboration: Work closely with data scientists, analysts, and other engineering teams to understand data requirements and deliver effective data solutions.</li><li>
Documentation: Create and maintain comprehensive documentation for data pipelines, data models, and knowledge graph schemas.</li></ul>
Required Qualifications
Education:
Bachelor&rsquo;s degree in computer science, Engineering, or a related quantitative field.
Experience:<ul><li>
3+ years of professional experience as a Data Engineer or in a similar role.</li></ul><ul><li>
Strong hands-on experience with Google Cloud Platform (GCP) data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer (Apache Airflow).</li><li>
Demonstrable experience working with Knowledge Graph technologies, specifically Neo4j and/or Stardog. This includes data modeling, query language proficiency (Cypher for Neo4j, SPARQL for Stardog), and integration.</li><li>
Proficiency in Python for data manipulation and pipeline orchestration.</li><li>
Experience with SQL and data warehousing concepts.</li><li>
Familiarity with data modeling techniques for both relational and graph databases.</li><li>
Experience with version control systems (e.g., Git).</li></ul>
Preferred Qualifications<ul><li>
Experience with other GCP services like Data Catalog, Looker, or Vertex AI.</li><li>
Knowledge of streaming data technologies (e.g., Kafka, Google Cloud Dataflow streaming).</li><li>
Experience with other graph databases or semantic web technologies.</li><li>
Familiarity with data governance tools and principles.</li><li>
Certifications in Google Cloud Platform data engineering.</li></ul> 
Employee Type: 
Permanent 
UPS is committed to providing a workplace free of discrimination, harassment, and retaliation.</div>

Data Engineer - GCP, BiqQuery, Dataflow, Pub/Sub, Stardog, Composer

Apple

<div>Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other&rsquo;s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It&rsquo;s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you&rsquo;ll do more than join something - you&rsquo;ll add something. As a BigData Software Engineer, you are an integral part of a small data-centric team driving large-scale data infrastructure and processes development, implementation, and improvement. Our organization thrives on collaborative partnerships. Join and play a key role in developing and driving the adoption of Data Mesh and data-centric micro-services. Apple's Manufacturing Systems and Infrastructure (MSI) team is responsible for capturing, consolidating and tracking all manufacturing data for Apple&rsquo;s products and modules worldwide. Our tools enable teams to confidently use data to shape the next generation of product manufacturing at Apple. We seek a practitioner with experience building large-scale data platforms, analytic tools, and solutions. If you are passionate about making data easily accessible, trusted, and available across the entire business at scale, we'd love to hear from you.
 
 
Description 
 
As a BigData Engineer, you will lead the development and implementation of our cloud-based data infrastructure. You will work closely with cross-functional teams to understand data requirements, design scalable solutions, and ensure the integrity and availability of our data. The ideal candidate will have a deep understanding of cloud technologies, data engineering best practices, and a proven track record of successfully delivering complex data projects. - Lead the design and implementation of cloud-based data architectures. - Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. - Implement data security and privacy best practices. - Optimize data storage, retrieval, and processing for performance and cost efficiency. - Lead efforts to ensure data quality, consistency, and accuracy. - Mentor and provide technical guidance to junior data engineers. - Stay current with industry trends and emerging technologies in cloud data engineering.
 
 
Minimum Qualifications 
<ul><li>
Bachelor&rsquo;s or Master's degree in Computer Science or a related field
</li><li>Proven experience as a Big Data developer, with a focus on cloud platforms
</li><li>Strong proficiency in cloud services such as AWS, Azure, or Google Cloud
</li><li>Expertise in data modelling and data integration
</li><li>Experience with big data technologies (Hadoop, Spark, etc.)
</li><li>Proficient in programming languages such as Python, Java, Scala, GoLang
</li><li>Knowledge of data warehouse solutions (Redshift, BigQuery, Snowflake, Druid)
</li><li>Experience with streaming data technologies (Kafka, Kinesis)
</li></ul> 
Preferred Qualifications 
<ul><li>
Certification in cloud platforms (AWS Certified Big Data - Specialty, Microsoft Certified: Azure Data Engineer, etc.)
</li><li>Experience building data streaming solutions using Apache Spark, Storm, Link, Flume
</li><li>Experience using ETL tools and technologies like Reltio, Stibo, Informatics, Apache Atlas
</li><li>Knowledge of machine learning and data science concepts
</li><li>Contributions to the open source community
</li><li>Familiarity with data governance and compliance
</li><li>Strong problem-solving and analytical skills
</li>Excellent communication and leadership skills 
<li>
</li></ul> 
 
Submit CV</div>

Big Data Software Engineer - Manufacturing Systems & Infrastructure

ixceed

Role: AWS Data EngineerLocation: PuneMode: HybridType: PermanentJob Description:We are seeking a talented and motivated Data Engineer with requisite years of hands-on experience to join our growing data team. The ideal candidate will have experience working with large datasets, building data pipelines, and utilizing AWS public cloud services to support the design, development, and maintenance of scalable data architectures. This is an excellent opportunity for individuals who are passionate about data engineering and cloud technologies and want to make an impact in a dynamic and innovative environment.Key Responsibilities:<ul><li>Data Pipeline Development: Design, develop, and optimize end-to-end data pipelines for extracting, transforming, and loading (ETL) large volumes of data from diverse sources into data warehouses or lakes.</li><li>Cloud Infrastructure Management: Implement and manage data processing and storage solutions in AWS (Amazon Web Services) using services like S3, Redshift, Lambda, Glue, Kinesis, and others.</li><li>Data Modeling: Collaborate with data scientists, analysts, and business stakeholders to define data requirements and design optimal data models for reporting and analysis.</li><li>Performance Tuning &amp; Optimization: Identify bottlenecks and optimize query performance, pipeline processes, and cloud resources to ensure cost-effective and scalable data workflows.</li><li>Automation &amp; Scripting: Develop automated data workflows and scripts to improve operational efficiency using Python, SQL, or other scripting languages.</li><li>Collaboration &amp; Documentation: Work closely with data analysts, data scientists, and other engineering teams to ensure data availability, integrity, and quality. Document processes, architectures, and solutions clearly.</li><li>Data Quality &amp; Governance: Ensure the accuracy, consistency, and completeness of data. Implement and maintain data governance policies to ensure compliance and security standards are met.</li><li>Troubleshooting &amp; Support: Provide ongoing support for data pipelines and troubleshoot issues related to data integration, performance, and system reliability.</li></ul>Qualifications:Essential Skills:<ul><li>Experience: 8+ years of professional experience as a Data Engineer, with a strong background in building and optimizing data pipelines and working with large-scale datasets.</li><li>AWS Experience: Hands-on experience with AWS cloud services, particularly S3, Lambda, Glue, Redshift, RDS, and EC2.</li><li>ETL Processes: Strong understanding of ETL concepts, tools, and frameworks. Experience with data integration, cleansing, and transformation.</li><li>Programming Languages: Proficiency in Python, SQL, and other scripting languages (e.g., Bash, Scala, Java).</li><li>Data Warehousing: Experience with relational and non-relational databases, including data warehousing solutions like AWS Redshift, Snowflake, or similar platforms.</li><li>Data Modeling: Experience in designing data models, schema design, and data architecture for analytical systems.</li><li>Version Control &amp; CI/CD: Familiarity with version control tools (e.g., Git) and CI/CD pipelines.</li><li>Problem-Solving: Strong troubleshooting skills, with an ability to optimize performance and resolve technical issues across the data pipeline.</li></ul>Desirable Skills:<ul><li>Big Data Technologies: Experience with Hadoop, Spark, or other big data technologies.</li><li>Containerization &amp; Orchestration: Knowledge of Docker, Kubernetes, or similar containerization/orchestration technologies.</li><li>Data Security: Experience implementing security best practices in the cloud and managing data privacy requirements.</li><li>Data Streaming: Familiarity with data streaming technologies such as AWS Kinesis or Apache Kafka.</li><li>Business Intelligence Tools: Experience with BI tools (Tableau, Quicksight) for visualization and reporting.</li><li>Agile Methodology: Familiarity with Agile development practices and tools (Jira, Trello, etc.)</li></ul>Job Type: PermanentPay: &#8377;3,000,000.00 - &#8377;3,500,000.00 per yearBenefits:<ul><li>Work from home</li></ul>Experience:<ul><li>AWS: 4 years (Required)</li><li>Data Engineering: 6 years (Required)</li><li>Python: 3 years (Required)</li><li>Pyspark/Spark: 3 years (Required)</li></ul>Work Location: In person

AWS Data Engineer

ShyftLabs

<div><div>Position Overview:</div><div>
We are seeking a skilled and passionate Data Engineer with deep expertise in Google Cloud Platform (GCP) and Google BigQuery. In this role, you will architect, build, and maintain the scalable data pipelines that are the foundation of our analytics and data science initiatives.</div><div>
You will be responsible for the entire data lifecycle, from ingestion and processing to warehousing and serving. You will work on creating a reliable, efficient, and high-quality data ecosystem that empowers our data analysts, data scientists, and business leaders to make critical data-informed decisions.</div><div></div><div> 
ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries by focusing on creating value through innovation.</div>
<h3 class="jobSectionHeader">Job Responsibilities:</h3><ul><li>
Data Architecture &amp; Pipeline Development: Design, build, and maintain scalable and reliable batch and real-time ETL/ELT data pipelines using GCP services like Dataflow, Cloud Functions, Pub/Sub, and Cloud Composer.</li><li>
Data Warehousing: Develop and manage our central data warehouse in Google BigQuery. Implement data models, schemas, and table structures optimized for performance and scalability.</li><li>
Data Processing &amp; Transformation: Write clean, efficient, and robust code (primarily in SQL and Python) to transform raw data into curated, analysis-ready datasets.</li><li>
Infrastructure Optimization &amp; Scalability: Monitor, troubleshoot, and optimize our data infrastructure for performance, reliability, and cost-effectiveness. Implement BigQuery best practices, including partitioning, clustering, and materialized views.</li><li>
Enable Data Accessibility &amp; BI: Build and maintain curated data models that serve as the &quot;source of truth&quot; for business intelligence and reporting, ensuring data is ready for consumption by BI tools like Looker.</li><li>
Data Governance &amp; Quality: Implement automated data quality checks, validation rules, and monitoring to ensure the accuracy and integrity of our data pipelines and warehouse.</li><li>
Collaboration: Work closely with software engineers, data analysts, and data scientists to understand their data requirements and provide the necessary infrastructure and data products.</li></ul><h3 class="jobSectionHeader">
Basic Qualifications:</h3><ul><li>
Experience: 3-5+ years of hands-on experience in a Data Engineering, Software Engineering, or a similar role.</li><li>
Programming Skills: Strong proficiency in a programming language such as Python or Java for data processing and automation.</li><li>
Expert SQL Proficiency: Mastery of SQL for complex data manipulation, DDL/DML operations, and query optimization.</li><li>
Google BigQuery: Proven expertise in using BigQuery as a data warehouse, including data modeling, performance tuning, and cost management.</li><li>
GCP Data Services: Hands-on experience building data pipelines using the GCP ecosystem (e.g., Dataflow, Pub/Sub, Cloud Storage, Cloud Composer/Airflow).</li><li>
Data Pipeline Concepts: Deep understanding of ETL/ELT principles and data warehousing architecture (e.g., Star Schema, Data Lakes).</li><li>
Engineering Mindset: Strong problem-solving and troubleshooting skills with a focus on building scalable, maintainable, and automated systems.</li></ul><h3 class="jobSectionHeader">
Preferred Qualifications:</h3><ul><li>
BI Tool Integration: Experience building data models that power BI tools like Looker (knowledge of LookML is a strong plus), Tableau, or Power BI.</li><li>
Modern Data Stack Tools: Experience with tools like dbt, Dataform, or Fivetran for data transformation and integration.</li><li>
Infrastructure as Code (IaC): Familiarity with tools like Terraform or Deployment Manager for managing cloud infrastructure.</li><li>
Containerization: Knowledge of Docker and Kubernetes is a plus.</li><li>
Certifications: Google Cloud Professional Data Engineer certification is highly desirable.</li><li>
Version Control: Proficiency with Git for code management and CI/CD pipelines.</li></ul><div>
We are proud to offer a competitive salary alongside a strong insurance package. We pride ourselves on the growth of our employees, offering extensive learning and development resources.</div></div>

Data Engineer

Ashra Technology

Greeting from dayRole: Snowflake data engineerExp: 5+YearsLocation: RemoteDescription: Role - Snowflake Data Engineer Must Required Skills in KEYWORDS: Snowflake ETL SQL Azure Cloud Services Exp - 5+ years in Data work Job Location &ndash; Remote Billing Start date: October 10th Shift Timings: US- Eastern 8-5* Experience in ETL tools with strong SQL skills, minimum 5+ years. Matillion preferred.* Experience in creating pipelines for Data warehouse and should be experienced with Snowflake data manipulation and tuning.* Experience in backend programming including schema and table design, stored procedures, Triggers, Views, and Indexes.* Conduct data analysis, mapping transformation, data modeling and data-warehouse concepts* Strong working Experience with Agile, Scrum, Kanban, and Waterfall methodologies.* Knowledge of Matillion tool is an add on.* Strong communications skills &ndash; written and oral* Azure cloud platform experience required.Interested share your resume to akshitha@ashratech.com/868832632Job Type: Full-timePay: &#8377;1,000,000.00 - &#8377;2,000,000.00 per yearWork Location: In person

Snowflake Data Engineer

Search 10000+ Cloud data engineer jobs near you this October. New roles added regularly across leading industries. Apply today.