gcp data engineer

Cognizant Technology Solutions

<div><p><b>Skills-GCP Data Engineer</b></p><p><b>
Experience: 4 to 13 years</b></p><p><b>
Location: AIA-Gurgaon</b></p><p></p><ul><li><b>
Hands-on experience with GCP services, specifically BigQuery, Cloud Storage, and Composer for data pipeline orchestration</b></li><li><b>
Proficiency in Databricks platform with PySpark for building and optimizing large-scale ETL/ELT processes</b></li><li><b>
Expertise in writing and tuning complex SQL queries for data transformation, aggregation, and reporting on large datasets</b></li><li><b>
Experience integrating data from multiple sources such as APIs, cloud storage, and databases into a central data warehouse</b></li><li><b>
Familiarity with workflow orchestration tools like Apache Airflow or Cloud Composer for scheduling, monitoring, and managing data jobs</b></li><li><b>
Knowledge of version control systems (Git), CI/CD practices, and Agile development methodologies</b></li></ul><p></p><p><b>
Overall Responsibilities</b></p><ul><li><b>
Design, develop, and maintain scalable data pipelines using GCP, Pyspark, and associated tools</b></li><li><b>
Write efficient, well-documented SQL queries to support data transformation, data quality, and reporting needs</b></li><li><b>
Integrate data from diverse sources, including APIs, cloud storage, and databases, to create a reliable central data repository</b></li><li><b>
Develop automated workflows and schedules for data processing tasks utilizing Composer or Airflow</b></li><li><b>
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver solutions</b></li><li><b>
Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and reliability</b></li><li><b>
Maintain data security, privacy standards, and documentation compliance</b></li><li><b>
Stay informed about emerging data engineering technologies and apply them effectively to improve workflows</b></li></ul></div>

GCP Data Engineer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><div><b>JD-</b></div>
<div><b>
Google Data Engineer</b></div><br>
<div></div>
<div><b>
Exp -5 to 10 years</b></div><div></div><div><b><br>
Design, build, and optimize systems for data collection, storage, access, and analytics at scale. They create data pipelines that convert raw data into formats usable by data scientists, data-centric applications, and other data consumers.Should be proficient in Python/Java Script,SQL and Data analysis,Data Query and Composer.</b></div>
</div></div></div><div><div><div><b>Location</b></div>
<div>Pune</div>
</div><div><div><b>Job Function</b></div>
<div>IT INFRASTRUCTURE SERVICES</div>
</div><div><div><b>Role</b></div>
<div>Engineer</div>
</div><div><div><b>Job Id</b></div>
<div>375465</div>
</div><div><div><b>Desired Skills</b></div>
<div>Python | GCP - IT Service Management Consulting | MySql
</div></div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Capco

<p></p><div><p><b>About Us</b></p>
<p><b>
&ldquo;Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar &amp; Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.</b></p>
<p><b>
WHY JOIN CAPCO?</b></p>
<p><b>
You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.</b></p>
<p><b>
MAKE AN IMPACT</b></p>
<p><b>
Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.</b></p>
<p><b>
#BEYOURSELFATWORK</b></p>
<p><b>
Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.</b></p><br>
<p></p>
<p><b>
CAREER ADVANCEMENT</b></p>
<p><b>
With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.</b></p>
<p><b>
DIVERSITY &amp; INCLUSION</b></p>
<p><b>
We believe that diversity of people and perspective gives us a competitive advantage.</b></p>
<p><b>
MAKE AN IMPACT</b></p><p></p><p><br>
In this role, you will:</p><br>
<p></p>
<ul><li>Technical leadership for a team of engineers that focus on development, deployment and operations</li></ul>
<ul><li>Lead and contribute to multiple pods with moderate resource requirements, risk, and/or complexity</li></ul>
<ul><li>Interface technically with a range of stakeholders with customer and business impact</li></ul>
<ul><li>Leading others to solve complex problems</li></ul>
<ul><li>Experience in working within an agile, multidisciplinary DevOps team</li></ul>
<ul><li>Migrate and re-engineer existing services from on-premises data centers to Cloud (GCP/AWS)</li></ul>
<ul><li>ETL Engineer is responsible for performing system development work with background of various data models and data warehousing concepts.</li></ul>
<ul><li>Write, analyse, review, and rewrite programs to departmental and Group standards</li></ul>
<ul><li>Understanding the business requirements and provide the real-time solutions</li></ul>
<ul><li>Following the project development tools like JIRA, Confluence and GIT</li></ul>
<ul><li>Build and maintain operations tools for monitoring, notifications, trending, and analysis.</li></ul>
<ul><li>Enhance programs to increase operating efficiency or adapt to new requirements</li></ul>
<ul><li>Review code from team members Analyst/Developers as part of the quality assurance process</li></ul>
<ul><li>Produce unit test plans with detailed expected results to fully exercise the code.</li></ul>
<ul><li>Work closely with solution architect, business Analyst and technology lead to contribute in achieving final outcome.</li></ul>
<ul><li>Demonstrate upward graph in adaption of various Engineering Practices.</li></ul><br>
<p></p>
<p>
To be successful in this role, you should meet the following requirements:</p><br>
<p></p>
<ul><li>Mandatory Skills: -</li></ul>
<p>
o Senior Data Engineer with Cloud (GCP) (Experience - 8 to 12 Years)</p>
<p>
o Mandatory Google Cloud Big Query Scripting Skills or Cloud SQL hands-on experience</p>
<p>
o Mandatory SQL PL/SQL Scripting Experience [High level expertise and hands-on work]</p>
<p>
o Mandatory shell scripting Or Python Skills [High level expertise and hands-on work]</p>
<p>
o Should have experience on any of the RDBMS</p>
<p>
o Should have leadership experience.</p><br>
<p></p>
<ul><li>Good To Have: -</li></ul>
<p>
o GCP Data Engineer certifications is an added advantage.</p>
<p>
o Experience/knowledge on GCP components like GCS, Big Query, Airflow, Cloud SQL and Google Cloud SDK</p>
<p>
o Good to have knowledge - Preferable Control M or ETL Tool or Any from - UC4 Atomic, Airflow Composer</p>
<p>
o Prefer to have Juniper Ingestion process awareness</p>
<p>
o Experience in working within an agile, multidisciplinary &lsquo;Dev-Ops&rsquo; team.</p>
<p>
o Changes, Incident and Problem Management</p></div><p></p>

<div></div><div><div><div><div><ul><li>Design, develop, and maintain ETL/ELT pipelines using Airflow and transformation tools like dbt (or similar)</li>
<li>Manage data workflows and orchestration on Google Cloud Composer</li>
<li>Build and maintain data storage and processing workflows, preferably on Google Cloud Platform (GCP) using BigQuery and GCS (or equivalent tools in other cloud environments)</li>
<li>Automate infrastructure and deployments using Terraform</li>
<li>Collaborate with data analysts, scientists, and engineers to deliver clean, tested, and reliable datasets</li>
<li>Monitor pipeline performance, handle failures, and ensure data quality and observability</li>
<li>Follow best practices for coding, testing, documentation, and version control</li>
</ul></div></div></div><div><div><div><b>Location</b></div>
<div>Bengaluru</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Engineer</div>
</div><div><div><b>Job Id</b></div>
<div>379402</div>
</div><div><div><b>Desired Skills</b></div>
<div>Python</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF ENGINEERING</div></div></div><div></div>

GCP DATA ENGINEER

Prodapt Solutions

<div>Overview:
<h3 class="jobSectionHeader"><b>Overview:</b></h3><p>
We are seeking a talented and motivated GCP Data Engineer with experience in real-time streaming technologies, specifically Apache Kafka, and proficiency in Java. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and streaming applications in a cloud environment.</p><br>
<p></p>
Responsibilities:
<h3 class="jobSectionHeader"><b>Key Responsibilities:</b></h3><ul><li><b>
Data Pipeline Development:</b> Design and implement robust data pipelines using Google Cloud services (BigQuery, Dataflow, Pub/Sub) integrated with Kafka for real-time data processing.</li><li><b>
Streaming Applications:</b> Develop and maintain real-time streaming applications using Kafka and Java, ensuring high availability and performance.</li><li><b>
Cloud Infrastructure:</b> Utilize GCP technologies to build scalable and efficient data architectures, leveraging tools such as Cloud Storage, Cloud Functions, and Kubernetes.</li><li><b>
Monitoring and Optimization:</b> Monitor data flow, performance metrics, and troubleshoot issues in production environments. Optimize data pipeline performance and reliability.</li><li><b>
Collaboration:</b> Work closely with data scientists, analysts, and other engineers to understand data requirements and translate them into technical specifications.</li><li><b>
Documentation:</b> Maintain comprehensive documentation of data pipelines, architecture, and processes to ensure knowledge sharing and compliance.</li></ul><br>
<p></p>
Requirements:
<h3 class="jobSectionHeader"><b>Required Skills:</b></h3><ul><li><b>
Cloud Skills:</b> Proficiency in Google Cloud Platform (GCP), including services like BigQuery, Dataflow, and Pub/Sub.</li><li><b>
Streaming Technologies:</b> Strong experience with Kafka for real-time data streaming and messaging.</li><li><b>
Programming Language:</b> Proficient in Java, with a solid understanding of object-oriented programming principles and best practices.</li><li><b>
Data Management:</b> Familiarity with data modeling, ETL processes, and database management.</li><li><b>
Development Tools:</b> Experience with version control systems (e.g., Git), CI/CD tools, and Agile methodologies.</li><li><b>
Problem-Solving:</b> Strong analytical and troubleshooting skills, with the ability to work independently and as part of a team.</li></ul><p></p><h3 class="jobSectionHeader"><b><br>
Preferred Qualifications:</b></h3><ul><li>
Bachelor's degree in Computer Science, Information Technology, or a related field.</li><li>
Experience with other programming languages (Python, Scala) is a plus.</li><li>
Knowledge of additional GCP services or data visualization tools (e.g., Looker, Tableau) is advantageous.</li></ul></div><p></p>

GCP Data Engineer (Kafka + Java)

HSBC

<div><p>Some careers shine brighter than others.<br>
If you&rsquo;re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.</p><p>
HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.</p><p>
We are currently seeking an experienced professional to join our team in the role of Senior Consultant Specialist</p><p>
In this role, you will:</p><ul><li>Migrate and re-engineer existing services from on-premises data centres to Cloud (GCP)</li><li>Understanding the business requirements and provide the real-time solutions</li><li>Following the project development tools like JIRA, Confluence and GIT HUB</li><li>Write python/shell scripts to automate operations and server management</li><li>Build and maintain operations tools for monitoring, notifications, trending, and analysis.</li><li>Define, create, test, and execute operations procedures.</li><li>Document current and future configuration processes and policies</li></ul><p>
To be successful in this role, you should meet the following requirements:</p><ul><li>Data Engineer/Developer with Cloud (GCP) (Experience - 12 to 15 Years)</li><li>Expert in Python, Data Flow, Pubsub, Big Query</li><li>Hadoop knowledge, NiFi/Kafka experience ( Preferable )</li><li>Must have good Experience/knowledge on GCP components like GCS, BigQuery, AirFlow, DataFlow, AlloyDB, CloudRUN, Cloud SQL, PubSub/Kafka and Google Cloud SDK</li><li>Understanding of Terraform script, Shell script</li><li>Should have experience on any of the RDBMS</li><li>GCP Data Engineer certifications is an added advantage</li></ul><p>
You&rsquo;ll achieve more when you join HSBC.</p><p>
www.hsbc.com/careers</p><p>
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.</p><p>
Issued by &ndash; HSDI</p></div>

GCP Data Engineer / Senior Consultant Specialist

Ford Motor Company

<div><p>As a Senior Data Engineer, you will leverage your deep knowledge of GCP and your experience with cloud migration to build and maintain scalable, secure, and reliable Data solutions. You will collaborate closely with architects, engineers, and operations teams to deliver high-quality cloud-based solutions.</p></div>
<br><div><p><b>Responsibilities:
</b></p><ul><li>Design, develop, and optimize data pipelines and ETL workflows using GCP services such as Big Query, Dataflow, Pub/Sub, Dataproc, and Cloud Storage.
</li><li>Perform data cleaning, transformation, and validation to ensure accuracy and consistency across various data sources
</li><li>Understand solution patterns and help application teams implement the patterns and maintain data warehousing solutions to support analytics and reporting needs.
</li><li>Ensure data integrity, security, and governance best practices are followed across all data solutions.
</li><li>Work closely with cross functional applications to provide hands on help with the migrations
</li><li>Work closely with BI teams&rsquo; data scientists, analysts, and business stakeholders to understand data needs and translate them into scalable solutions.
</li><li>Monitor, troubleshoot, and improve data pipelines to ensure high availability and performance.
</li><li>Advocate for best practices in data modeling, schema design, and query optimization.
</li><li>Orchestrate data processing and workflows using Astronomer and Terraform.
</li><li>Collaborate in the design and implementation of machine learning data pipelines where applicable.
</li><li>Stay up to date with the latest GCP data technologies and industry trends.
</li><li>Leverage LLMs to create accelerators wherever it is feasible
</li></ul><p><b>Preferred Qualifications:
</b></p><ul><li>GCP certifications (Professional Cloud Architect &amp; Professional Data Engineer).
</li><li>Experience with machine learning pipelines and AI-driven data solutions.
</li><li>Experience with IBM DataStage, Informatica, DBT &amp; Databricks
</li><li>Knowledge &amp; understanding of BI tools such as QlikSense, Power BI etc.
</li></ul><p>Experience with containerization (Docker, Kubernetes).</p></div>
<br><div><p><b>Qualifications:
</b></p><ul><li>8+ years of experience in data engineering with a 3+ years of hands-on experience of Data Engineering on Google cloud-based data solutions.
</li><li>Strong hands-on experience with Google Cloud Platform (GCP) services, including Big Query, Dataflow, Dataproc, and Pub/Sub, Data Catalog/ Data Plex Catalog
</li><li>Proficiency in SQL, Python, and Pyspark or Apache Beam.
</li><li>Proficiency understanding on Data Warehousing, Data Analysis, Data Profiling, Data Quality &amp; Data Mapping
</li><li>Experience building and optimizing ETL/ELT processes for large-scale data environments.
</li><li>Experience in Migrating on prem Warehouses, ETLs and BI tools to GCP
</li><li>Familiarity with data modeling, schema design, and Big Query optimization.
</li><li>Hands-on experience with infrastructure-as-code tools like Terraform.
</li><li>Experience working with real-time data streaming and batch processing.
</li><li>Strong problem-solving skills and ability to work in a fast-paced environment.
</li><li>Excellent communication and collaboration skills.
</li><li>Experience with CI/CD tools and automation frameworks (e.g., Jenkins, GitLab CI, Terraform, Tekton etc..).</li></ul></div>

PLM Data & Analytics Cloud Engineer

Search 10000+ Gcp data engineer jobs near you this November. New roles added regularly across leading industries. Apply today.

10000 gcp data engineer jobs NEAR_ME

GCP Data Engineer

GCP Data Engineer

GCP Data Engineer

GCP DATA ENGINEER

GCP Data Engineer (Kafka + Java)

GCP Data Engineer / Senior Consultant Specialist

PLM Data & Analytics Cloud Engineer