gcp data engineer

HCLTech

Hiring: Senior GCP Data Engineer | HCLTech | Hybrid | Chennai / Bangalore / HyderabadWe are looking for an experienced Data Engineer to join our client HCLTech in a hybrid work model.Experience:<ul><li>8+ years overall experience</li><li>5+ years relevant mandatory</li><li>Banking domain &ndash; minimum 1 year (mandatory)</li><li>Notice Period &ndash; 15 days</li></ul>Location:Chennai | Bangalore | HyderabadMandatory Skills:<ul><li>SQL &amp; Python</li><li>Google Cloud Platform (GCP)</li><li>BigQuery (Partitioning &amp; Clustering)</li><li>Dataflow (Apache Beam)</li><li>Cloud Composer (Apache Airflow)</li><li>Cloud Data Fusion</li><li>DBT</li></ul>Nice to Have:<ul><li>SQL Server / SSIS</li><li>Kafka</li></ul>Role &amp; Responsibilities:<ul><li>Build reusable, scalable data pipelines handling structured &amp; unstructured data</li><li>Work with structured &amp; unstructured data and perform feature engineering for ML</li><li>Curate data to provide real-time contextual insights to power customer journeys</li><li>Design &amp; develop scalable real-time data applications using modern &amp; traditional platforms (Kafka, GCP, SQL Server)</li><li>Work across the full data lifecycle</li><li>Implement engineering best practices: TDD, Code Reviews, CI/CD</li><li>Mentor engineers and deliver high-quality, data-driven solutions for banking customers</li><li>Collaborate effectively across cross-functional teams</li></ul>Interested candidates who can join within 15 days, please share your updated resume and details at: laxitahiraman.b@dynpro.in#Hiring #DataEngineer #GCP #BigQuery #BankingDomain #HCLTech #ChennaiJobs #BangaloreJobs #HyderabadJobsJob Type: Contractual / TemporaryWork Location: Hybrid remote in Bangaon, West Bengal

GCP Data Engineer

Deutsche Bank

<div><h2 class="jobSectionHeader">Job Description:
</h2>Job Title: GCP Data Engineer, AS
Location: Pune, India
Role Description
It&rsquo;s a GCP Data Engineer role, performing end to end development of integrations, data preparation/synthesization/transformation, data quality, data storage workloads, along with usage of the prepared data for advanced data analytics (may include some of the AI use cases). It encompasses the L3 support activities as well for the implemented workloads.
What we&rsquo;ll offer you
As part of our flexible scheme, here are just some of the benefits that you&rsquo;ll enjoy
<ul><li>Best in class leave policy.
</li><li>Gender neutral parental leaves
</li><li>100% reimbursement under childcare assistance benefit (gender neutral)
</li><li>Sponsorship for Industry relevant certifications and education
</li><li>Employee Assistance Program for you and your family members
</li><li>Comprehensive Hospitalization Insurance for you and your dependents
</li><li>Accident and Term life Insurance
</li><li>Complementary Health screening for 35 yrs. and above
</li></ul>Your key responsibilities
<ul><li>Design, develop and maintain data pipelines using Python and SQL programming language on GCP.
</li><li>Expertise on API development and integration
</li><li>Experience on writing SQL queries and optimizing it.
</li><li>Strong programming skills with Python.
</li><li>Experience with GCP Composer or Apache airflow.
</li><li>Hands-on experience on streaming data pipelines.
</li><li>Worked on near real-time services like Pub Sub/Kafka.
</li><li>Proven experience on app development and hosting over cloud platform with help of Docker (preferably GCP, cloud run).
</li><li>A willingness to accept failures, learn and try again.
</li><li>Experience in Agile methodologies, ETL, ELT, Data movement and Data processing skills.
</li><li>Work with Cloud Composer to manage and process batch data jobs efficiently.
</li><li>Develop and optimize complex SQL queries for data analysis, extraction, and transformation.
</li><li>Develop and deploy google cloud services using Terraform.
</li><li>Consume and Hosting REST API using Python.
</li><li>Build and deploy AI and RAG pipelines
</li><li>Design, build and deploy agentic workflows
</li><li>Operationalize AI applications
</li><li>Knowledge of RAG, vector database, multi-agent system, agentic framework &ndash; ADK along with a2a protocol and agent cards
</li><li>Experienced in Vertex AI platform
</li><li>Implement CI CD pipeline using GitHub Action
</li><li>Monitor and troubleshoot data pipelines, resolving any issues in a timely manner.
</li><li>Ensure team collaboration using Jira, Confluence, and other tools.
</li><li>Ability to quickly learn new any existing technologies Strong problem-solving skills.
</li><li>Write advanced SQL and Python scripts.
</li><li>Strategize novel approaches for designing, implementing, deploying robust and scalable ai systems
</li><li>Certification on Professional Google Cloud Data engineer will be an added advantage.
</li></ul>Your skills and experience
<ul><li>6-10 years of IT experience, as a hands-on technologist.
</li><li>Proficient in Python
</li><li>Proficient in SQL.
</li><li>Hands on experience on GCP Cloud Composer, Data Flow, Big Query, Cloud Function, Cloud Run, Google ADK and good to have GKE
</li><li>Hands on experience in building and managing AI workloads and REST API hosting and consumptions.
</li><li>Proficient in Terraform/ Hashicorp.
</li><li>Experienced in GitHub and Git Actions
</li><li>Experienced in CI-CD
</li><li>Experience in automating ETL testing using python and SQL.
</li><li>Good to have APIGEE.
</li><li>Good to have Bit Bucket
</li><li>Understanding of LLM(Gemini) and embedding models
</li><li>Experienced in prompt engineering
</li></ul>How we&rsquo;ll support you
<ul><li>Training and development to help you excel in your career
</li><li>Coaching and support from experts in your team
</li><li>A culture of continuous learning to aid progression
</li><li>A range of flexible benefits that you can tailor to suit your needs
</li></ul>About us and our teams
Please visit our company website for further information:
https://www.db.com/company/company.html
We strive for a culture in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively.
<div><div><div><div>Together we share and celebrate the successes of our people. Together we are Deutsche Bank Group.
We welcome applications from all people and promote a positive, fair and inclusive work environment.</div></div></div></div></div>

GCP Data Engineer, AS

<div><h2 class="jobSectionHeader">Job Description:
</h2>Job Title: GCP Data Engineer, AVP
Location: Pune, India
Role Description
It&rsquo;s a GCP Data Engineer role, performing end to end development of integrations, data preparation/synthesization/transformation, data quality, data storage workloads, along with usage of the prepared data for advanced data analytics (may include some of the AI use cases). It encompasses the L3 support activities as well for the implemented workloads.
What we&rsquo;ll offer you
As part of our flexible scheme, here are just some of the benefits that you&rsquo;ll enjoy
<ul><li>Best in class leave policy.
</li><li>Gender neutral parental leaves
</li><li>100% reimbursement under childcare assistance benefit (gender neutral)
</li><li>Sponsorship for Industry relevant certifications and education
</li><li>Employee Assistance Program for you and your family members
</li><li>Comprehensive Hospitalization Insurance for you and your dependents
</li><li>Accident and Term life Insurance
</li><li>Complementary Health screening for 35 yrs. and above
</li></ul>Your key responsibilities
<ul><li>Design, develop and maintain data pipelines using Python and SQL programming language on GCP.
</li><li>Expertise on API development and integration
</li><li>Experience on writing SQL queries and optimizing it.
</li><li>Strong programming skills with Python.
</li><li>Experience with GCP Composer or Apache airflow.
</li><li>Hands-on experience on streaming data pipelines.
</li><li>Worked on near real-time services like Pub Sub/Kafka.
</li><li>Proven experience on app development and hosting over cloud platform with help of Docker (preferably GCP, cloud run).
</li><li>A willingness to accept failures, learn and try again.
</li><li>Experience in Agile methodologies, ETL, ELT, Data movement and Data processing skills.
</li><li>Work with Cloud Composer to manage and process batch data jobs efficiently.
</li><li>Develop and optimize complex SQL queries for data analysis, extraction, and transformation.
</li><li>Develop and deploy google cloud services using Terraform.
</li><li>Consume and Hosting REST API using Python.
</li><li>Build and deploy AI and RAG pipelines
</li><li>Design, build and deploy agentic workflows
</li><li>Operationalize AI applications
</li><li>Knowledge of RAG, vector database, multi-agent system, agentic framework &ndash; ADK along with a2a protocol and agent cards
</li><li>Experienced in Vertex AI platform
</li><li>Implement CI CD pipeline using GitHub Action
</li><li>Monitor and troubleshoot data pipelines, resolving any issues in a timely manner.
</li><li>Ensure team collaboration using Jira, Confluence, and other tools.
</li><li>Ability to quickly learn new any existing technologies Strong problem-solving skills.
</li><li>Write advanced SQL and Python scripts.
</li><li>Strategize novel approaches for designing, implementing, deploying robust and scalable ai systems
</li><li>Certification on Professional Google Cloud Data engineer will be an added advantage.
</li></ul>Your skills and experience
<ul><li>10+ years of IT experience, as a hands-on technologist.
</li><li>Proficient in Python
</li><li>Proficient in SQL.
</li><li>Hands on experience on GCP Cloud Composer, Data Flow, Big Query, Cloud Function, Cloud Run, Google ADK and good to have GKE
</li><li>Hands on experience in building and managing AI workloads and REST API hosting and consumptions.
</li><li>Proficient in Terraform/ Hashicorp.
</li><li>Experienced in GitHub and Git Actions
</li><li>Experienced in CI-CD
</li><li>Experience in automating ETL testing using python and SQL.
</li><li>Good to have APIGEE.
</li><li>Good to have Bit Bucket
</li><li>Understanding of LLM(Gemini) and embedding models
</li><li>Experienced in prompt engineering
</li></ul>How we&rsquo;ll support you
<ul><li>Training and development to help you excel in your career
</li><li>Coaching and support from experts in your team
</li><li>A culture of continuous learning to aid progression
</li><li>A range of flexible benefits that you can tailor to suit your needs
</li></ul>About us and our teams
Please visit our company website for further information:
https://www.db.com/company/company.html
We strive for a culture in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively.
<div><div><div><div>Together we share and celebrate the successes of our people. Together we are Deutsche Bank Group.
We welcome applications from all people and promote a positive, fair and inclusive work environment.</div></div></div></div></div>

GCP Data Engineer, AVP

Cambridge Technology Enterprises (CTE)

<div><div>Role Summary:<div></div> 
GCP Data Engineer with 2&ndash;3 years of experience in building and supporting data pipelines on Google Cloud Platform. The resource will work on data ingestion, transformation, and loading into BigQuery and support reporting/analytics teams. The role involves Python, SQL, and workflow scheduling.<div></div> 
Key Skills:<div></div> 
Google Cloud Platform (GCP)
BigQuery
Cloud Storage (GCS)
Cloud run and Cloud Function
Pub/Sub (basic knowledge)
Python
SQL
ETL/ELT concepts
JSON &amp; file processing (CSV/Parquet)
Git basics<div></div> 
Roles &amp; Responsibilities: 
Develop and maintain ETL pipelines using Python and SQL.
Load and transform data into BigQuery.
Create and manage Cloud run and Cloud Function.
Perform data validation and fix data issues and perform reprocessing/backfills.
Monitor jobs and handle failures.
Coordinate with upstream/downstream teams during failures.
Work with data scientists to provide clean datasets.
Optimize queries and improve pipeline performance
Support deployment and production issues.</div></div>

Data Engineer

Equinix

<div><div><div><h3 class="jobSectionHeader">Staff Data Engineer - GCP</h3>
 <div></div><div><div><ul><li>JR-157863
</li> <div></div><li>Hybrid
</li> </ul></div><div></div><div><ul><li>Bengaluru
</li> </ul></div><div></div><div><ul><li>Technology
</li> </ul></div><div></div><div><ul><li>Full time</li></ul></div></div><div></div><div><div> 
</div>
</div><div>Who are we?<div>

Equinix is the world&rsquo;s digital infrastructure company&reg;, shortening the path to connectivity to enable the innovations that enrich our work, life and planet. 

A place where bold ideas are welcomed, human connection is valued, and everyone has the opportunity to shape their future.
</div>
Help us challenge assumptions, uncover bias, and remove barriers&mdash;because progress starts with fresh ideas. You&rsquo;ll find belonging, purpose, and a team that welcomes you&mdash;because when you feel valued, you&rsquo;re empowered to do your best work.
Job Summary
As a key member of the Data Team at Equinix, we are seeking an experienced GCP Data Engineer who will lead end-to-end development of complex Data Engineering use cases and drive the evolution of Equinix's Data Lake platform. You will design and build enterprise-scale data infrastructure and analytics solutions on Google Cloud Platform while providing technical mentorship to the data engineering team. The ideal candidate combines deep technical expertise in cloud-native data technologies with proven leadership skills and a passion for building robust, scalable data platforms that drive strategic business insights.
Responsibilities<ul>
<li>
Participate in design and implementation of enterprise-scale data pipelines and platform architecture for End-to-End data products.</li>
<li>
Develop fault-tolerant, petabyte-scale data processing systems using advanced GCP services</li>
<li>
Evaluate and recommend new technologies, tools, and architectural approaches</li>
<li>
Build complex ETL/ELT workflows using Cloud Dataflow, Composer, Dataform/dbt, BigQuery and custom solutions</li>
<li>
Implement sophisticated real-time streaming architectures with Cloud Pub/Sub, Kafka and Apache Beam</li>
<li>
Design and optimize data processing workflows for performance, cost, and reliability</li>
<li>
Develop advanced data transformation logic and custom processing functions</li>
<li>
Implement data architectures and microservices-based data platforms</li>
<li>
Design multi-environment deployment strategies and automated scaling solutions</li>
<li>
Establish monitoring, alerting, and observability frameworks across the data platform</li>
<li>
Lead code reviews and establish quality assurance processes</li>
<li>
Provide technical guidance on complex problem-solving and optimization techniques</li>
<li>
Facilitate knowledge sharing sessions and technical training programs</li>
<li>
Collaborate with hiring managers on technical interviews and team expansion</li>
<li>
Implement comprehensive data governance frameworks and compliance controls</li>
<li>
Design fine-grained access controls and data classification systems</li>
<li>
Establish automated data quality monitoring and lineage tracking</li>
<li>
Ensure GDPR, SOX, and other regulatory compliance across data workflows</li>
<li>
Implement privacy-preserving techniques and data anonymization strategies</li>
<li>
Translate complex business requirements into scalable technical solutions</li>
<li>
Coordinate cross-functional initiatives involving multiple engineering teams</li>
</ul>
Qualifications
Technical Expertise<ul>
<li>
GCP Services: 5+ years hands-on experience with BigQuery (advanced SQL, scripting, ML integration), Cloud Dataflow, Cloud Composer, Cloud Storage, Pub/Sub, and Vertex AI</li>
<li>
Programming: Expert-level Python/Java programming, proficiency in Python/Scala for Spark development</li>
<li>
Advanced Technologies: Deep experience with Apache Beam, Airflow, Kubernetes, Docker, and distributed computing</li>
<li>
Infrastructure: Extensive experience with Terraform, CI/CD pipelines, and cloud infrastructure management</li>
<li>
Database Systems: Advanced knowledge of both relational and NoSQL databases, data modeling, and performance optimization</li>
</ul>
Professional Experience<ul>
<li>
Bachelor&rsquo;s or master&rsquo;s degree in computer science, Engineering, or related field</li>
<li>
5+ years of data engineering experience with 4+ years specifically on Google Cloud Platform</li>
<li>
Proven track record of delivering complex, enterprise-scale data solutions</li>
<li>
Experience with data governance, compliance, and security frameworks</li>
<li>
Excellent written and verbal communication skills with ability to present to executives</li>
<li>
Experience working with cross-functional projects and managing stakeholder relationships</li>
<li>
Proven ability to translate business requirements into technical solutions</li>
<li>
Google Cloud Professional Data Engineer certification</li>
<li>
Experience with MLOps, feature stores, and machine learning pipeline development</li>
<li>
Knowledge of data science workflows and statistical analysis</li>
<li>
Experience with BI tools (Looker, Tableau) and advanced analytics platforms</li>
</ul>
Equinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing form.
Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.
We use artificial intelligence in our hiring process. Learn more here.</div></div></div></div>

Staff Data Engineer - GCP

HSBC

<div>Job Tilte : Assistant Director &ndash; Decision Systems Data 
In this role, you will:<ul><li>
This role will sit within the decisioning ecosystem for Fraud/ Credit/Collections and the role holder will need to manage internal and external data used for automated decisions. Data engineer is a global lead role to support the data pipeline across regions.</li><li>
Build and maintain data pipelines on GCP. Build complex attributes, scorecards on GCP.</li><li>
Impact analysis of data/attribute changes and de-deduplication.Exceeding stakeholders&rsquo; and customers&rsquo; expectations by delivering best solutions to data issues.</li><li>
Building and maintaining strong working relationships with key stakeholders across all levels. The role holder needs to manage one or more clients from regions having different time zones, regulatory environment, and maturity of business, data &amp; systems.</li><li>
Mentors&rsquo; new joiners and supports in their day-to-day deliveries.Actively contribute with the monitoring and reporting of progress, issues, dependencies, risks to the Program management, internal stakeholders and/or steering committees.</li></ul> 
To be successful in this role:<ul><li>
Over 8+ years relevant experience on cloud computing with GCP experience. Bachelor&rsquo;s or master&rsquo;s degree from reputed university with specialization in engineering discipline. Knowledge and understanding of financial-services/Retail banking-operations is desired.Experience on working on Data/Information Management projects of varying complexities. Strong background and hands-on experience on google cloud (GCP) implementing data pipelines.
</li><li>Strong experience in Airflow, Big Query, DBT, Big Table, Dataflow, Python, CICD Pipeline, Jenkins. Strong hold on SQL data processing queries like Joins, optimizing queries etc. Strong experience in efficient cloud computing, able to provide design solutions for data pipeline use cases. Strong hold on GCP performance optimization matrices. Able to run various PoCs for capability enhancements.</li><li>
GCP Data engineer certification will be desired. Experience with Agile/iterative process in delivering use cases. Exposure to JIRA/Confluence for project management activity. Enthusiasm for proactively seeking, exploring, and developing use cases for new data and/or tools/wider industry trends.</li><li>
Proven ability to work in a matrix multi-national operating structure. Strong experience in leading a team to deliver use cases or projects. Strong team mentoring experience. Strong analytical skills with business analysis aptitude. Knowledge and understanding of financial-services/Retail banking-operations across the credit cycle: acquisitions, portfolio management, collections.</li><li>
Strong background working with large-scale data. Experience with Agile/iterative process in the context of project tracking and reporting. Exposure to JIRA/Confluence for project management activity. The role holder must own the responsibility for all aspects of data analysis and build knowledge on credit risk and collections and fraud business areas.</li><li>
Actively contribute with the monitoring and reporting of progress, issues, dependencies, risks to the Program management, internal stakeholders and/or steering committees. Assist business stakeholders with the decomposition of complex business requirements</li><li>
Strong understanding of Credit Risk Strategies: acquisitions, portfolio management collections and its data components. Experience in data transformation and data visualization and analytics etc. Proven passion for data analysis and data quality</li></ul> 
HSBC.Careers.com
You&rsquo;ll achieve more when you join HSBC. 
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website. 
***Issued by HSBC Electronic Data Processing (India) Private LTD***</div>

Assistant Director, Decision Systems Data

Valeo

<div>Valeo is a tech global company, designing breakthrough solutions to reinvent the mobility. We are an automotive supplier partner to automakers and new mobility actors worldwide. Our vision? Invent a greener and more secured mobility, thanks to solutions focusing on intuitive driving and reducing CO2 emissions. We are leader on our businesses, and recognized as one of the largest global innovative companies.
<ul><li><div><div><div><div><h2 class="jobSectionHeader">Responsibilities
</h2><ul><li>Participate in Analytics projects in GCP
</li><li>Design, build, and optimize scalable data pipelines for ingestion, processing, and validation.
</li><li>Monitor and optimize cloud environments for performance, security, and cost efficiency.
</li><li>Manage and configure GCP resources such as BigQuery, Cloud Functions, Cloud Storage, and other GCP services. .
</li><li>Ensure data quality and validation across the analytics ecosystem.
</li><li>Implement cloud security best practices and ensure compliance with industry standards.
</li><li>Collaborate with cross-functional teams to integrate data from multiple sources and improve data flows.
</li><li>Explore and experiment with new use cases in Data Analytics, Data Engineering, and AI.
</li><li>Troubleshoot and resolve cloud and data pipeline issues to improve system reliability.
</li><li>Provide insights and recommendations for cloud cost optimization and resource management.
</li><li>Collect, analyze, and align business requirements with stakeholders for data-driven solutions.
</li><li>Develop and maintain clear documentation for data processes, cloud architecture, and best practices.
</li></ul><h2 class="jobSectionHeader">Requirements
</h2><ul><li>Education/Training
</li><li>BSc degree in computer engineering, computer science or any similar technical field of study
</li><li>Languages
</li><li>Excellent command of English language is a must (Written and Verbal)
</li><li>French fluency is a plus.
</li></ul></div></div></div></div></li></ul>Job:
Business Applications Analyst
Organization:
IS SSC
Schedule:
Full time
Employee Status:
Regular
Job Type:
Job Posting Date:
2026-02-08
<div>Join Us !
 
Being part of our team, you will join:
 
<ul><li>one of the largest global innovative companies, with more than 20,000 engineers working in Research &amp; Development
</li><li>a multi-cultural environment that values diversity and international collaboration
</li><li>more than 100,000 colleagues in 31 countries... which make a lot of opportunity for career growth
</li><li>a business highly committed to limiting the environmental impact if its activities and ranked by Corporate Knights as the number one company in the automotive sector in terms of sustainable development
</li></ul> 
More information on Valeo: https://www.valeo.com</div></div>

Senior Google Cloud Data Engineer, Valeo Service

Search 10000+ Gcp data engineer jobs near you this March. New roles added regularly across leading industries. Apply today.