Software Engineer Lead - Data Engineer Databricks

About the job you’re considering

Capgemini is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative. The engineer will be responsible for building data pipelines and models to support product-level carbon footprint analysis. This role involves integrating structured engineering, manufacturing, and supplier data into a unified model using Databricks on AWS.

Your role

• Develop and optimize ETL/ELT pipelines on Databricks using PySpark and SQL to support carbon footprint analytics.

  • 
    Build data models that combine engineering (EBOM), manufacturing (MBOM), supplier, and factory operations data to generate emissions metrics.
  • Integrate and transform data from:
  • MBOM from SAP, including multilevel BOM explosion logic
  • EBOM from Oracle-based systems (no explosion required)
  • Supplier environmental data (e.g., material-level emissions)
  • Factory data (e.g., energy consumption, material usage)
  • Collaborate with sustainability analysts, engineering teams, and supply chain stakeholders to translate carbon calculation logic into data transformations.
  • Ensure high data quality, lineage, and governance using Delta Lake, Unity Catalog, and standard best practices.
  • Leverage AWS services such as S3, Glue, and Athena for orchestration and storage.
  • Document data logic and workflows for traceability and compliance with ESG standards.

Your skills and experience

• Hands-on experience with Databricks (Delta Lake, Unity Catalog, Jobs, Workflows)
  

  • Strong skills in PySpark and SQL
  • Experience with SAP MBOM structures, especially multilevel BOM explosion
  • Understanding of Oracle-based EBOM systems and ability to integrate structured data
  • Familiarity with AWS data ecosystem (S3, Glue, Lambda, Athena)
  • Strong knowledge of data modeling, pipeline optimization, and performance tuning

Life at Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

• Flexible work
• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Employee Resource Groups
• Disaster Relief

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to
engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2024 global revenues of €22.1 billion.

Get the future you want | www.capgemini.com

Disclaimer

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.

Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.