Data Engineer

Backend / Data Engineer — Pipeline & Data Architecture

We are engaging a Senior Data Engineer to design and build the data pipelines underpinning an AI-enabled delivery programme for one of our clients - a global leading strategy-led Tech consultancy for their technology build unit.

You will work within Palantir Foundry, building production-grade pipelines that directly support downstream AI applications.

What You'll Be Doing

• Designing and building robust data pipelines using Foundry Transforms (Python / SQL)
• Modelling data within Foundry's ontology layer (objects, relationships, properties)
• Integrating data from external systems (APIs, batch ingestion, files)
• Ensuring data quality, reliability, and lineage visibility
• Structuring datasets for downstream application and AI consumption
• Collaborating closely with AI engineers to align data outputs with usage needs
  
  
  

What We're Looking For

Must-Have

• Strong experience designing and owning production data pipelines
• Solid Python and/or SQL for data processing
• Experience working with modern data platforms (e.g. Foundry, Databricks, Spark, dbt)
• Good understanding of:
• data modelling
• pipeline reliability
• data quality and governance
  
  
  

Strongly preferred:

• Hands-on experience with Palantir Foundry:
• Transforms
• dataset management
• ontology modelling
  
  
  

Nice-to-have:

• Experience supporting AI / LLM use cases
• Familiarity with how data is consumed in LLM workflows
• Experience with real-time or near-real-time pipelines
  
  
  

If you are experienced in designing data that works reliably in production and is usable downstream ( not just pipelines that run), we want to hear from you.