Data Architect

Key Skills:Databricks & PySpark
Mode of Work: Work From Office

Experience: 4-16 Years

About the job:
Join ValueMomentum’s Data Engineering team to design, build and scale Azure Databricks lakehouse solutions for P&C insurance customers. This hiring drive covers three experience bands — SSE, Tech Lead and Architect — so apply to the level that matches your background. Across levels, you’ll own end-to-end data platform delivery: authoring ETL/ELT pipelines (ADF & Databricks), developing PySpark transformations, enabling Delta Lake patterns, implementing governance, and delivering production-grade CI/CD and cost-optimised architectures.

Know your team:

At ValueMomentum Technology Solution Centers, we are a team of passionate software engineering teams who thrive on tackling complex business challenges with innovative solutions catering to the P&C insurance value chain. We achieve this through a strong software engineering foundation and by continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Platforms, Infra/Cloud, Application, Data, Core, and Quality Assurance.

Join our team that invests in your growth. Our Infinity Program empowers you to build your career with role-specific skill development, leveraging immersive learning platforms. You'll have the opportunity to work with some of the best minds serving insurance customers in the US, UK and Canadian markets.

Responsibilities:

• Design, develop and operate data pipelines using Azure Databricks, ADF and ADLS.
• Implement transformations in SQL, Python & PySpark; build testable, modular code.
• Collaborate with product, BI, infra and QA teams to deliver data models and analytics-ready datasets.
• Integrate pipelines into CI/CD, monitor jobs, troubleshoot performance and ensure data quality.
• Follow Agile practices and contribute to sprint planning, design reviews and documentation.

Requirements:

• Hands-on Databricks & PySpark experience.
• Strong SQL and Python skills.
• Experience with Azure Data Factory, ADLS (Data Lake) and Azure DevOps/Git pipelines.
• Working knowledge of Delta Lake concepts, CI/CD for data workloads and Agile delivery.
• Good debugging, performance tuning and data modelling capabilities.

Good To Have:
Candidates with these additional skills on their resumes have an added advantage when their profiles are being assessed. Some of them are as follows:

• Experience with Auto Loader, Delta Live Tables (DLT), Unity Catalogue, and Starburst.
• Migration experience from Hadoop/SSIS/Informatica/Vertica to Databricks.
• Azure Synapse, Delta Lake optimisations, streaming patterns.
• Insurance / P&C domain experience and pre-sales/solutioning exposure.