Lead Data Engineer

Role Overview

We are looking for a skilled Data Engineer with strong expertise in cloud-based data platforms, data engineering frameworks, and modern programming languages. The ideal candidate will have hands-on experience with Azure, Databricks, and large-scale data processing using Python and PySpark. This role requires strong collaboration with stakeholders and the ability to manage programs and deliver scalable data solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL.
• Build and optimize data workflows on Azure Cloud using Databricks.
• Develop and implement efficient data models to support analytics and reporting requirements.
• Write optimized SQL queries for data transformation, integration, and analysis.
• Collaborate with cross-functional teams to gather data requirements and translate them into technical solutions.
• Work closely with stakeholders to ensure data solutions align with business objectives.
• Develop and maintain components using TypeScript where required for data platform integrations.
• Ensure data quality, reliability, and performance across the data ecosystem.
• Lead or support program management activities, including planning, execution, and delivery of data initiatives.

Required Skills

• Strong programming skills in Python, PySpark, and SQL.
• Hands-on experience with Azure Cloud Platform.
• Experience working with Azure Databricks for large-scale data processing.
• Solid understanding of data modeling concepts and data architecture.
• Proficiency in SQL programming and query optimization.
• Experience with TypeScript development.
• Strong stakeholder management and communication skills.
• Experience in program management or managing complex data initiatives.

Preferred Qualifications

• Experience working with large-scale data platforms and modern data architectures.
• Familiarity with data warehousing and analytics solutions.
• Ability to work in a fast-paced, collaborative environment.