Principal Data Engineer

Principal Data Engineer

Summary of the Role

As a Principal Data Engineer, you’ll design and maintain scalable data systems that support analytics and decision-making. You’ll collaborate with cross-functional teams and help shape our data capabilities while supporting others in their growth.

In this role you’ll

• Design and maintain reliable, scalable data pipelines for both batch and real-time processing.

• Develop and manage ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) workflows using tools such as Apache Spark, Databricks, and Apache Kafka.

• Work closely with data scientists, analysts, and software engineers to build data-driven solutions.

• Support data quality, lineage, and governance across platforms, and improve system performance through tuning and resource management.

• Apply data protection protocols including encryption, access control, and anonymization to ensure data security.

About the Ideal Candidate:

• Design and implement robust, scalable data pipelines using Apache Spark, Scala, Kafka, Python and Databricks.

• Develop and maintain data lakes and warehouses using Delta Lake and SQL

• Implement CI/CD pipelines using Azure, Jenkins

• Should be handson on Python / Scala

• Support analytics and reporting platforms such as Power BI, Qlik Sense, and Kibana.

Diversity & Inclusion