- Designing and developing data products in the Microsoft Azure stack such as Azure Data Factory, Databricks, Azure DevOps deployment pipelines, Airflow, et cetera
- Creating scalable data products to boost data-driven working Leading in one or more initiatives within the area D&I to enable, facilitate and operationalize innovation to be at the forefront of technological developments.
- Work together with other lead engineers at area level to set the foundations and best practices.
- Ensure that other engineers can proactively identify gaps in information, manage limitations, and consider the broader implications of their decisions.
- 7+ years’ experience as a Data Engineer in a complex IT landscape
- Experience in Azure Data Bricks Knowledge , Splunk , Dynatrace , Pyspark, AWS /Azure Devops CI/CD, Airflow , Specflow ,
- Experience in working with SQL and developing ETL solutions Experienced in working with Azure data platform. For example, ADF, Databricks, Synapse, Azure DevOps
- Experienced in testing pipelines which are built on Azure with system and regression tests
- Experienced with OPS work like monitoring and s olving incidents
- Knowledge of Apache Airflow
- Knowledge of data modelling and data management is preferable
- Knowledge of Python Spark is preferable
- Knowledge of client and payments data is preferable
Desired Skills
Cloud Azure
Desired Candidate Profile
Qualifications : BACHELOR OF TECHNOLOGY