Azure Data Engineer

Must-Have

PySpark, SQL, Azure Services (ADF, Databricks, Synapse)

Good-to-Have

Python, Azure Key Vault

Responsibility of / Expectations from the Role

1

Aware of end to end data ingestion process

2

Build and maintain secure and compliant data processing pipelines by using different tools and techniques

3

Handle complex data structure such as Semi structure data (json, xml) that meet business requirements.

4

Have knowledge on deployment framework such as CI/CD, github check in process

5

Able to perform data analytics, data analysis and data profiling

6