Azure Data Engineeer

Job Description: Azure Data Engineer (PySpark)

Position Overview:

We are seeking a highly skilled Azure Data Engineer with 5 years of professional experience in designing, building, and optimizing data pipelines. The ideal candidate will have strong expertise in PySpark, Azure Data Services, and modern data engineering practices to support scalable analytics and business intelligence solutions.

Key Responsibilities:

• Design, develop, and maintain data pipelines using PySpark and Azure Data Factory.
• Implement ETL/ELT processes for structured and unstructured data across multiple sources.
• Optimize big data workflows for performance, scalability, and cost efficiency.
• Collaborate with data scientists, analysts, and business stakeholders to deliver clean, reliable datasets.
• Manage and monitor Azure cloud resources including Azure Data Lake, Synapse Analytics, Databricks, and Blob Storage.
• Ensure data quality, governance, and security compliance across all solutions.
• Troubleshoot and resolve issues in data pipelines and provide production support.
• Document technical designs, workflows, and best practices for knowledge sharing.

Required Skills & Experience

• 5 years of experience in data engineering with a focus on PySpark.
• Strong knowledge of Azure ecosystem:
• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Data Lake Storage
• Proficiency in Python (PySpark) for big data processing.
• Solid understanding of SQL and data modeling concepts.
• Experience with CI/CD pipelines and version control (Git).
• Knowledge of data governance, security, and compliance frameworks.
• Strong problem-solving and analytical skills.

Preferred Qualifications

• Exposure to machine learning pipelines or data science workflows.
• Experience with Power BI or other visualization tools.
• Familiarity with DevOps practices in Azure.
• Knowledge of streaming technologies (Kafka, Event Hub).

Job Type: Contractual / Temporary
Contract length: 36 months

Benefits:

• Health insurance
• Provident Fund

Work Location: In person