Data Engineer

We are looking for an experienced Data Engineer with strong expertise in Microsoft Azure data services, Azure Data Factory (ADF), and Python.

Key Responsibilities:

• Design, develop, and maintain data pipelines and ETL workflows using Azure Data Factory (ADF).
• Integrate and transform data from various structured and unstructured data sources into Azure data stores.
• Work extensively with Azure Data Lake, Azure Synapse Analytics, and Azure SQL Database.
• Develop and optimize Python-based data processing scripts for ingestion, transformation, and validation.
• Implement data quality checks, data validation, and error handling mechanisms.
• Collaborate with data architects, analysts, and business stakeholders to understand data requirements.
• Monitor and troubleshoot data workflows and ensure high availability and reliability.
• Optimize data pipelines for performance, scalability, and cost efficiency in Azure.
• Implement and maintain CI/CD pipelines for data workflows using Azure DevOps or similar tools.

Technical Skills Required:

• Strong experience in Azure Data Factory (ADF) – pipeline design, dataflows, triggers, linked services, and integration runtime.
• Solid understanding of Azure ecosystem – Data Lake Storage, Synapse Analytics, SQL Database, Event Hub, Functions, Logic Apps, etc.
• Proficiency in Python for data processing, transformation, and automation.
• Experience with SQL and performance tuning on large datasets.
• Hands-on experience in data modeling, ETL design, and data warehousing concepts.
• Knowledge of CI/CD, Git, and Azure DevOps pipelines.
• Understanding of data governance, security, and compliance best practices.

Job Type: Contractual / Temporary
Contract length: 6 months

Pay: ₹606,313.98 - ₹1,500,000.00 per year

Work Location: In person