Job Summary:
We are seeking a skilled Data Engineer with strong experience in Azure Data Services, Databricks, Snowflake, and Microsoft Fabric to design, build, and maintain scalable data pipelines and cloud-based analytics solutions. The ideal candidate will have a deep understanding of data engineering best practices, cloud architecture, and modern data platform tools.
Key Responsibilities:
- Design, develop, and manage data pipelines for large-scale data processing and analytics.
- Implement ETL/ELT workflows using Azure Data Factory or Microsoft Fabric Data Pipelines.
- Build and optimize data models and data lakes/warehouses on Snowflake and Azure Data Lake.
- Develop scalable data transformation solutions using Databricks (PySpark, SQL, Delta Lake).
- Collaborate with data scientists, analysts, and BI teams to enable advanced analytics and reporting.
- Ensure data quality, integrity, and security across all data sources and pipelines.
- Monitor and optimize performance of data pipelines and storage solutions.
- Leverage Microsoft Fabric capabilities for unified data analytics, governance, and visualization.
- Follow best practices for CI/CD, version control, and infrastructure-as-code for data engineering projects.
Required Skills and Experience:
- 6+ years of experience in data engineering or related roles.
- Strong hands-on experience with Azure Data Services (ADF, ADLS, Synapse, Azure SQL, etc.).
- Expertise in Databricks (PySpark, Delta Lake, job orchestration, notebooks).
- Practical knowledge of Snowflake architecture, data sharing, and performance tuning.
- Exposure to Microsoft Fabric components (Data Factory, Lakehouse, Power BI integration).
- Proficiency in SQL and Python for data manipulation and transformation.
- Experience with CI/CD, Git, and DevOps practices for data solutions.
- Understanding of data governance, cataloging, and security within Azure environment.
- Strong problem-solving and communication skills.
Job Types: Full-time, Permanent
Pay: ₹606,313.98 - ₹2,008,807.37 per year
Benefits:
- Health insurance
- Provident Fund
Work Location: In person