Azure Data Engineer

Position: Azure Data Engineer

Budget: Up to 20 LPA
Notice Period: Immediate to 15days
Location: Remote

Skills and Highlights:

● Azure Data Factory (Must Have)

● Azure Data Bricks (Must Have)

● Azure fabric (Good to have)

● Experience in Data Processing Flow with Gen AI application

● Experience working with Unstructured data (Must Have)

● Worked on production with more than 10000 file injection (Must Have)

● Experience in multi model injection (Must Have)

● OCR capabilities

—---------Detailed JD—----------

Job Description:

We are seeking an experienced Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data Fabric to lead the migration of our existing data pipeline and processing infrastructure. The ideal candidate will have a strong background in Azure cloud data services, big data analytics, and data engineering, with specific experience in Azure Data Fabric. We are looking for someone who has at least 6 months of hands-on experience with Azure Data Fabric or has successfully completed at least one migration to Azure Data Fabric.

Key Responsibilities:

● Assess the current data architecture using Azure Data Factory and Databricks and develop a detailed migration plan to Azure Data Fabric.

● Design and implement end-to-end data pipelines within Azure Data Fabric, including data ingestion, transformation, storage, and analytics.

● Optimize data workflows to leverage Azure Data Fabric's unified platform for data integration, big data processing, and real-time analytics.

● Ensure seamless integration of data from SharePoint and other sources into Azure Data Fabric, maintaining data quality and integrity.

● Collaborate with business analysts and business stakeholders to align data strategies and optimize the data environment for machine learning and AI workloads.

● Implement security best practices, including data governance, access control, and monitoring within Azure Data Fabric.

● Conduct performance tuning and optimization for data storage and processing within Azure Data Fabric to ensure high availability and cost efficiency.

Key Requirements:

● Proven experience (5+ years) in Azure data engineering with a strong focus on Azure Data Factory and Azure Databricks.

● At least 6 months of hands-on experience with Azure Data Fabric or completion of one migration to Azure Data Fabric.

● Hands-on experience in designing, building, and managing data pipelines, data lakes, and data warehouses on Azure.

● Expertise in Spark, SQL, and data transformation techniques within Azure environments.

● Strong understanding of data governance, security, and compliance in cloud environments.

● Experience with migrating data architectures and optimizing workflows on cloud platforms.

● Ability to work collaboratively with cross-functional teams and communicate technical concepts effectively to non-technical stakeholders.

● Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert) are a plus.

Job Types: Full-time, Permanent

Pay: ₹1,500,000.00 - ₹2,000,000.00 per year

Application Question(s):

• Notice period
• Current CTC
• Expected CTC

Experience:

• Data Engineering: 5 years (Preferred)
• Azure Data Factory: 4 years (Required)
• Azure Data Bricks: 4 years (Required)
• Date processing with Gen AI: 2 years (Required)
• Azure Data Fabric: 1 year (Required)

Work Location: Remote