Senior Consultant

Job Description & Summary: We are looking for a skilled Azure Cloud Data Engineer with strong expertise in Python programming , Databricks , and advanced SQL to join our team in Noida . The candidate will be responsible for designing, developing, and optimizing scalable data solutions on the Azure cloud platform. You will play a critical role in building data pipelines and transforming complex data into actionable insights by leveraging cloud-native tools and technologies.

Level: Senior Consultant / Manager

Location: Noida

LOS:

Competency: Data & Analytics

Skill: Azure Data Engineering

Job Position Title:

Azure Cloud Data Engineer with Python Programming – Senior Consultant/Manager (6+ Years)

Responsibilities:

• Design, develop, and manage scalable and secure data pipelines using Azure Databricks and Azure Data Factory.
• Write clean, efficient, and reusable code primarily in Python for cloud automation, data processing, and orchestration.
• Architect and implement cloud-based data solutions, integrating structured and unstructured data sources.
• Build and optimize ETL workflows and ensure seamless data integration across platforms.
• Develop data models using normalization and denormalization techniques to support OLTP and OLAP systems.
• Manage Azure-based storage solutions including Azure Data Lake and Blob Storage.
• Troubleshoot performance bottlenecks in data flows and ETL processes.
• Integrate advanced analytics and support BI use cases within the Azure ecosystem.
• Lead code reviews and ensure adherence to version control practices (e.g., Git).
• Contribute to the design and deployment of enterprise-level data warehousing solutions.
• Stay current with Azure cloud technologies and Python ecosystem updates to adopt best practices and emerging tools.

Mandatory skill sets:

• Strong Python programming skills (Must-Have) – advanced scripting, automation, and cloud SDK experience
• Strong SQL skills (Must-Have)
• Azure Databricks (Must-Have)
• Azure Data Factory
• Azure Blob Storage / Azure Data Lake Storage
• Apache Spark (hands-on experience)
• Data modeling (Normalization & Denormalization)
• Data warehousing and BI tools integration
• Git (Version Control)
• Building scalable ETL pipelines

Preferred skill sets (Good to Have):

• Understanding of OLTP and OLAP environments
• Experience with Kafka and Hadoop
• Azure Synapse Analytics
• Azure DevOps for CI/CD integration
• Agile delivery methodologies

Years of experience required:

• 6+ years of overall experience in cloud engineering or data engineering roles, with at least 2-3 years of hands-on experience with Azure cloud services.
• Proven track record of strong Python development with at least 2-3 years of hands-on experience.

Education qualification:

BE/B.Tech/MBA/MCA