Azure Data Engineer

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience in handling large datasets, optimizing data workflows, and enabling seamless data availability for analytics, reporting, and AI/ML applications.

Key Responsibilities

• Design, develop, and maintain end-to-end data pipelines for ingestion, transformation, and storage.
• Build and optimize ETL/ELT workflows to ensure high performance and reliability.
• Develop scalable data models, schemas, and architectures for analytics and business intelligence.
• Work with cloud platforms such as AWS, Azure, or GCP, and manage data services (Redshift, BigQuery, Snowflake, etc.).
• Build and maintain data lakes, data warehouses, and distributed processing systems.
• Integrate data from multiple sources (APIs, databases, applications, sensors, third-party platforms).
• Collaborate with data scientists, analysts, and cross-functional teams to understand data needs.
• Implement data quality checks, anomaly detection, validation processes, and monitoring dashboards.
• Optimize data pipelines for performance, scalability, and cost-efficiency.
• Ensure data security, governance, and compliance with organizational and regulatory standards.

Required Skills & Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Systems, Data Engineering, or related field.
• Strong proficiency in Python, SQL, and experience with ETL development.
• Hands-on experience with big data technologies: Hadoop, Spark, Kafka, Airflow, Flink, etc.
• Good understanding of data warehousing concepts, dimensional modeling, and database design.
• Experience with cloud data tools (AWS Glue, EMR, Lambda, S3, Snowflake, Databricks, BigQuery, Azure Data Factory).
• Familiarity with NoSQL databases (MongoDB, Cassandra, DynamoDB) and relational databases (PostgreSQL, MySQL).
• Strong problem-solving skills, debugging capability, and performance optimization knowledge.
• Experience with version control (Git) and CI/CD workflows.

Job Type: Full-time

Pay: ₹90,000.00 - ₹1,300,000.00 per month

Benefits:

• Provident Fund

Work Location: In person