Senior Data Engineer

Job Title: Senior Data Engineer

Location: Remote

Experience: 4–5 Years

Role Overview

We are looking for a Senior Data Engineer with strong hands-on expertise in building and optimizing data pipelines on the Azure cloud ecosystem. The ideal candidate should have solid experience with Azure DataBricks, Azure Data Factory, SQL, and Python to design, develop, and deliver scalable and high-performing data solutions. The role requires strong problem-solving skills, analytical thinking, and the ability to work independently in a fast-paced environment.

Key Responsibilities

Design, build, and maintain scalable ETL pipelines using Azure Data Factory and Azure DataBricks.

Develop efficient SQL queries, stored procedures, and performance-optimized data models.

Implement data workflows to ingest, transform, and load structured and unstructured data.

Work closely with business stakeholders to translate requirements into technical data solutions.

Ensure high performance, data integrity, and accuracy in all deliverables.

Collaborate with cross-functional teams to integrate data from multiple sources.

Monitor, troubleshoot, and optimize data pipelines for reliability and performance.

Follow best practices for CI/CD, error handling, and logging in data workflows.

Required Qualifications & Skills

Bachelor’s degree in Computer Science, Engineering, or a related discipline.

4–5 years of hands-on experience as a Data Engineer.

Strong expertise in:

Azure DataBricks – data transformations, Delta Lake, notebooks, Spark.

Azure Data Factory – pipelines, linked services, datasets, triggers, CI/CD.

SQL – stored procedures, triggers, performance tuning, error handling.

Python – data frames, automation, integration with databases.

Strong analytical and problem-solving skills.

Excellent communication skills to explain technical solutions in a clear, business-friendly way.

Ability to work independently in a remote, fast-paced environment.

Good to Have (Preferred Skills)

Azure Functions – Python-based automation and API integration.

API Development (FAST API) – building and consuming APIs.

Microsoft Fabric – pipelines and OneLake integration.

Exposure to ML/AI – regression, classification, clustering, or time-series models.

Familiarity with Generative AI and OpenAI API integrations.

Why Join Us?

Be part of a high-impact role working on modern Azure-based data engineering projects.

Opportunity to design and implement end-to-end data solutions.

Fully remote working environment with challenging and innovative projects

Job Type: Full-time

Pay: ₹500,652.22 - ₹1,841,823.67 per year

Application Question(s):

• What is your notice period in days?

Experience:

• Azure DataBricks notebook, Spark: 4 years (Required)
• Azure Data Factory pipelines, linked services, CI/CD: 4 years (Required)

Work Location: In person