Senior Data Engineer

We are seeking a Senior Data Engineer to join an on-site engineering team in Bangalore. This role is ideal for hands-on engineers who design, build, and operate scalable, production-grade data pipelines and analytical platforms that serve machine learning, BI, and real-time streaming use cases.

### Role & Responsibilities

- Lead data migration efforts from diverse ERP systems into Microsoft Fabric, leveraging Lakehouse / OneLake architecture to support fabric-based reporting.

- Design, build, and maintain robust data pipelines and ETL/ELT workflows using Fabric tools such as Dataflows Gen2, Pipelines (formerly ADF), notebooks, and Delta Lake.

- Implement data modeling and transformation using PySpark, Spark SQL, T-SQL, and Power Query (M), feeding structured datasets into semantic models and Power BI.

- Optimize Power BI datasets and performance, utilizing DAX, semantic modelling, and Direct Lake connectivity to minimize resource utilization and enhance report performance

- Establish and enforce data governance and security protocols, including role-based access, data lineage, and integration with tools like Microsoft Purview

- Collaborate with business teams to translate reporting requirements into technical specifications, oversee data validation, and support testing phases.

- Create technical documentation, data mappings, migration guides, and deliver training to stakeholders and internal users.

- Mentor and coach team members, enabling knowledge sharing on Microsoft Fabric tools, migration patterns, and performance optimization techniques.

*Preferred Experience & Qualifications*

- Proven experience as a Data Lead or similar role using Microsoft Fabric components: Lakehouse / OneLake, Synapse Data Engineering (Spark), Fabric data pipelines, and Power BI

- Strong command of SQL / TSQL, PySpark, Python, or Power Query (M) for transformation tasks.

- Expertise with data warehouse modeling (star/snowflake schemas) and modern architecture patterns (e.g. medallion layers — Bronze/Silver/Gold)

- In-depth proficiency in Power BI, including Custom visuals, DAX optimization and dataset tuning for high-volume reporting.

- Familiarity with DevOps for data, including CI/CD pipelines using Azure DevOps or GitHub Actions for Fabric artifacts and deployments.

- Practical experience with ERP to Analytics migration, ideally involving tools like ADF, Synapse, or Fabric migration assistant components

- Excellent stakeholder collaboration, documentation, and mentoring abilities.

<span>*Mandatory Skills :* </span>Microsoft Fabric, Lakehouse, OneLake, Dataflows Gen2 Pipelines (formerly ADF) Delta Lake PySpark Spark SQL T-SQL Power Query (M) Power BI DAX, Semantic modelling Direct Lake Microsoft Purview, SQL, TSQL, Python

Job Type: Full-time

Pay: ₹1,700,000.00 - ₹1,900,000.00 per year

Work Location: In person

Speak with the employer
+91 9008078505