Assistant Manager - Data Engineering

About the Company: Databrick

Databricks is a unified data and AI platform built on a lakehouse architecture, which combines features of both data warehouses and data lakes.

Designation: Assistant Manager - Data Engineering
Experience: 5 to 7 years
Location: Bengaluru, Karnataka , India (BLR)

Lead Data Engineer with strong technical skills

Role Summary

Data Engineering Lead with experience in designing and managing large-scale data solutions. The role involves leading the development of data ingestion pipelines on Databricks, leveraging the Medallion Architecture (Bronze, Silver, Gold layers) to process marketing data.

The person will also drive process improvements, enforce data security and compliance standards, and foster best practices within the team.

Key Responsibilities

Design, build, and optimize ETL pipelines using Azure Databricks to support marketing analytics and reporting.

Manage data workflows across Bronze, Silver, and Gold layers following the Databricks Medallion Architecture.

Collaborate closely with clients, analysts, data scientists, and business stakeholders to translate business needs into scalable data solutions.

Act as the primary point of contact for clients and business stakeholders, ensuring timely delivery of high-quality solutions.

Lead and mentor the team, establish best practices, and drive process improvements for standard team engagements.

Ensure data governance, security, and compliance are maintained across the platform.

Enable marketing analytics use cases by building pipelines that track customer journeys, campaign effectiveness, and credit allocation to products.

Required Skills

Strong expertise in SQL, PySpark, and Python.

Advanced knowledge of Azure Databricks, including performance tuning and large-scale data pipeline development.

Proven experience in data engineering, ETL pipeline design, and big data processing

Strong communication and stakeholder management skills.

Domain experience in Marketing Data and Analytics is a plus.

Good-to-Have Skills

Knowledge of Generative AI and AI/BI solutions in Databricks.

Experience with Power BI for data visualization and business intelligence reporting.

5 to 7 years in the Data Engineering domain

Data Engineering, ETL pipeline design, and big data processing - (Databricks, SQL, PySpark), Knowledge of Generative AI and AI/BI solutions in Databricks., Databricks, PySpark, SQL

Bengaluru, Karnataka, India