Sr. Data Engineer

Sr Data Engineer

Location: India

Experience: 10+ Years

Department: Architecture Team, Data Insights & Analytics

Role Summary

We are seeking an accomplished Data Engineer to join our dynamic Architecture Team within the Data Insights & Analytics group. The ideal candidate will bring 7+ years of experience in architecting, developing, and managing robust, scalable data solutions for large-scale enterprises.

You will design and implementation of next-generation data architectures & AI ready Data Products and deliver enterprise insights. Deep expertise in the Databricks Lakehouse platform & AWS Cloud Services, with preferable Experience/Knowledge in SAP data processing .

Key Responsibilities

• Architect, design, and build scalable data architectures, pipelines, and data products (Databricks, AWS).
• Design and develop enterprise data models; manage the full data life cycle.
• Extract, transform, and integrate data from SAP ECC/S4HANA and other non-SAP environments.
• Build solutions for real-time, streaming, and batch data workloads.
• Define and implement data security, governance, and compliance standards.
• Adapt and implement data quality and observability practices.
• Perform performance tuning and cost optimization.
• Support Operations teams in day-to-day business needs.
• Collaborate with business and technical teams to understand requirements and deliver scalable data architecture solutions.

Required Skills & Qualifications

• Experience:
• Minimum 10+ years in data architecture/data engineering roles.
• Proven success in large-scale data environments.
• Technical Proficiency:
• Databricks Lakehouse platform:
• Delta Lake & Medallion Architecture
• DLT Pipelines
• PySpark Workbooks
• Spark SQL & SQL Warehouse
• Unity Catalog (data governance, lineage)
• Genie (query performance, indexing)
• Security & Role-Based Access Control
• Bonus: MLflow knowledge
• Data Modeling:
• ER & Dimensional modeling
• Metadata management
• Programming:
• Python, SQL, PySpark
• AWS Cloud Services:
• S3, Lambda, EMR, Redshift, Bedrock
• Familiarity with DevOps, CI/CD Process.

Preferred/Optional Skills

• SAP ERP & S/4HANA data extraction (DataSphere, BDC)
• SLT, SAP ABAP, CDS views knowledge
• Manufacturing domain experience
• SAP data domain expertise

Education

• Master’s Degree in Computer Science, Information Systems or a related field is required.

Certifications (Preferred/Nice to Have)

• Databricks Certified Data Engineer / Architect

Job Type: Full-time

Pay: ₹501,672.41 - ₹1,845,896.21 per year

Work Location: Remote