Sr. Data Engineer

Job Title: Sr. Data Engineer

Job Location: Pune(Onsite)

Job Type: Full-time

Job Description:

Maintain & develop data platforms based on Microsoft Fabric for Business Intelligence &Databricks for real-time data analytics

• Design, implement and maintain standardized production-grade data pipelines using modern data transformation processes and workflows for SAP, MS Dynamics, on-premise or cloud.

• Develop an enterprise-scale cloud-based Data Lake for business intelligence solutions.

• Translate business and customer needs into data collection, preparation and processing requirements.

• Optimize the performance of algorithms developed by Data Scientists

• General administration and monitoring of the data platforms

Competencies:

• working with structured & unstructured data• experienced in various database technologies (RDBMS, OLAP, Timeseries, etc.)

• solid programming skills (Python, SQL, Scala is a plus)

• experience in Microsoft Fabric (incl. Warehouse, Lakehouse, Data Factory, DataFlow Gen2,Semantic Model) and/or Databricks (Spark)

• proficient in PowerBI

• experienced working with APIs• proficient in security best practices

• data centered Azure know-how is a plus (Storage, Networking, Security, Billing)

Education / experience / language:

• Bachelor or Master degree in business informatics, computer science, or equal

• A background in software engineering (e.g., agile programming, project organization) and experience with human centered design would be desirable

• Extensive experience in handling large data sets

• Experience working at least 5 years as a data engineer, preferably in an industrial company

• Analytical problem-solving skills and the ability to assimilate complex information

• Programming experience in modern data-oriented languages (SQL, Python)

• Experience with Apache Spark and DevOps

• Proven ability to synthesize complex data advanced technical skills related to data modelling, data mining, database design and performance tuning

Special requirements:

• High quality mindset paired with strong customer orientation, critical thinking, and attention to detail

• Understanding of data processing at scale• Influence without authority

• Willingness to acquire additional system/technical knowledge as needed

• Problem solver

• Experience to work in an international organization and in multi-cultural teams

• Proactive, creative and innovative

Job Type: Full-time

Work Location: In person