Job Purpose

We are seeking a versatile and experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and machine learning, with the ability to design, build, and maintain data pipelines, as well as develop and deploy machine learning models. This role requires a deep understanding of data lakehouses, such as Databricks and Azure Fabric, and the ability to work collaboratively with cross-functional teams to deliver data-driven solutions.

Key Activities, Responsibility & Accountability

Key Responsibilities:
Data Engineering:

• Design, build, and maintain scalable data pipelines and ETL processes.
• Work with large datasets and data lakehouses, including Databricks and Azure Fabric.
• Ensure data quality, integrity, and security across all data pipelines.
• Optimize data storage and retrieval processes for performance and efficiency.

Machine Learning Engineering:

• Develop, implement, and optimize machine learning models and algorithms.
• Perform data analysis and model tuning to improve accuracy and performance.
• Deploy machine learning models into production environments.
• Monitor and maintain the performance of deployed models.

Collaboration:

• Collaborate with cross-functional teams to understand business requirements and deliver data-driven solutions.
• Work closely with data scientists, analysts, and other stakeholders to ensure seamless integration of data and models.

Continuous Learning:

• Stay up-to-date with the latest advancements in data engineering and machine learning.
• Participate in training and development opportunities to enhance skills and knowledge.

Responsibilities & Accountabilities (contd.)

Professional Certifications

Qualifications

Bachelor's or Master's degree in Data Science, Computer Science, Engineering, or a related field.

Experience