Senior Data Engineer – PySpark, Python

Location: Dubai

Experience: 8+ Years

Work Mode: Hybrid (3 Days Onsite)

Role Overview

We are seeking a highly experienced Senior Data Engineer with expertise in PySpark, Python, Hadoop, and large-scale data engineering pipelines .

The role involves building secure and scalable data platforms, enabling advanced analytics, and supporting machine learning workflows.

Key Responsibilities

• Acquire business requirements and perform exploratory data analysis (EDA).
• Build scalable and high-performance data pipelines using Python, Spark, and Hadoop.
• Perform feature engineering and support machine learning data workflows.
• Collaborate with Data Scientists, Analytics teams, and stakeholders in Agile environments.
• Optimize distributed data processing and ensure data quality and governance.
  
  

Required Skills

• Strong expertise in Python, PySpark, Spark optimization, Hadoop, and SQL
• Experience in enterprise data engineering and ML pipelines
• Familiarity with Git, Agile methodologies, and cloud-native data environments
• Strong analytical and communication skills
  
  

📩 Apply Now: careers@d4insight.com