Data Engineer

About

This opportunity is for a leading Energy & Gas giant in the UAE. We are looking for Data Engineers to build the pipelines that power our analytics. You will be responsible for the extraction, transformation, and loading (ETL) of data, creating the reliable infrastructure needed for data science and business intelligence.

Responsibilities

• Design, build, and maintain robust ETL/ELT pipelines to move data from various sources to centralized data warehouses/lakes.
• Optimize data ingestion processes for performance, scalability, and reliability.
• Develop complex SQL queries and scripts (Python/Scala) to transform raw data into usable formats.
• Collaborate with Data Architects to implement data models and schemas effectively.
• Monitor and troubleshoot data pipeline failures, ensuring high data availability for users.
• Implement data partitioning and indexing strategies to optimize query performance.
• Ensure data security and compliance during data transfer and storage.

Requirements

• 2–8 years of experience
• Strong programming skills in Python, Scala, or Java.
• Expert-level proficiency in SQL and experience with ETL tools (e.g., Azure Data Factory, Informatica, Talend).
• Experience with big data technologies (Spark, Hadoop, Databricks).
• Understanding of cloud data platforms (Azure Synapse, Snowflake).

Bonus

• Azure Data Engineer Associate certification.
• Experience with streaming data (Kafka, Event Hubs).
• Knowledge of CI/CD for data pipelines.

Job Type: Full-time

Pay: AED12,000.00 - AED18,000.00 per month