Senior Data Engineer

Reports To:

Director of Data Engineering

Summary

We are in search of a talented and passionate Data Engineer to enhance our data engineering capabilities at Property Finder in Dubai. In this role, you will driving the development and maintenance of sophisticated data solutions, building data pipelines in batch and real time. Beyond that, you will contribute in building and maintaining the infrastructure necessary for data engineering processes.

Collaborating with cross-functional teams, you will contribute to building self-service data layers and provide crucial insights to align data architecture with broader business strategies. Your contribution towards innovative solutions and ensuring the highest standards of data quality.

Key Responsibilities:

• Design and implement real time data pipelines in Cloud.
• Design and implement complex ETL solutions for large datasets.
• Optimise and fine-tune SQL and/or Python code for performance.
• Design and maintain data models for efficient storage and retrieval.
• Troubleshoot and resolve issues related to data pipeline performance.
• Build and maintain self-service datasets to accelerate data democratization efforts.
• Contribute to the initiatives for managing and optimizing infrastructure.
• Implement best practices for version control and collaboration in Terraform.

Our Tech Stack:

Languages: Java/Scala, SQL & Python

Message Queues: Kafka, Kinesis Data Streams

Data stores: Snowflake, Redshift, Clickhouse, S3

Pipeline orchestration tool: Dagster (Legacy: Airflow)

Platforms & Services: Docker, Kubernetes

PaaS: AWS (ECS/EKS, DMS, Kinesis, Glue, Athena, S3 and others.)

ETL: FiveTran & DBT for transformation

IaC: Terraform (with Terragrunt)