Data Engineer

Position Summary

We are seeking a skilled Data Engineer with strong expertise in building and managing ETL/ELT pipelines using PySpark within an AWS cloud environment. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data workflows to support multiple data sources, while ensuring seamless integration with Power BI for reconciliation, reporting, and advanced analytics.

Key Responsibilities

· Data Pipeline Development

o Design, develop, and maintain scalable ETL/ELT pipelines using PySpark.

o Implement data ingestion from multiple data sources (Finance, CRM, Payment Gateways, etc.) into AWS Data Lake/Warehouse.

o Ensure efficient data partitioning, schema management, and optimization for large datasets.

· Cloud & Infrastructure (AWS)

o Leverage AWS services (S3, Glue, EMR, Redshift, Lambda, Step Functions) for data engineering workflows.

o Implement data security, access control, and compliance in line with organizational standards.

o Automate deployments using CI/CD pipelines.

· Data Integration & Reporting

o Prepare curated datasets for Power BI dashboards and reports.

o Enable reconciliation processes by providing granular, auditable datasets.

o Collaborate with BI developers to ensure data accuracy, integrity, and performance in reporting.

· Collaboration & Process

o Work closely with Business Analysts, Data Scientists, and ERP functional teams to understand requirements.

o Participate in data governance initiatives, ensuring metadata, lineage, and quality controls are implemented.

o Provide support for ad-hoc analytics requests from stakeholders.

Required Skills & Qualifications

· Technical Skills

o Strong programming in Python with deep knowledge of PySpark.

o Proven experience in ETL/ELT pipeline development in distributed environments.

o Expertise in AWS data services (S3, Glue, EMR, Redshift, Athena, Lambda, Kinesis).

o Proficiency in SQL (analytical queries, optimization, tuning).

o Familiarity with Power BI integration (Direct Query, Dataflows, Gateways).

· Data Engineering Practices

o Experience with data lakes, warehouses, and star/snowflake schema design.

o Knowledge of data quality frameworks, reconciliation processes, and auditability controls.

o Hands-on experience with workflow orchestration tools.

· Soft Skills

o Strong problem-solving and analytical skills.

o Ability to collaborate across IT, business, and analytics teams.

o Clear communication for technical and non-technical stakeholders.

Preferred Qualifications

· Experience with ERP data models (Finance, CRM - Reconciliation).

· Exposure to machine learning data preparation (feature engineering, training/test datasets).

· Certification(s):

o AWS Certified Data Analytics – Specialty

o Databricks/Spark Developer Certification

o Microsoft Power BI Data Analyst Associate

Job Type: Full-time

Ability to commute/relocate:

• Ajman: Reliably commute or planning to relocate before starting work (Preferred)

Application Question(s):

• Availability to start immediately
• Visa Status

Experience:

• Data Engineer: 3 years (Preferred)

Language:

• English (Preferred)