Data Engineer

Data Engineer

Experience: 2-3+ Years

Location: Lahore, Pakistan (Hybrid/Remote)

Type: Full-Time

About the Role

We're looking for a Data Engineer to build and maintain our Semantic Lakehouse architecture. You'll work with Apache Iceberg, AWS Glue, and modern data stack technologies to create scalable ETL pipelines that process data from multiple heterogeneous sources into a unified analytics layer.

What You'll Do

• Design and implement ETL pipelines using AWS Glue and PySpark for data standardization and harmonization
• Build and maintain Apache Iceberg tables with SCD Type 2 dimensions and fact tables
• Develop the semantic mapping layer that transforms source data into bounded entity-centric models
• Implement data quality checks, validation rules, and error handling in processing pipelines
• Optimize query performance using partitioning strategies, compaction, and statistics
• Work with Amazon Athena and Redshift Spectrum for analytical queries
• Collaborate with ML engineers to integrate NER-based schema inference into pipelines
• Ensure multi-tenant data isolation and implement Lake Formation security policies

Requirements

• 2-3+ years of experience in data engineering or related field
• Strong proficiency in Python and SQL
• Experience with Apache Spark/PySpark for large-scale data processing
• Hands-on experience with AWS services (S3, Glue, Athena, Lambda)
• Understanding of data modeling concepts (dimensional modeling, star/snowflake schemas)
• Familiarity with columnar formats (Parquet, ORC) and table formats (Iceberg, Delta Lake, or Hudi)
• Experience with workflow orchestration tools (Step Functions, Airflow, or similar)
• Strong problem-solving skills and attention to data quality

Nice to Have

• Experience with Apache Iceberg specifically
• Knowledge of CDC (Change Data Capture) patterns
• Experience with Databricks
• AWS certifications (Data Analytics, Solutions Architect)

Job Type: Full-time

Pay: Rs300,000.00 - Rs500,000.00 per month

Experience:

• Data Engineering: 2 years (Required)

Work Location: Hybrid remote in Lahore