data scientist

automation engineer

data analyst

ai/ml engineer

cloudera data engineer

data engineer

ZAPTA Technologies (Pvt.) Limited

We are looking for a skilled Data Engineer with a strong analytical mindset and hands-on experience in managing and optimizing data systems. The ideal candidate should be well-versed in data analysis, operations, and automation, with a keen eye for identifying data trends and ensuring seamless data flow across platforms.Key Responsibilities:<ul><li>Design, build, and maintain scalable data pipelines and architectures.</li><li>Perform data analysis to support decision-making and business insights.</li><li>Manage and monitor data operations, ensuring data integrity, quality, and availability.</li><li>Perform data scraping from various sources (APIs, web, and databases) to collect and process large datasets.</li><li>Collaborate with cross-functional teams (Data Analysts, Developers, Product Managers) to meet project goals and ensure data-driven solutions.</li><li>Identify, analyze, and interpret data trends or patterns to drive business strategy.</li><li>Manage data lakes and implement effective data management (data magnet) strategies for efficient storage and retrieval.</li><li>Optimize ETL processes and support automation of data workflows.</li></ul>Required Skills &amp; Qualifications:<ul><li>Bachelor&rsquo;s degree in Computer Science, Data Engineering, Information Technology, or a related field.</li><li>2+ years of professional experience as a Data Engineer or in a similar data-focused role.</li><li>Proficiency in SQL, Python, and data manipulation libraries (Pandas, NumPy, etc.).</li><li>Experience with ETL tools and frameworks.</li><li>Knowledge of data lakes, data warehouses, and cloud platforms (AWS, Azure, or GCP).</li><li>Experience with data scraping tools (e.g., BeautifulSoup, Scrapy, or API integrations).</li><li>Strong understanding of data pipelines, operations, and workflow automation.</li><li>Excellent collaboration and communication skills.</li><li>Strong analytical and problem-solving abilities with attention to detail.</li></ul>Job Type: Full-timeWork Location: In person

Data Engineer

Datamatics Global Services Ltd

<div><h2 class="jobSectionHeader">Cloudera Data Engineer</h2>
Location: Remote (UAE Time Zone) 
Experience: 5+ Years 
Availability: Immediate joiners or candidates who can start within 30 days preferred<h3 class="jobSectionHeader">
Role Overview</h3>
We are seeking an experienced Cloudera Data Engineer to design, build, and maintain data pipelines and processing frameworks across Cloudera&rsquo;s ecosystem. The ideal candidate will have strong expertise in Spark, Hive, Impala, NiFi, and Oozie, and proven experience optimizing large-scale data pipelines for performance and reliability.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, build, and maintain ETL/ELT pipelines using Spark, Hive, Impala, NiFi, and Oozie.</li><li>
Optimize data pipelines for performance, reliability, and cost efficiency across batch and streaming workloads.</li><li>
Develop automation scripts and reusable frameworks for data ingestion, transformation, and cleansing.</li><li>
Collaborate with Cloudera Administrators to tune performance and manage cluster resources efficiently.</li><li>
Troubleshoot and resolve data pipeline failures, performance bottlenecks, and data quality issues.</li><li>
Monitor cluster utilization, job performance, and data throughput using Cloudera Manager.</li><li>
Work with DevOps/Infrastructure teams to define and maintain CI/CD pipelines, automation for deployments, and monitoring of data jobs.</li><li>
Participate in incident management, root cause analysis, and preventive maintenance.</li><li>
Ensure pipelines meet SLAs, data quality, and latency requirements for analytics workloads.</li></ul><h3 class="jobSectionHeader">
Requirements</h3><ul><li>
5+ years of experience as a Data Engineer in a Cloudera-based environment.</li><li>
Strong hands-on experience with Spark, Hive, Impala, NiFi, and Oozie.</li><li>
Solid understanding of ETL design, performance optimization, and data governance principles.</li><li>
Experience with Linux/Unix scripting and CI/CD integration.</li><li>
Excellent troubleshooting and communication skills.</li></ul>
IppsLo883Y</div>

Cloudera Data Engineer

Datamatics Technologies

<div>
 
 Cloudera Data Engineer
 
 
 
 Location:
 
 Remote (UAE Time Zone)
 
 
 Experience:
 
 5+ Years
 
 
 Availability:
 
 Immediate joiners or candidates who can start within 30 days preferred
 
 
 Role Overview
 
 
 We are seeking an experienced
 
 Cloudera Data Engineer
 
 to design, build, and maintain data pipelines and processing frameworks across Cloudera&rsquo;s ecosystem. The ideal candidate will have strong expertise in Spark, Hive, Impala, NiFi, and Oozie, and proven experience optimizing large-scale data pipelines for performance and reliability.
 
 
 Key Responsibilities
 
 <ul>
 <li>
 
 Design, build, and maintain
 
 ETL/ELT pipelines
 
 using Spark, Hive, Impala, NiFi, and Oozie.
 
 </li>
 <li>
 
 Optimize data pipelines for
 
 performance, reliability, and cost efficiency
 
 across batch and streaming workloads.
 
 </li>
 <li>
 
 Develop
 
 automation scripts and reusable frameworks
 
 for data ingestion, transformation, and cleansing.
 
 </li>
 <li>
 
 Collaborate with Cloudera Administrators to
 
 tune performance
 
 and manage cluster resources efficiently.
 
 </li>
 <li>
 
 Troubleshoot and resolve
 
 data pipeline failures, performance bottlenecks, and data quality issues
 
 .
 
 </li>
 <li>
 
 Monitor
 
 cluster utilization, job performance, and data throughput
 
 using Cloudera Manager.
 
 </li>
 <li>
 
 Work with DevOps/Infrastructure teams to define and maintain
 
 CI/CD pipelines, automation for deployments
 
 , and monitoring of data jobs.
 
 </li>
 <li>
 
 Participate in
 
 incident management, root cause analysis, and preventive maintenance
 
 .
 
 </li>
 <li>
 
 Ensure pipelines meet
 
 SLAs, data quality, and latency requirements
 
 for analytics workloads.
 
 </li>
 </ul>
 
 Requirements
 
 <ul>
 <li>
 
 5+ years of experience as a
 
 Data Engineer
 
 in a Cloudera-based environment.
 
 </li>
 <li>
 
 Strong hands-on experience with
 
 Spark, Hive, Impala, NiFi, and Oozie
 
 .
 
 </li>
 <li>
 
 Solid understanding of
 
 ETL design, performance optimization
 
 , and
 
 data governance
 
 principles.
 
 </li>
 <li>
 
 Experience with
 
 Linux/Unix scripting
 
 and
 
 CI/CD integration
 
 .
 
 </li>
 <li>
 
 Excellent troubleshooting and communication skills.
 
 </li>
 </ul>
</div>

Algo

<div>Position: Data Engineer (Azure Platform)

Location: Lahore, Pakistan (on-site)<div> 
Job Description 
<ul><li>Design and develop scalable data warehouse solutions to support analytics and reporting.</li><li>Build and maintain efficient Azure Data Pipelines using Azure Data Factory for ETL processes.</li><li>Develop and optimize Spark jobs using Databricks and PySpark for large-scale data transformations.</li><li>Coordinate with onsite and offshore teams to ensure seamless project execution and business continuity.</li><li>Develop and maintain dashboards and reports using BI tools such as Power BI, Tableau, MicroStrategy, or Qlik.</li><li>Manage the presentation and access layers to ensure secure and efficient data access.</li><li>Work directly with clients and stakeholders to understand requirements and deliver actionable data solutions</li></ul></div> 
Qualifications
<ul><li>BS in Computer Science or a related field with 4-5 years of experience in BI and data management projects.</li><li>Strong expertise in database and data warehouse design, support, and maintenance.</li><li>Proficiency in writing complex SQL and SparkSQL queries.</li><li>Experience in Python and its data-related frameworks.</li><li>Hands-on experience with Databricks and PySpark for data engineering tasks.</li><li>Strong proficiency in Power BI; experience with other BI tools is a plus.</li><li>Experience with Azure Data Platform (Data Factory, Azure SQL, Synapse, Data Lake) is preferred.</li><li>Ability to generate and maintain comprehensive technical documentation.</li><li>Excellent communication and interpersonal skills.</li><li>Strong analytical and problem-solving abilities.</li><li>Willingness to learn and adapt to new technologies and project requirements.</li><li>Experience in data analysis is a plus.</li><li>Ability to work independently and handle critical situations confidently.</li><li>A collaborative, team-oriented mindset.</li></ul></div>

Data Engineer (Azure Platform)

NorthBay Solutions

<div><h3 class="jobSectionHeader">Position: Senior Data Engineer (Migration / NoSQL / SQL)</h3>
Location: Lahore / Islamabad / Karachi (Hybrid) 
Experience: Up to 3 Years of Relevant Experience 
Salary: Up to PKR 350,000 
Company: NorthBay Solutions 
 
About the Role:
NorthBay is looking for a Senior Data Engineer with a strong passion for database management, data engineering, and migration projects. The ideal candidate will have a solid understanding of database systems, data migration frameworks, and AWS cloud data services. This role involves working on complex migration projects across PostgreSQL, MongoDB, DocumentDB, MySQL, and Oracle databases using AWS Database Migration Services (AWS DMS) and other modern data tools. 
 
Key Responsibilities:<ul><li>
Support and execute database migration initiatives across multiple database platforms and AWS environments.</li><li>
Collaborate with technical leads to ensure successful, secure, and validated database migrations.</li><li>
Develop and maintain data validation plans, migration scripts, and testing frameworks.</li><li>
Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration.</li><li>
Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability.</li><li>
Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies.</li><li>
Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices</li></ul>
Requirements:<ul><li>
Up to 3 years of relevant experience in database deployment, management, or migration.</li><li>
Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle.</li><li>
Experience using AWS Database Migration Services (AWS DMS) for data migration projects.</li><li>
Knowledge of NoSQL databases and DocumentDB is a plus.</li><li>
Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration.</li><li>
Familiarity with backup/recovery, replication, and clustering concepts.</li><li>
Strong analytical, problem-solving, and communication skills.</li></ul><h3 class="jobSectionHeader">
What We Offer:</h3><ul><li>
Competitive salary (up to PKR 350K)</li><li>
Fuel expense reimbursement</li><li>
Paid holidays and vacation</li><li>
Medical outpatient reimbursement &amp; health insurance</li><li>
Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects</li></ul>
Ay5S00UEcZ</div>

Senior Data Engineer (Migration / NoSQL / SQL)

MonetizeMore

<div><h3 class="jobSectionHeader">About MonetizeMore</h3>
MonetizeMore is a global leader in ad tech, helping publishers maximize their ad revenue through advanced optimization, data, and automation. Our fully remote team is distributed across the world, driven by innovation, autonomy, and measurable impact.<h3 class="jobSectionHeader">
Role Overview</h3>
We are looking for a Data Infrastructure Engineer to design, build, and maintain scalable data systems that support analytics, machine learning, and business intelligence at MonetizeMore. You will collaborate closely with data engineers, analysts, and product teams to ensure our data pipelines are reliable, efficient, and secure.
In addition to core data infrastructure responsibilities, you will occasionally work on Airflow DAGs and orchestration tasks, supporting our data workflow automation initiatives.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, implement, and maintain scalable, high-performance data infrastructure.</li><li>
Manage the data pipelines using Apache Airflow for orchestration and scheduling.</li><li>
Develop and deploy data services and tools using Kubernetes and containerized environments.</li><li>
Leverage AWS services (e.g., S3, Lambda, Athena, ECS/EKS, Glue) for data storage, processing, and orchestration.</li><li>
Ensure reliability, performance, and cost efficiency of data systems.</li><li>
Collaborate with cross-functional teams to support data-driven initiatives and ad tech systems.</li><li>
Implement monitoring, logging, and alerting for all critical data infrastructure components.</li><li>
Champion best practices in data security, governance, and DevOps for data workflows.</li></ul><h3 class="jobSectionHeader">
Qualifications</h3>
Required:<ul><li>
1-2 years of experience in data infrastructure roles.</li><li>
Strong proficiency with Python and SQL.</li><li>
Solid understanding of AWS data and compute services (S3, Athena, ECS/EKS, etc.).</li><li>
Experience in CI/CD, infrastructure-as-code (Terraform, CloudFormation, or similar).</li><li>
Experience with containerization (Docker).</li><li>
Strong problem-solving and debugging skills.</li><li>
Experience with transactional database maintenance. Preferred: Postgres</li></ul>
Preferred:<ul><li>
Knowledge of data warehousing tools like Athena, or BigQuery.</li><li>
Experience managing workflows with Apache Airflow.</li><li>
Hands-on experience deploying and maintaining workloads on Kubernetes.</li><li>
Familiarity with real-time data streaming (Kafka, Kinesis, etc.).</li><li>
Exposure to monitoring and observability tools (Prometheus, Grafana, ELK Stack).</li></ul><h3 class="jobSectionHeader">
Why MonetizeMore</h3><ul><li>
100% remote, flexible work environment.</li><li>
Work with cutting-edge ad tech and data systems.</li><li>
Collaborative, globally distributed team.</li><li>
Opportunities for growth and ownership.</li></ul>
dpdiW5IUw3</div>

Data Infrastructure Engineer

Mind Stream

Location: Doha, QatarProven experience with Azure DevOps and implementing CI/CD pipelines.<ul><li>Strong knowledge of Azure data services, specifically Azure Databricks and Azure Data Factory.</li><li>Proficiency in Databricks Asset Bundle for Databricks Ci/CD.</li><li>Experience with scripting and automation tools (e.g., PowerShell, Python).</li><li>Experience in implementing selective deployment for ADF data pipelines.</li><li>Understanding of containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus.</li><li>Excellent problem-solving skills and ability to troubleshoot complex CI/CD issues.</li><li>Strong communication skills and ability to collaborate effectively with cross-functional teams.</li><li>Knowledge of security best practices for CI/CD pipelines and Azure environments.</li><li>Detail-oriented with a focus on delivering high-quality, reliable automation solutions.</li><li>Bachelor's degree in Computer Science, Information Technology, or related field.</li><li>Minimum of 5 years of experience in DevOps or related roles.</li></ul>Job Type: Full-timeWork Location: In person

Azure DevOps (Data) Engineer

Explore 952+ Data engineer in Lahore this November. Find roles across top companies and apply now to boost your career.

952 data engineer jobs IN Lahore

Data Engineer

Cloudera Data Engineer

Cloudera Data Engineer

Data Engineer (Azure Platform)

Senior Data Engineer (Migration / NoSQL / SQL)

Data Infrastructure Engineer

Azure DevOps (Data) Engineer