ai engineer

devops engineer

machine learning engineer

automation engineer

software engineer

data pipeline engineer

Datamatics Global Services Ltd

<div><h2 class="jobSectionHeader"><b>Cloudera Data Engineer</b></h2><p><b>
Location:</b> Remote (UAE Time Zone)<br>
<b>Experience:</b> 5+ Years<br>
<b>Availability:</b> Immediate joiners or candidates who can start within 30 days preferred</p><h3 class="jobSectionHeader"><b>
Role Overview</b></h3><p>
We are seeking an experienced <b>Cloudera Data Engineer</b> to design, build, and maintain data pipelines and processing frameworks across Cloudera&rsquo;s ecosystem. The ideal candidate will have strong expertise in Spark, Hive, Impala, NiFi, and Oozie, and proven experience optimizing large-scale data pipelines for performance and reliability.</p><h3 class="jobSectionHeader"><b>
Key Responsibilities</b></h3><ul><li><p>
Design, build, and maintain <b>ETL/ELT pipelines</b> using Spark, Hive, Impala, NiFi, and Oozie.</p></li><li><p>
Optimize data pipelines for <b>performance, reliability, and cost efficiency</b> across batch and streaming workloads.</p></li><li><p>
Develop <b>automation scripts and reusable frameworks</b> for data ingestion, transformation, and cleansing.</p></li><li><p>
Collaborate with Cloudera Administrators to <b>tune performance</b> and manage cluster resources efficiently.</p></li><li><p>
Troubleshoot and resolve <b>data pipeline failures, performance bottlenecks, and data quality issues</b>.</p></li><li><p>
Monitor <b>cluster utilization, job performance, and data throughput</b> using Cloudera Manager.</p></li><li><p>
Work with DevOps/Infrastructure teams to define and maintain <b>CI/CD pipelines, automation for deployments</b>, and monitoring of data jobs.</p></li><li><p>
Participate in <b>incident management, root cause analysis, and preventive maintenance</b>.</p></li><li><p>
Ensure pipelines meet <b>SLAs, data quality, and latency requirements</b> for analytics workloads.</p></li></ul><h3 class="jobSectionHeader"><b>
Requirements</b></h3><ul><li><p>
5+ years of experience as a <b>Data Engineer</b> in a Cloudera-based environment.</p></li><li><p>
Strong hands-on experience with <b>Spark, Hive, Impala, NiFi, and Oozie</b>.</p></li><li><p>
Solid understanding of <b>ETL design, performance optimization</b>, and <b>data governance</b> principles.</p></li><li><p>
Experience with <b>Linux/Unix scripting</b> and <b>CI/CD integration</b>.</p></li><li><p>
Excellent troubleshooting and communication skills.</p></li></ul><p>
</p><p>IppsLo883Y</p></div>

Cloudera Data Engineer

FiveRivers Technologies

<div><div><h3 class="jobSectionHeader"><b>Job Information</b></h3>
<ul><div><p>Date Opened</p>
<div><b>11/10/2025</b><b>
</b></div></div><div><p>Job Type</p>
<div><b>Full time</b><b>
</b></div></div><div><p>Work Experience</p>
<div><b>6-9 years</b><b>
</b></div></div><div><p>Industry</p>
<div><b>IT Services</b><b>
</b></div></div><div><p>City</p>
<div><b>Lahore</b><b>
</b></div></div><div><p>State/Province</p>
<div><b>Punjab</b><b>
</b></div></div><div><p>Country</p>
<div><b>Pakistan</b><b>
</b></div></div><div><p>Zip/Postal Code</p>
<div><b>54000</b><b>
</b></div></div></ul></div><div><h3 class="jobSectionHeader"><b>Job Description</b></h3>
<div><p>As a Senior Backend Engineer, you will lead efforts to advance our analytics platform to the next level. Our data pipeline architecture is built for scalability, flexibility, and performance leveraging the latest technologies from AWS.</p><p><br>
You&rsquo;ll join a small, high-performing team that continuously innovates the data pipeline by integrating cutting-edge tools and architectures. In this role, you will help evolve each component of our analytics process into a scalable, serverless architecture, supporting advanced analytics with enhanced computational power and performance.</p><p><br>
We&rsquo;re looking for someone passionate about pushing technological boundaries, mentoring others, and leading impactful backend projects.</p><div></div><div><b><br>
Key Responsibilities</b></div><ul><li><p><br>
Lead major initiatives and projects within the data pipeline team.</p></li><li><p><br>
Design, develop, and optimize scalable ETL/ELT pipelines.</p></li><li><p><br>
Contribute to architectural decisions and the introduction of new technologies.</p></li><li><p><br>
Mentor and guide less experienced engineers, offering technical support and feedback.</p></li><li><p><br>
Collaborate cross-functionally with teams such as Data Integration, Support, and TAM to ensure smooth pipeline usage and monitoring.</p></li><li><p><br>
Drive efforts to enhance performance, scalability, and reliability of backend systems.</p></li></ul><h3 class="jobSectionHeader"><b><br>
Requirements</b></h3><ul><li><p>
5+ years of experience in backend development.</p></li><li><p><br>
Proven experience developing ETL/ELT pipelines from the ground up.</p></li><li><p><br>
Strong proficiency in Java, Python, and SQL (knowledge of Presto/Trino is a plus).</p></li><li><p><br>
Hands-on experience with AWS services such as S3, Glue, Athena, Lambda, and Step Functions (strong plus).</p></li><li><p><br>
Familiarity with Infrastructure as Code (IaC) tools such as AWS CDK, CloudFormation, or Terraform.</p></li><li><p><br>
Solid understanding of backend architecture, data processing, and performance optimization.</p></li><li><p><br>
Excellent problem-solving, collaboration, and communication skills.</p></li></ul><div><b><br>
Location:</b> Gulberg II, Lahore</div></div></div></div><p></p>

Senior Software Engineer (Python)

<div><div><h3 class="jobSectionHeader"><b>Job Information</b></h3>
<ul><div><p>Date Opened</p>
<div><b>11/10/2025</b><b>
</b></div></div><div><p>Job Type</p>
<div><b>Full time</b><b>
</b></div></div><div><p>Work Experience</p>
<div><b>6-9 years</b><b>
</b></div></div><div><p>Industry</p>
<div><b>IT Services</b><b>
</b></div></div><div><p>City</p>
<div><b>Lahore</b><b>
</b></div></div><div><p>State/Province</p>
<div><b>Punjab</b><b>
</b></div></div><div><p>Country</p>
<div><b>Pakistan</b><b>
</b></div></div><div><p>Zip/Postal Code</p>
<div><b>54000</b><b>
</b></div></div></ul></div><div><h3 class="jobSectionHeader"><b>Job Description</b></h3>
<div><p>As a Senior Backend Engineer, you will lead efforts to advance our analytics platform to the next level. Our data pipeline architecture is built for scalability, flexibility, and performance leveraging the latest technologies from AWS.</p><p><br>
You&rsquo;ll join a small, high-performing team that continuously innovates the data pipeline by integrating cutting-edge tools and architectures. In this role, you will help evolve each component of our analytics process into a scalable, serverless architecture, supporting advanced analytics with enhanced computational power and performance.</p><p><br>
We&rsquo;re looking for someone passionate about pushing technological boundaries, mentoring others, and leading impactful backend projects.</p><div></div><div><b><br>
Key Responsibilities</b></div><ul><li><p><br>
Lead major initiatives and projects within the data pipeline team.</p></li><li><p><br>
Design, develop, and optimize scalable ETL/ELT pipelines.</p></li><li><p><br>
Contribute to architectural decisions and the introduction of new technologies.</p></li><li><p><br>
Mentor and guide less experienced engineers, offering technical support and feedback.</p></li><li><p><br>
Collaborate cross-functionally with teams such as Data Integration, Support, and TAM to ensure smooth pipeline usage and monitoring.</p></li><li><p><br>
Drive efforts to enhance performance, scalability, and reliability of backend systems.</p></li></ul><h3 class="jobSectionHeader"><b><br>
Requirements</b></h3><ul><li><p>
5+ years of experience in backend development.</p></li><li><p><br>
Proven experience developing ETL/ELT pipelines from the ground up.</p></li><li><p><br>
Strong proficiency in Java, Python, and SQL (knowledge of Presto/Trino is a plus).</p></li><li><p><br>
Hands-on experience with AWS services such as S3, Glue, Athena, Lambda, and Step Functions (strong plus).</p></li><li><p><br>
Familiarity with Infrastructure as Code (IaC) tools such as AWS CDK, CloudFormation, or Terraform.</p></li><li><p><br>
Solid understanding of backend architecture, data processing, and performance optimization.</p></li><li><p><br>
Excellent problem-solving, collaboration, and communication skills.</p></li></ul></div></div></div><p></p>

Senior Software Engineer (Python)_01

Algo

<div><p><b>Position:</b> Data Engineer (Azure Platform)</p>
<p><b>
Location:</b> Lahore, Pakistan (on-site)</p><p></p><div><b><br>
Job Description</b><br>
<ul><li>Design and develop scalable data warehouse solutions to support analytics and reporting.</li><li>Build and maintain efficient <b>Azure Data Pipelines </b>using <b>Azure Data Factory</b> for ETL processes.</li><li>Develop and optimize Spark jobs using <b>Databricks</b> and <b>PySpark</b> for large-scale data transformations.</li><li>Coordinate with onsite and offshore teams to ensure seamless project execution and business continuity.</li><li>Develop and maintain dashboards and reports using BI tools such as Power BI, Tableau, MicroStrategy, or Qlik.</li><li>Manage the presentation and access layers to ensure secure and efficient data access.</li><li>Work directly with clients and stakeholders to understand requirements and deliver actionable data solutions</li></ul></div><p></p><p><b><br>
Qualifications</b></p>
<ul><li>BS in Computer Science or a related field with <b>4-5 years of experience</b> in BI and data management projects.</li><li>Strong expertise in <b>database</b> and <b>data warehouse design</b>, support, and maintenance.</li><li>Proficiency in <b>writing complex SQL</b> and <b>SparkSQL queries</b>.</li><li>Experience in <b>Python</b> and its data-related frameworks.</li><li>Hands-on experience with <b>Databricks</b> and <b>PySpark</b> for data engineering tasks.</li><li>Strong proficiency in Power BI; experience with other BI tools is a plus.</li><li>Experience with Azure Data Platform <b>(Data Factory, Azure SQL, Synapse, Data Lake)</b> is preferred.</li><li>Ability to generate and maintain comprehensive technical documentation.</li><li>Excellent communication and interpersonal skills.</li><li>Strong analytical and problem-solving abilities.</li><li>Willingness to learn and adapt to new technologies and project requirements.</li><li>Experience in data analysis is a plus.</li><li>Ability to work independently and handle critical situations confidently.</li><li>A collaborative, team-oriented mindset.</li></ul></div>

Data Engineer (Azure Platform)

MonetizeMore

<div><h3 class="jobSectionHeader"><b>About MonetizeMore</b></h3><p>
MonetizeMore is a global leader in ad tech, helping publishers maximize their ad revenue through advanced optimization, data, and automation. Our fully remote team is distributed across the world, driven by innovation, autonomy, and measurable impact.</p><p></p><h3 class="jobSectionHeader"><b>
Role Overview</b></h3><p>
We are looking for a <b>Data Infrastructure Engineer</b> to design, build, and maintain scalable data systems that support analytics, machine learning, and business intelligence at MonetizeMore. You will collaborate closely with data engineers, analysts, and product teams to ensure our data pipelines are reliable, efficient, and secure.</p><p>
In addition to core data infrastructure responsibilities, you will occasionally work on <b>Airflow DAGs and orchestration tasks</b>, supporting our data workflow automation initiatives.</p><p></p><h3 class="jobSectionHeader"><b>
Key Responsibilities</b></h3><ul><li>
Design, implement, and maintain scalable, high-performance data infrastructure.</li><li>
Manage the data pipelines using <b>Apache Airflow</b> for orchestration and scheduling.</li><li>
Develop and deploy data services and tools using <b>Kubernetes</b> and containerized environments.</li><li>
Leverage <b>AWS services</b> (e.g., S3, Lambda, Athena, ECS/EKS, Glue) for data storage, processing, and orchestration.</li><li>
Ensure reliability, performance, and cost efficiency of data systems.</li><li>
Collaborate with cross-functional teams to support data-driven initiatives and ad tech systems.</li><li>
Implement monitoring, logging, and alerting for all critical data infrastructure components.</li><li>
Champion best practices in data security, governance, and DevOps for data workflows.</li></ul><p></p><h3 class="jobSectionHeader"><b>
Qualifications</b></h3><p><b>
Required:</b></p><ul><li>
1-2 years of experience in data infrastructure roles.</li><li>
Strong proficiency with <b>Python</b> and SQL.</li><li>
Solid understanding of <b>AWS data and compute services</b> (S3, Athena, ECS/EKS, etc.).</li><li>
Experience in CI/CD, infrastructure-as-code (Terraform, CloudFormation, or similar).</li><li>
Experience with containerization (Docker).</li><li>
Strong problem-solving and debugging skills.</li><li>
Experience with transactional database maintenance. Preferred: Postgres</li></ul><p><b>
Preferred:</b></p><ul><li>
Knowledge of data warehousing tools like <b>Athena</b>, or <b>BigQuery</b>.</li><li>
Experience managing workflows with <b>Apache Airflow</b>.</li><li>
Hands-on experience deploying and maintaining workloads on <b>Kubernetes</b>.</li><li>
Familiarity with real-time data streaming (Kafka, Kinesis, etc.).</li><li>
Exposure to monitoring and observability tools (Prometheus, Grafana, ELK Stack).</li></ul><p></p><h3 class="jobSectionHeader"><b>
Why MonetizeMore</b></h3><ul><li>
100% remote, flexible work environment.</li><li>
Work with cutting-edge ad tech and data systems.</li><li>
Collaborative, globally distributed team.</li><li>
Opportunities for growth and ownership.</li></ul><p>
</p><p>dpdiW5IUw3</p></div>

Data Infrastructure Engineer

Scroll Tab

<div><p><b>/&quot;</b><b>Our U.S based Client required Remote Services for this Position/&quot;</b></p><p><br>
</p><p><b>Summary</b></p><br>
<p><br>
We are looking for a highly skilled Senior Databricks Engineer with a strong background in Azure data services to lead the design, development, and optimization of scalable data pipelines and analytics solutions. The ideal candidate will have at least 4 years of hands-on experience in Databricks, with deep expertise in Azure Data Factory (ADF), Delta Lake, and big data processing.</p><p><br>
</p><p><b>Key Responsibilities:</b></p><p><br>
</p><ul><li>Design and implement robust, scalable, and efficient data pipelines using Azure Databricks and ADF.</li>
<li>Develop and manage ETL/ELT processes, data lakes, and Delta Lake architecture.</li>
<li>Collaborate with data scientists, analysts, and business stakeholders to deliver high-impact AI/ML-driven data products.</li>
<li>Optimize Spark jobs and ensure performance tuning of large-scale data transformations.</li>
<li>Drive best practices in data quality, governance, and security across Azure cloud-based solutions.</li>
<li>Participate in code reviews, solution architecture design, and technical mentoring of junior engineers.</li>
<li>Monitor and manage job performance and orchestration using ADF, Databricks Workflows, or other schedulers.</li>
<li>Ensure adherence to compliance, privacy, and security policies within data solutions</li><br>
</ul><p></p><p><b>Qualification:</b></p>
<p>Bachelors Degree in Computer Sciences or Software Engineering</p>
<p>Sound Knowledge of Database Management ,SQL and Azure</p></div>

Senior Databricks Engineer

Devsinc

<div>
 Devsinc is seeking a talented
 <strong>
  Associate Data Engineer
 </strong>
 to join our growing data team. In this role, you will design and build scalable data pipelines, work with modern cloud platforms, and lay the foundation for analytics that drive critical business decisions. From day one, you'll learn from senior engineers, work with a modern cloud stack, and see your contributions make a tangible impact.
 <br/>
 <br/>
 <strong>
  Responsibilities:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Design, develop, and maintain automated ELT pipelines for structured and unstructured data.
  </li>
  <li>
   Work with cloud platforms (AWS, GCP, or Azure) to build scalable, secure, and cost-effective data solutions.
  </li>
  <li>
   Model and transform data to support analytics and reporting needs.
  </li>
  <li>
   Implement automated testing, monitoring, and alerting to ensure high-quality, reliable data.
  </li>
  <li>
   Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  </li>
  <li>
   Use version control and CI/CD practices to streamline development and deployment.
  </li>
  <li>
   Stay up to date with modern data tools, frameworks, and best practices
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Requirements
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Bachelor's degree in Computer Science, Engineering, or a related field
  </li>
  <li>
   6 months to 1 year of relevant experience (freelancing, or full-time)
  </li>
  <li>
   Strong knowledge of Python and SQL for data processing and transformation.
  </li>
  <li>
   Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP) and exposure to data services such as Glue, BigQuery, Data Factory, or Redshift.
  </li>
  <li>
   Familiarity with data warehouses (Snowflake, Redshift, BigQuery, or Synapse).
  </li>
  <li>
   Basic understanding of ETL/ELT frameworks (dbt, Spark, Databricks).
  </li>
  <li>
   Knowledge of orchestration tools (Airflow, Azure Data Factory Pipelines, or AWS Glue Workflows).
  </li>
  <li>
   Proficiency in version control systems (GitHub, GitLab, or Bitbucket) and CI/CD pipelines
  </li>
  <li>
   Personal or academic projects on GitHub using modern data engineering stacks.
  </li>
  <li>
   Understanding of DevOps practices and containerization technologies
  </li>
  <li>
   Collaborative - open to knowledge-sharing and teamwork.
  </li>
  <li>
   Team Player - willing to support peers and contribute to collective success.
  </li>
  <li>
   Growth Minded - eager to learn, improve, and adapt to emerging technologies.
  </li>
  <li>
   Adaptable - flexible in dynamic, fast-paced environments.
  </li>
  <li>
   Customer-Centric - focused on delivering solutions that create real business value
  </li>
 </ul>
</div>


Associate Software Engineer - Data Engineer

Explore 1130+ Data pipeline engineer in Lahore this November. Find roles across top companies and apply now to boost your career.