data scientist

data analyst

cloudera data engineer

machine learning engineer

senior - data scientist

big data engineer

Scroll Tab

<div>/&quot;Our U.S based Client required Remote Services for this Position/&quot; 
Summary 
 
We are looking for a highly skilled Senior Databricks Engineer with a strong background in Azure data services to lead the design, development, and optimization of scalable data pipelines and analytics solutions. The ideal candidate will have at least 4 years of hands-on experience in Databricks, with deep expertise in Azure Data Factory (ADF), Delta Lake, and big data processing. 
Key Responsibilities: 
<ul><li>Design and implement robust, scalable, and efficient data pipelines using Azure Databricks and ADF.</li>
<li>Develop and manage ETL/ELT processes, data lakes, and Delta Lake architecture.</li>
<li>Collaborate with data scientists, analysts, and business stakeholders to deliver high-impact AI/ML-driven data products.</li>
<li>Optimize Spark jobs and ensure performance tuning of large-scale data transformations.</li>
<li>Drive best practices in data quality, governance, and security across Azure cloud-based solutions.</li>
<li>Participate in code reviews, solution architecture design, and technical mentoring of junior engineers.</li>
<li>Monitor and manage job performance and orchestration using ADF, Databricks Workflows, or other schedulers.</li>
<li>Ensure adherence to compliance, privacy, and security policies within data solutions</li> 
</ul>Qualification:
Bachelors Degree in Computer Sciences or Software Engineering
Sound Knowledge of Database Management ,SQL and Azure</div>

Senior Databricks Engineer

Taraki

<div>
 This Job is with Big Entities
 
 
 
 Job Overview
 
 
 
 We are seeking an experienced Backend Engineer to architect and deploy scalable backend applications and services. The ideal candidate will have expertise in modern programming languages, distributed systems, and team leadership.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Design and maintain high-performance backend applications and microservices
 </li>
 <li>
 Architect scalable, cloud-native systems and collaborate across engineering teams
 </li>
 <li>
 Write high-quality, performant code and conduct thorough code reviews
 </li>
 <li>
 Build and operate CI/CD pipelines and production systems
 </li>
 <li>
 Work with databases, containerization (Docker/Kubernetes), and cloud platforms
 </li>
 <li>
 Lead agile practices and continuously improve service reliability
 
 
 
 </li>
 </ul>
 
 Required Qualifications
 
 
 
 <ul>
 <li>
 4+ years of professional software development experience
 </li>
 <li>
 2+ years contributing to service design and architecture
 </li>
 <li>
 Strong expertise in modern languages like Golang, Python
 </li>
 <li>
 Deep understanding of scalable, cloud-native architectures and microservices
 </li>
 <li>
 Production experience with distributed systems and database technologies
 </li>
 <li>
 Experience with Docker, software engineering best practices
 </li>
 <li>
 Bachelor's Degree in Computer Science or related technical field
 
 
 
 </li>
 </ul>
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Experience with Golang, AWS, and Kubernetes
 </li>
 <li>
 CI/CD pipeline experience with GitHub Actions
 </li>
 <li>
 Start-up environment experience
 
 </li>
 </ul>
</div>

Backend Engineer - Big Entities

Datamatics Global Services Ltd

<div><h2 class="jobSectionHeader">Cloudera Data Engineer</h2>
Location: Remote (UAE Time Zone) 
Experience: 5+ Years 
Availability: Immediate joiners or candidates who can start within 30 days preferred<h3 class="jobSectionHeader">
Role Overview</h3>
We are seeking an experienced Cloudera Data Engineer to design, build, and maintain data pipelines and processing frameworks across Cloudera&rsquo;s ecosystem. The ideal candidate will have strong expertise in Spark, Hive, Impala, NiFi, and Oozie, and proven experience optimizing large-scale data pipelines for performance and reliability.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, build, and maintain ETL/ELT pipelines using Spark, Hive, Impala, NiFi, and Oozie.</li><li>
Optimize data pipelines for performance, reliability, and cost efficiency across batch and streaming workloads.</li><li>
Develop automation scripts and reusable frameworks for data ingestion, transformation, and cleansing.</li><li>
Collaborate with Cloudera Administrators to tune performance and manage cluster resources efficiently.</li><li>
Troubleshoot and resolve data pipeline failures, performance bottlenecks, and data quality issues.</li><li>
Monitor cluster utilization, job performance, and data throughput using Cloudera Manager.</li><li>
Work with DevOps/Infrastructure teams to define and maintain CI/CD pipelines, automation for deployments, and monitoring of data jobs.</li><li>
Participate in incident management, root cause analysis, and preventive maintenance.</li><li>
Ensure pipelines meet SLAs, data quality, and latency requirements for analytics workloads.</li></ul><h3 class="jobSectionHeader">
Requirements</h3><ul><li>
5+ years of experience as a Data Engineer in a Cloudera-based environment.</li><li>
Strong hands-on experience with Spark, Hive, Impala, NiFi, and Oozie.</li><li>
Solid understanding of ETL design, performance optimization, and data governance principles.</li><li>
Experience with Linux/Unix scripting and CI/CD integration.</li><li>
Excellent troubleshooting and communication skills.</li></ul>
IppsLo883Y</div>

Cloudera Data Engineer

Datamatics Technologies

<div>
 
 Cloudera Data Engineer
 
 
 
 Location:
 
 Remote (UAE Time Zone)
 
 
 Experience:
 
 5+ Years
 
 
 Availability:
 
 Immediate joiners or candidates who can start within 30 days preferred
 
 
 Role Overview
 
 
 We are seeking an experienced
 
 Cloudera Data Engineer
 
 to design, build, and maintain data pipelines and processing frameworks across Cloudera&rsquo;s ecosystem. The ideal candidate will have strong expertise in Spark, Hive, Impala, NiFi, and Oozie, and proven experience optimizing large-scale data pipelines for performance and reliability.
 
 
 Key Responsibilities
 
 <ul>
 <li>
 
 Design, build, and maintain
 
 ETL/ELT pipelines
 
 using Spark, Hive, Impala, NiFi, and Oozie.
 
 </li>
 <li>
 
 Optimize data pipelines for
 
 performance, reliability, and cost efficiency
 
 across batch and streaming workloads.
 
 </li>
 <li>
 
 Develop
 
 automation scripts and reusable frameworks
 
 for data ingestion, transformation, and cleansing.
 
 </li>
 <li>
 
 Collaborate with Cloudera Administrators to
 
 tune performance
 
 and manage cluster resources efficiently.
 
 </li>
 <li>
 
 Troubleshoot and resolve
 
 data pipeline failures, performance bottlenecks, and data quality issues
 
 .
 
 </li>
 <li>
 
 Monitor
 
 cluster utilization, job performance, and data throughput
 
 using Cloudera Manager.
 
 </li>
 <li>
 
 Work with DevOps/Infrastructure teams to define and maintain
 
 CI/CD pipelines, automation for deployments
 
 , and monitoring of data jobs.
 
 </li>
 <li>
 
 Participate in
 
 incident management, root cause analysis, and preventive maintenance
 
 .
 
 </li>
 <li>
 
 Ensure pipelines meet
 
 SLAs, data quality, and latency requirements
 
 for analytics workloads.
 
 </li>
 </ul>
 
 Requirements
 
 <ul>
 <li>
 
 5+ years of experience as a
 
 Data Engineer
 
 in a Cloudera-based environment.
 
 </li>
 <li>
 
 Strong hands-on experience with
 
 Spark, Hive, Impala, NiFi, and Oozie
 
 .
 
 </li>
 <li>
 
 Solid understanding of
 
 ETL design, performance optimization
 
 , and
 
 data governance
 
 principles.
 
 </li>
 <li>
 
 Experience with
 
 Linux/Unix scripting
 
 and
 
 CI/CD integration
 
 .
 
 </li>
 <li>
 
 Excellent troubleshooting and communication skills.
 
 </li>
 </ul>
</div>

<div><h2 class="jobSectionHeader">Informatica DEI Engineer</h2>
Location: Remote (UAE Time Zone) 
Experience: 5+ Years 
Availability: Immediate joiners or candidates who can start within 30 days preferred<h3 class="jobSectionHeader"> 
Role Overview</h3>
We are looking for an experienced Informatica DEI Engineer to design, build, and optimize large-scale data integration pipelines across batch and streaming workloads within the Informatica DEI and Cloudera ecosystem.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, build, test, and deploy data integration mappings and workflows in Informatica DEI.</li><li>
Integrate Informatica DEI with Cloudera clusters, ensuring security, performance, and connectivity.</li><li>
Monitor and support operational jobs, troubleshoot failures, and implement corrective actions.</li><li>
Tune data job performance: optimize mappings, sessions, and resource usage.</li><li>
Implement and maintain data quality frameworks and integration with data platforms.</li><li>
Collaborate with DevOps to build CI/CD pipelines and automate environment deployments.</li><li>
Maintain documentation, runbooks, and standards for DEI operations.</li><li>
Drive incident management, root cause analysis, and performance improvement initiatives.</li></ul><h3 class="jobSectionHeader">
Requirements</h3><ul><li>
5+ years of hands-on experience in Informatica DEI (Data Engineering Integration).</li><li>
Expertise in ETL design, data transformation, and performance optimization.</li><li>
Experience integrating Informatica DEI with Hadoop/Cloudera environments.</li><li>
Familiarity with data quality, automation, and CI/CD practices.</li><li>
Excellent problem-solving and collaboration skills.</li></ul>
hw9qdZkI2h</div>

Informatica DEI Engineer

Sprouto Group

About Sprouto:Sprouto is a forward-thinking AI-driven software development company delivering innovative AI solutions, mobile applications, digital transformation, and bespoke business systems. Join us to work on cutting-edge AI projects and develop custom Large Language Models (LLMs) that drive business impact.The Role:We are looking for a skilled Machine Learning &amp; AI Engineer with 2+ years of experience to design, develop, and deploy AI/ML solutions, including custom LLMs, leveraging Google Cloud&rsquo;s Vertex AI. You will work closely with cross-functional teams to build scalable, robust, and high-performing AI systems.Key Responsibilities:<ul><li>Design, implement, and deploy machine learning models and AI algorithms, including custom LLMs.</li><li>Build and maintain ML pipelines on Google Cloud Vertex AI for LLM development and traditional ML models.</li><li>Prepare data, fine-tune, evaluate, and deploy LLMs effectively.</li><li>Collaborate with data scientists, engineers, and product managers to translate business requirements into AI solutions.</li><li>Monitor model performance and implement improvements.</li><li>Stay updated on the latest AI, ML, and LLM developments.</li><li>Document technical designs and processes.</li></ul>Required Skills &amp; Experience:<ul><li>Bachelor&rsquo;s degree in Computer Science, AI, Data Science, or related field.</li><li>Minimum 2 years of experience in ML/AI engineering, with exposure to NLP or LLMs.</li><li>Proficiency in Python and ML frameworks (TensorFlow/PyTorch).</li><li>Practical experience with Google Cloud Platform, especially Vertex AI.</li><li>Knowledge of ML algorithms and NLP libraries (Transformers, spaCy, NLTK).</li><li>Experience in deploying and monitoring ML models.</li><li>Strong problem-solving and communication skills.</li></ul>Preferred Skills:<ul><li>Direct experience developing or fine-tuning LLMs.</li><li>Knowledge of LLM architectures (e.g., Transformer, BERT, GPT).</li><li>Experience with MLOps, CI/CD, Docker/Kubernetes, and big data tools.</li><li>Advanced degree (Master&rsquo;s/PhD) in AI/NLP or relevant certifications (e.g., Google Cloud Professional ML Engineer).</li></ul>Job Type: Full-timeWork Location: In person

Machine Learning & AI Engineer

Techionik Ltd

An AI/ML Engineer is responsible for designing, developing, and deploying machine learning models and artificial intelligence systems that solve real-world problems. The role involves working with large datasets, building predictive models, optimizing algorithms, and integrating ML solutions into production environments. AI/ML Engineers work closely with data scientists, software engineers, and product teams to deliver scalable and efficient AI-driven applications.Key Responsibilities<ul><li>Develop, train, test, and deploy machine learning and deep learning models.</li><li>Collect, preprocess, and analyze large datasets for model training and evaluation.</li><li>Research and implement cutting-edge ML algorithms and techniques.</li><li>Build end-to-end ML pipelines (data ingestion &rarr; model training &rarr; evaluation &rarr; deployment).</li><li>Optimize model performance (accuracy, latency, scalability).</li><li>Collaborate with data scientists to translate business problems into ML solutions.</li><li>Integrate ML models into production systems using APIs, cloud services, or MLOps tools.</li><li>Monitor, maintain, and retrain models in production to ensure long-term performance.</li><li>Document model architecture, data workflow, and implementation details.</li></ul>Required Skills<ul><li>Strong experience with Python and ML libraries (TensorFlow, PyTorch, Scikit-learn).</li><li>Proficiency in data processing tools (Pandas, NumPy, Spark).</li><li>Knowledge of statistics, probability, and linear algebra.</li><li>Experience with machine learning algorithms (regression, classification, NLP, CV, deep learning, etc.).</li><li>Familiarity with cloud platforms such as AWS, GCP, or Azure.</li><li>Understanding of MLOps tools (MLflow, Kubeflow, Docker, Kubernetes, CI/CD).</li><li>Strong problem-solving and analytical skills.</li></ul>Preferred Qualifications<ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, AI, Data Science, or related field.</li><li>Experience with big data technologies (Hadoop, Spark).</li><li>Hands-on experience with LLM integration or generative AI.</li><li>Ability to build scalable ML architectures and work with REST APIs or microservices.</li></ul>Soft Skills<ul><li>Excellent communication and collaboration skills.</li><li>Ability to work in cross-functional teams.</li><li>Strong attention to detail and documentation.</li><li>Creative thinking and innovation mindset.</li></ul>Job Type: Full-timeWork Location: In person

AI/ML Engineer

Explore 1233+ Big data engineer in Lahore this November. Find roles across top companies and apply now to boost your career.

1233 big data engineer jobs IN Lahore

Senior Databricks Engineer

Backend Engineer - Big Entities

Cloudera Data Engineer

Cloudera Data Engineer

Informatica DEI Engineer

Machine Learning & AI Engineer

AI/ML Engineer