ai engineer

ai/ml engineer

data engineer

data scientist

devops engineer

data pipeline engineer

Caregenix Solutions

We're Hiring: ETL Engineer (Remote &ndash; Full Time)Company: CareGenix SolutionsLocation: RemoteExperience: 1 - 3 YearsType: Full-TimeCaregenix Solutions, a fast-growing healthcare tech company, is seeking a skilled ETL Engineer to design and maintain robust data pipelines that power real-time insights and analytics.Key Responsibilities:Build and manage scalable ETL/ELT pipelines using AWS services (Glue, Lambda, S3, EMR, Redshift, etc.).Design and optimize data models and databases (Redshift, Athena, RDS).Ingest data from diverse sources and ensure quality through validation checks.Collaborate with teams to deliver reliable, insight-driven data solutions.Monitor pipeline performance and troubleshoot as needed.Follow best practices for data security and governance.Requirements6+ years in Data Engineering or similar roles.Strong in SQL and Python or Scala.Hands-on experience with AWS data tools: Glue, Redshift, EMR, Athena, Kinesis, etc.Experience with workflow/orchestration tools (Airflow, Step Functions).Solid knowledge of data warehousing, performance tuning, and big data.Familiarity with CI/CD, Git, and IaC tools (Terraform, CloudFormation).Bachelor&rsquo;s in Computer Science, Engineering, or related field.To Apply Send your resume to careers@caregenix.solutionsSubject Line: ETL EngineerBe part of a team transforming healthcare through data. We&rsquo;d love to hear from youJob Type: Full-timePay: Up to Rs200,000.00 per monthApplication Question(s):<ul><li>How many years of experience do you have in this field?</li><li>what is your expected pay?</li></ul>Work Location: Remote

ETL Engineer

CHROMEIS

<div><h4 class="jobSectionHeader">Overview:</h4>

We are seeking a detail-oriented Data Engineer responsible for designing, developing, and maintaining scalable data systems. The ideal candidate will build robust data pipelines, ensure data quality, and collaborate across teams to support analytics and reporting. This role requires a strong understanding of data modeling, data warehousing, integration techniques, and the ability to translate business needs into technical solutions.
<h4 class="jobSectionHeader">
Responsibilities:</h4>
<ul><li>Design and implement scalable data pipelines for ingesting, processing, and storing data from diverse sources, ensuring optimal performance and reliability.</li>
<li>Develop and maintain data models that support analytical and operational needs, using techniques that balance normalization and denormalization.</li>
<li>Build and optimize data warehousing solutions, incorporating strategies for partitioning, indexing, and backup to enhance query performance.</li>
<li>Integrate data from various sources through effective ETL processes, resolving format and structure differences to ensure consistency and integrity.</li>
<li>Create clear and actionable data visualizations to communicate data trends and insights to stakeholders.</li>
<li>Write and maintain clean, efficient code for data processing tasks and basic SQL queries, ensuring the solutions are scalable and maintainable.</li>
<li>Collaborate with cross-functional teams to translate business requirements into technical designs and document data architectures.</li>
<li>Employ logical reasoning and problem-solving skills to troubleshoot issues in data flows and optimize system performance.</li>
<li>Communicate effectively, both in writing and verbally, to document processes, share insights, and support decision-making.</li>
</ul><h4 class="jobSectionHeader">Qualifications:</h4>
<ul><li>Bachelor&rsquo;s degree in Computer Science, Information Technology, or a related field, or equivalent experience.</li>
<li>Proven experience in building data pipelines, data warehousing, and data integration projects.</li>
<li>Proficiency in SQL and familiarity with at least one programming language (e.g., Python, Java, or similar) used in data processing.</li>
<li>Solid understanding of data modeling techniques, including strategies for handling OLAP systems and large datasets.</li>
<li>Experience with data visualization tools and practices.</li>
<li>Strong analytical and logical reasoning skills, combined with excellent English writing and communication abilities.</li>
<li>Ability to work independently and collaboratively in a dynamic, fast-paced environment.</li>
<li>This position offers an exciting opportunity for a motivated Data Engineer to contribute to the overall data strategy, ensuring efficient data capture, storage, and analysis that drives informed decision-making.</li>
</ul><h4 class="jobSectionHeader">Application Process:</h4>
<div><ul><li>Please send your resume to [careers@chromeis.com] with a relevant subject line.</li></ul>
<ul><li>If your resume is shortlisted, you will be invited to take an online AI-based assessment.</li></ul>
<ul><li>Candidates who pass this test will move on to the next stage: an on-call interview with the end client.</li></ul>
<ul><li>Successful candidates from all rounds will receive an offer based on the initial discussion during the first call.</li></ul></div></div>

Data Engineer

Game District

We&rsquo;re seeking a Data Engineer to help build scalable data pipelines and models that power marketing, user acquisition, and monetization analytics. You&rsquo;ll work with data from Adjust, ad networks, and in-game sources, transforming it within our data stack to support analysts and data scientists across the company.Key Responsibilities<ul><li>Develop and maintain reliable ETL/ELT pipelines for MMPs, ad networks, and</li><li>monetization data.</li><li>Support data ingestion, transformation, and quality processes in AWS S3 and Iceberg.</li><li>Design and optimize data models for analytics and reporting in StarRocks.</li><li>Collaborate with data analysts and marketing teams to meet data needs.</li><li>Monitor and troubleshoot pipelines to ensure data accuracy and freshness.</li><li>Contribute to documentation, testing, and CI/CD for data workflows.</li></ul>Requirements<ul><li>3+ years of professional experience in data engineering.</li><li>Bachelor&rsquo;s degree in a STEM field (Computer Science, Engineering, Mathematics, or</li><li>related).</li><li>Strong experience with AWS (S3, Glue, Lambda, Athena).</li><li>Working knowledge of Iceberg or other modern data lakehouse frameworks.</li><li>Proficiency in SQL and Python (pandas, PySpark, or similar).</li><li>Experience integrating marketing and ad network APIs.</li><li>Familiarity with data orchestration tools (Airflow, dbt, etc.).</li><li>Understanding of data modeling and ETL best practices.</li></ul>Nice to Have<ul><li>Experience with CelerData StarRocks, ClickHouse, or similar analytical databases.</li><li>Background in the gaming industry or mobile app analytics.</li><li>Knowledge of MMPs like Adjust, Appsflyer, or Singular.</li></ul>Job Type: Full-timeApplication Question(s):<ul><li>What is your current salary? </li><li>What is your expected salary? </li><li>Please mention your total relevant experience. </li></ul>Work Location: In person

Algo

<div>Position: Data Engineer (Azure Platform)

Location: Lahore, Pakistan (on-site)<div> 
Job Description 
<ul><li>Design and develop scalable data warehouse solutions to support analytics and reporting.</li><li>Build and maintain efficient Azure Data Pipelines using Azure Data Factory for ETL processes.</li><li>Develop and optimize Spark jobs using Databricks and PySpark for large-scale data transformations.</li><li>Coordinate with onsite and offshore teams to ensure seamless project execution and business continuity.</li><li>Develop and maintain dashboards and reports using BI tools such as Power BI, Tableau, MicroStrategy, or Qlik.</li><li>Manage the presentation and access layers to ensure secure and efficient data access.</li><li>Work directly with clients and stakeholders to understand requirements and deliver actionable data solutions</li></ul></div> 
Qualifications
<ul><li>BS in Computer Science or a related field with 4-5 years of experience in BI and data management projects.</li><li>Strong expertise in database and data warehouse design, support, and maintenance.</li><li>Proficiency in writing complex SQL and SparkSQL queries.</li><li>Experience in Python and its data-related frameworks.</li><li>Hands-on experience with Databricks and PySpark for data engineering tasks.</li><li>Strong proficiency in Power BI; experience with other BI tools is a plus.</li><li>Experience with Azure Data Platform (Data Factory, Azure SQL, Synapse, Data Lake) is preferred.</li><li>Ability to generate and maintain comprehensive technical documentation.</li><li>Excellent communication and interpersonal skills.</li><li>Strong analytical and problem-solving abilities.</li><li>Willingness to learn and adapt to new technologies and project requirements.</li><li>Experience in data analysis is a plus.</li><li>Ability to work independently and handle critical situations confidently.</li><li>A collaborative, team-oriented mindset.</li></ul></div>

Data Engineer (Azure Platform)

Adal Fintech (Pvt) Ltd.

<div>Role Overview:
At Adal Fintech, we are seeking a skilled Data Engineer with strong expertise in SQL, PL/SQL, Stored Procedures, Database Query Optimization, SSIS, Apache Spark, and Python. The ideal candidate will design, develop, and optimize data pipelines and ETL workflows, ensuring efficient and scalable data solutions to support business intelligence and analytics initiatives.
About AdalFi:
At AdalFi, we&rsquo;re building Pakistan&rsquo;s fastest-growing AI-powered digital lending infrastructure, enabling banks to launch innovative credit products in days instead of months. Our platform uses advanced AI and data analytics to help financial institutions make smarter, faster lending decisions transforming access to credit for millions.
What You&rsquo;ll Do:<ul><li>Build and maintain ETL processes and data pipelines (SQL, PL/SQL, SSIS, Apache Spark, Python).</li><li>Write and optimize complex queries and stored procedures for high performance.</li><li>Work with large-scale structured/unstructured data, ensuring quality, security, and compliance.</li><li>Collaborate with BI teams and stakeholders to deliver reliable, scalable data solutions.</li><li>Document technical designs and workflows for knowledge sharing.</li></ul>
What We&rsquo;re Looking For:<ul><li>4+ years of experience in Data Engineering field.</li><li>Strong expertise in SQL, PL/SQL, Stored Procedures, query optimization, and performance tuning.</li><li>Hands-on experience with ETL tools (SSIS), big data (Apache Spark), and Python.</li><li>Solid understanding of data modeling, warehousing, and relational databases.</li><li>Familiarity with Git, CI/CD, and collaborative problem-solving.</li></ul>
Requirements:<ul><li>Bachelor&rsquo;s degree in CS, IT, or related field.</li><li>Experience with cloud platforms (AWS, Azure, GCP).</li><li>Knowledge of data governance, security, and compliance.</li><li>Exposure to NoSQL and real-time data processing.</li></ul></div>

Senior Data Engineer

ACE Union

About Us:We are a dynamic and fast-growing financial technology group headquartered in Manchester, United Kingdom, with an established presence across the UK, Europe, Canada, Australia, Pakistan, and Bangladesh. Our group, encompassing ACE Money Transfer and ACE Union, operates across two regulated verticals: Electronic Money Services (EMI) and Cross-Border Remittances.Through our digital platforms, including mobile apps, web portals, and APIs, we deliver a comprehensive range of regulated financial services. These include digital payments, e-wallets, electronic money issuance, prepaid cards, mobile top-ups, bill payments, and international money transfers, designed to serve both individual and business customers in over 100 countries. By leveraging cutting-edge technologies such as AI for fraud detection, automation for seamless transactions, and partnerships with global leaders like Mastercard, we provide secure, user-friendly, and accessible financial solutions that adapt to the evolving needs of a global customer base.As we scale our EMI and remittance operations amid 2025's fintech landscape&mdash;marked by real-time payments, embedded finance, blockchain integration, and sustainability initiatives&mdash;we are building a leadership team to drive innovation, regulatory compliance, and excellence across our dual-regulated ecosystem.Job Overview: This role is focused on designing and delivering scalable, secure, and high-performance data architectures to support the organization&rsquo;s expanding analytical and operational needs. The Senior Data Engineer will work closely with cross-functional teams to understand complex data requirements, define and implement robust data transformation rules, and lead the development and optimization of end-to-end data pipelines and data warehouse infrastructure. The ideal candidate will have hands-on experience in API based data integrations with third-party platforms, as well as a strong grasp of data governance principles. This includes implementing policies to ensure data quality, privacy, security, and compliance with regulatory standards. The role also involves optimizing workflows for cost efficiency and performance, while providing technical leadership to engineering and analytics teams in executing complex, data driven initiatives.Key Responsibilities:<ul><li>Architecting Scalable Data Systems: Designing robust data infrastructures capable of supporting increasing data volume and complexity.</li><li>Design Data Pipelines: Develop efficient data ingestion pipelines and ETL processes capable of handling both structured and unstructured data effectively.</li><li>Data Warehouse Management: Manage and optimize the data warehouse, ensuring efficient data storage, retrieval, and transformation. Implement best practices for organizing and managing raw, processed, and curated data, with scalability and future growth in mind</li><li>Optimize Data Modelling: Write, optimize, and maintain complex SQL queries and Python scripts to ensure efficient data processing.</li><li>Streamlining Data Workflows: Enhancing data storage, processing, and access methods to improve efficiency, strengthen data observability, and reduce operational costs through targeted infrastructure optimizations.</li><li>Governance &amp; Quality: Develop and maintain data quality checks to ensure data is accurate, consistent, and regulatory compliant.</li><li>Develop Integration Procedures: Design and implement processes to integrate data warehouse solutions into operational IT environments.</li><li>Driving Technical Leadership: Guiding engineering and analytics teams in the execution of data-driven initiatives and innovation.</li><li>Research &amp; Development: Keep up with the latest technological trends and identify innovative solutions to address customer challenges and company priorities.</li></ul>Skills and Qualifications:<ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in Engineering, Computer Science, or a related field, or equivalent professional experience.</li><li>Minimum of 4 years of hands-on experience in a Data Engineering or Data Architecture role.</li><li>Proven experience with cloud platforms such as AWS, Azure, or GCP, with practical knowledge of their core data and infrastructure services.</li><li>Proficient in using ETL tools and frameworks such as AWS Glue, Apache Airflow, Apache Spark, Kafka, Informatica, DataStage, or Talend for integrating data from multiple sources.</li><li>Demonstrated expertise in setting up and managing scalable, high-performance data warehouse environments.</li><li>Strong understanding of dimensional data modeling and mapping techniques, including Star, Snowflake, and Galaxy schemas.</li><li>Solid understanding of data privacy regulations, including GDPR, and experience applying best practices for data security, compliance, and governance.</li><li>Working knowledge of data observability principles and the full data lifecycle management.</li><li>Extensive experience in designing and developing ETL architectures to support large-scale, distributed data processing.</li><li>Deep knowledge of relational database concepts and advanced proficiency in SQL and Python for data manipulation and transformation.</li><li>Experience working in distributed environments, including clustering, partitioning, and sharding strategies.</li><li>Familiarity with building semantic models and preparing reporting and mapping documentation.</li><li>Strong analytical and problem-solving skills, with a logical and solution-oriented mindset.</li><li>Prior experience in the financial services sector is a plus.</li></ul>Job Type: Full-timePay: Rs300,000.00 - Rs400,000.00 per monthApplication Question(s):<ul><li>Do you speak English Proficiently ?</li><li>Do you have hands-on experience with DBT or Apache Airflow? If yes, please provide basic details on your experience, including specific use cases and projects.</li><li>What is your current compensation package?</li><li>What is your expected salary?</li><li>Is it possible for you to commute daily to Gulberg-3 Lahore, or to relocate to Lahore city for this job?</li><li>The shift timing connected with the role is 01 PM PST to 10 PM PST. Is it feasible for you to work in these timings?</li></ul>Education:<ul><li>Bachelor's (Required)</li></ul>Experience:<ul><li>Data Engineering or Data Architecture role.: 4 years (Required)</li></ul>Work Location: In person

Confiz

<div>We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.
Responsibilities:
<ul><li>Write PySpark and SQL scripts to validate data pipelines, transformations, and integrations.</li>
<li>Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards.</li>
<li>Continuously enhance automated tests as new features are developed, ensuring Participate in data reconciliation and verify Data Quality frameworks to maintain data accuracy, completeness, and consistency across the platform.</li>
<li>Formulate and maintain test strategies&mdash;including smoke, performance, functional, and regression testing&mdash;to ensure data processing and ETL jobs meet requirements.</li>
<li>Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity.</li>
<li>Share knowledge and best practices by collaborating with business analysts and technology teams to document testing processes and findings.</li>
<li>Communicate testing progress effectively with stakeholders, highlighting issues or blockers, and ensuring alignment with business objectives.</li>
<li>Maintain a comprehensive understanding of the Azure Data Lake platform's data landscape to ensure thorough testing coverage.</li>
</ul>
Requirements:
<ul><li>Bachelor&rsquo;s degree in computer science or related discipline</li>
<li>3-6 years of hands-on experience in Data Engineering particularly in Data Lake environments on Azure's cloud platform.</li>
<li>Proficient in Azure Data Factory, Azure Synapse Analytics and Databricks for big data processing and scaled data quality checks.</li>
<li>Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.</li>
<li>Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.</li>
<li>Hands-on experience with Functional &amp; system integration testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.</li>
<li>Knowledge and ability to design and execute test cases in a behaviour-driven development environment.</li>
<li>Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles.</li>
<li>Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.</li>
<li>Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.</li>
<li>Identify and resolve issues in complex Big Data environments, ensuring data accuracy and system efficiency.</li>
<li>Initiate and manage tasks, delivering high-quality results within deadlines in a dynamic setting.</li>
<li>Confidently challenge existing assumptions and processes to enhance data engineering and QA practices.</li>
<li>Maintain organized testing schedules and documentation, ensuring thorough coverage of all scenarios.</li>
<li>Exhibit strong interpersonal skills, working effectively in cross-functional, multicultural teams with minimal supervision.</li>
<li>Comfortable in Agile and Scrum environments, proficient with tools like Jira, and adaptable to changing priorities.</li>
<li>Manage multiple projects simultaneously, demonstrating strong planning and organizational skills to ensure timely task completion.</li>
</ul>
We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), ISO 14001:2015 (EMS), ISO 45001:2018 (OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/</div>

Data Engineer in Test

Explore 1135+ Data pipeline engineer in Lahore this November. Find roles across top companies and apply now to boost your career.

1135 data pipeline engineer jobs IN Lahore

ETL Engineer

Data Engineer

Data Engineer

Data Engineer (Azure Platform)

Senior Data Engineer

Senior Data Engineer

Data Engineer in Test