ai/ml engineer

data analyst

ai automation engineer

ai engineer

data engineer

big data engineer

Techbridge Consultancy Services

Location: Siddique Trade Centre, Gulberg III, Lahore, Pakistan Job Type: Full-time (Onsite) Working Hours: 2:00 PM &ndash; 11:00 PM (PKT)About the RoleWe are looking for a motivated Python Data Engineer with 2&ndash;3 years of experience to join our growing data team. You will be responsible for building, optimizing, and maintaining data pipelines and solutions that support business intelligence, analytics, and automation. This is an onsite role in our Lahore office.Key Responsibilities<ul><li>Develop, maintain, and optimize ETL/ELT pipelines using Python and related libraries (Pandas, NumPy, PySpark).</li><li>Write and optimize complex SQL queries for PostgreSQL, SQL Server, and other RDBMS.</li><li>Work with AWS Cloud services (S3, Lambda, Glue, Athena, Step Functions, EventBridge) to design and manage scalable data workflows.</li><li>Handle data ingestion, transformation, and validation for reporting and analytics.</li><li>Automate manual processes and integrate data flows across different systems.</li><li>Collaborate with analysts and business teams to ensure reliable and timely delivery of datasets and reports.</li><li>Use Excel and other BI tools for quick data analysis and validation.</li><li>Ensure data quality, security, and compliance in all data operations.</li></ul>Required Skills<ul><li>2&ndash;3 years of professional experience in data engineering, ETL, or backend development.</li><li>Strong proficiency in Python (Pandas, NumPy, PySpark).</li><li>Solid knowledge of SQL (PostgreSQL, SQL Server, or similar).</li><li>Experience with AWS Cloud services (S3, Lambda, Glue, Athena, Step Functions, EventBridge).</li><li>Hands-on experience in Excel for data validation and reporting.</li><li>Familiarity with data warehousing concepts and big data tools.</li><li>Understanding of data modeling, schema design, and performance optimization.</li><li>Strong problem-solving, analytical, and communication skills.</li></ul>Preferred<ul><li>Experience with job orchestration tools (Airflow, Step Functions, etc.).</li><li>Exposure to BI/Reporting tools (e.g., Power BI, QuickSight, Tableau).</li><li>Knowledge of APIs, REST, and data integration techniques.</li><li>Experience with Git and version control.</li></ul>What We Offer<ul><li>Opportunity to work with modern data engineering tools and AWS Cloud.</li><li>Professional growth in a collaborative and supportive environment.</li><li>Onsite role at a prime location in Gulberg III, Lahore</li></ul>Job Type: Full-timeApplication Question(s):<ul><li>How many years of professional experience do you have working with Python for data engineering or ETL pipelines?</li><li>How would you rate your proficiency in writing and optimizing SQL queries?</li><li>Are you comfortable working full-time onsite from 2:00 PM to 11:00 PM (PKT) in Gulberg III, Lahore?</li></ul>Language:<ul><li>English (Preferred)</li></ul>Work Location: In person

Python Data Engineer (ETL & AWS)

Confiz

<div>We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.
Responsibilities:
<ul><li>Write PySpark and SQL scripts to validate data pipelines, transformations, and integrations.</li>
<li>Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards.</li>
<li>Continuously enhance automated tests as new features are developed, ensuring Participate in data reconciliation and verify Data Quality frameworks to maintain data accuracy, completeness, and consistency across the platform.</li>
<li>Formulate and maintain test strategies&mdash;including smoke, performance, functional, and regression testing&mdash;to ensure data processing and ETL jobs meet requirements.</li>
<li>Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity.</li>
<li>Share knowledge and best practices by collaborating with business analysts and technology teams to document testing processes and findings.</li>
<li>Communicate testing progress effectively with stakeholders, highlighting issues or blockers, and ensuring alignment with business objectives.</li>
<li>Maintain a comprehensive understanding of the Azure Data Lake platform's data landscape to ensure thorough testing coverage.</li>
</ul>
Requirements:
<ul><li>Bachelor&rsquo;s degree in computer science or related discipline</li>
<li>3-6 years of hands-on experience in Data Engineering particularly in Data Lake environments on Azure's cloud platform.</li>
<li>Proficient in Azure Data Factory, Azure Synapse Analytics and Databricks for big data processing and scaled data quality checks.</li>
<li>Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.</li>
<li>Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.</li>
<li>Hands-on experience with Functional &amp; system integration testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.</li>
<li>Knowledge and ability to design and execute test cases in a behaviour-driven development environment.</li>
<li>Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles.</li>
<li>Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.</li>
<li>Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.</li>
<li>Identify and resolve issues in complex Big Data environments, ensuring data accuracy and system efficiency.</li>
<li>Initiate and manage tasks, delivering high-quality results within deadlines in a dynamic setting.</li>
<li>Confidently challenge existing assumptions and processes to enhance data engineering and QA practices.</li>
<li>Maintain organized testing schedules and documentation, ensuring thorough coverage of all scenarios.</li>
<li>Exhibit strong interpersonal skills, working effectively in cross-functional, multicultural teams with minimal supervision.</li>
<li>Comfortable in Agile and Scrum environments, proficient with tools like Jira, and adaptable to changing priorities.</li>
<li>Manage multiple projects simultaneously, demonstrating strong planning and organizational skills to ensure timely task completion.</li>
</ul>
We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 5 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM) and ISO 14001:2015 (EMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz Limited, visit: https://web.facebook.com/lifeatconfiz</div>

Data Engineer in Test

Softmatic Solutions

Job Title: Azure Data EngineerLocation: Ali block, Garden Town, LahoreJob Type: (11:00 AM to 08:00 PM) | Onsite | Full-TimeExperience: 1&ndash;2 YearsJoin Our Team at Softmatic Solutions:We are a software development firm offering expert application and game development services, including Xamarin, Cocos2d, Unity, Flutter, Native Android, and Native iOS. Additionally, we specialize in WordPress development, .NET solutions, and Power BI for data visualization and business intelligence.Recommendations are more than welcome. Job Summary: We are seeking an Azure Data Engineer with intermediate-level expertise to design, build, and maintain scalable data solutions. The ideal candidate will have hands-on experience with ETL/ELT pipelines, Azure data services, and strong analytical skills to support business intelligence and data-driven decision-making.Required Skills &amp; Qualifications:<ul><li>1&ndash;2 years of experience in data engineering or related field.</li><li>Proficiency in SQL and Python for data processing.</li><li>Hands-on experience with Azure Data Services (Data Factory, Data Lake, Synapse, Azure SQL).</li><li>Familiarity with Power BI and Power Apps for reporting and visualization.</li><li>Strong understanding of data warehouse concepts and best practices.</li><li>Excellent analytical and problem-solving skills.</li></ul>Why Join Us?<ul><li>Work in a fast-paced and innovative environment.</li><li>Opportunities for professional growth and development.</li><li>Collaborative and supportive team culture.</li><li>Competitive salary and benefits package.</li></ul>Job Type: Full-timeWork Location: In person

Azure Data Engineer

Burq

<div>About Burq 
 
Burq started with an ambitious mission: how can we turn the complex process of offering delivery into a simple turnkey solution. 
 
It's a big mission and now we want you to join us to make it even bigger! 
 
We're already backed by some of the Valley's leading venture capitalists, including Village Global, the fund whose investors include Bill Gates, Jeff Bezos, Mark Zuckerberg, Reid Hoffman, and Sara Blakely. We have assembled a world-class team all over the globe. 
 
We operate at scale, but we're still a small team relative to the opportunity. We have a staggering amount of work ahead. That means you have an unprecedented opportunity to grow while doing the most important work of your career. 
 
The Role 
 
As one of our first Data Engineers, you will be responsible for designing, building, and maintaining the pipelines and infrastructure that power our data-driven decision-making. You'll work closely with product, operations, and engineering teams to ensure that data is clean, reliable, and ready to drive insights, from optimizing delivery routes to improving customer experiences. 
 
This is a unique opportunity to build scalable data systems from the ground up and shape the foundation of our analytics and AI capabilities. 
 
What You'll Do 
<ul>
<li>
Design &amp; Build Pipelines: Develop and maintain scalable ETL/ELT processes to ingest, clean, and transform data from multiple sources (internal systems, third-party APIs, IoT devices)</li>
<li>Data Modeling: Design and implement efficient data models for analytics, machine learning, and operational systems</li>
<li>Infrastructure: Own the data infrastructure, leveraging cloud-native solutions (e.g., AWS, GCP, or Azure) and modern data tools</li>
<li>Collaboration: Partner with data scientists, analysts, and software engineers to deliver data products that enable smarter decision-making</li>
<li>Data Quality: Implement robust monitoring, validation, and governance to ensure accuracy, security, and compliance</li>
Scalability: Architect solutions that can handle rapid growth in data volume and complexity as the business scales 
<li>
</li>
</ul>Requirements
Requirements 
Experience: 3+ years of experience in data engineering, preferably in a startup or high-growth environment
Technical Skills:<ul>
<li>
Proficiency with SQL and at least one programming language (Python, Scala, or Java)</li>
<li>Experience with cloud data warehouses (Snowflake, BigQuery, or Redshift)</li>
<li>Familiarity with workflow orchestration tools (Airflow, Dagster, Prefect)</li>
<li>Hands-on experience with data streaming (Kafka, Kinesis) is a plus</li>
Mindset: A builder mentality&mdash;comfortable with ambiguity, fast iterations, and working in a small but mighty team 
<li>
</li>
</ul>Benefits
Investing in you 
At Burq, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status</div>

Data Engineer

<div>
 
 About Burq
 
 
 
 Burq started with an ambitious mission: how can we turn the complex process of offering delivery into a simple turnkey solution.
 
 
 It's a big mission and now we want you to join us to make it even bigger! 🚀
 
 
 We're already backed by some of the Valley's leading venture capitalists, including Village Global, the fund whose investors include Bill Gates, Jeff Bezos, Mark Zuckerberg, Reid Hoffman, and Sara Blakely. We have assembled a world-class team all over the globe.
 
 
 We operate at scale, but we're still a small team relative to the opportunity. We have a staggering amount of work ahead. That means you have an unprecedented opportunity to grow while doing the most important work of your career.
 
 
 
 The Role
 
 
 
 As one of our first
 
 Data Engineers
 
 , you will be responsible for designing, building, and maintaining the pipelines and infrastructure that power our data-driven decision-making. You'll work closely with product, operations, and engineering teams to ensure that data is clean, reliable, and ready to drive insights, from optimizing delivery routes to improving customer experiences.
 
 
 This is a unique opportunity to build scalable data systems from the ground up and shape the foundation of our analytics and AI capabilities.
 
 
 
 What You'll Do
 
 
 
 <ul>
 <li>
 Design &amp; Build Pipelines: Develop and maintain scalable ETL/ELT processes to ingest, clean, and transform data from multiple sources (internal systems, third-party APIs, IoT devices)
 </li>
 <li>
 Data Modeling: Design and implement efficient data models for analytics, machine learning, and operational systems
 </li>
 <li>
 Infrastructure: Own the data infrastructure, leveraging cloud-native solutions (e.g., AWS, GCP, or Azure) and modern data tools
 </li>
 <li>
 Collaboration: Partner with data scientists, analysts, and software engineers to deliver data products that enable smarter decision-making
 </li>
 <li>
 Data Quality: Implement robust monitoring, validation, and governance to ensure accuracy, security, and compliance
 </li>
 <li>
 Scalability: Architect solutions that can handle rapid growth in data volume and complexity as the business scales
 
 
 </li>
 </ul>
 
 Requirements
 
 
 
 
 Requirements
 
 
 
 Experience: 3+ years of experience in data engineering, preferably in a startup or high-growth environment
 
 
 Technical Skills:
 
 
 <ul>
 <li>
 Proficiency with SQL and at least one programming language (Python, Scala, or Java)
 </li>
 <li>
 Experience with cloud data warehouses (Snowflake, BigQuery, or Redshift)
 </li>
 <li>
 Familiarity with workflow orchestration tools (Airflow, Dagster, Prefect)
 </li>
 <li>
 Hands-on experience with data streaming (Kafka, Kinesis) is a plus
 </li>
 <li>
 Mindset: A builder mentality&mdash;comfortable with ambiguity, fast iterations, and working in a small but mighty team
 
 
 </li>
 </ul>
 
 Benefits
 
 
 
 Investing in you
 
 
 At Burq, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status
</div>

Algo

<div>Position: Data Engineer (Azure Platform)

Location: Lahore (on-site)<div> 
Job Description 
<ul><li>Design and develop scalable data warehouse solutions to support analytics and reporting.</li><li>Build and maintain efficient Azure Data Pipelines using Azure Data Factory for ETL processes.</li><li>Develop and optimize Spark jobs using Databricks and PySpark for large-scale data transformations.</li><li>Coordinate with onsite and offshore teams to ensure seamless project execution and business continuity.</li><li>Develop and maintain dashboards and reports using BI tools such as Power BI, Tableau, MicroStrategy, or Qlik.</li><li>Manage the presentation and access layers to ensure secure and efficient data access.</li><li>Work directly with clients and stakeholders to understand requirements and deliver actionable data solutions</li></ul></div> 
Qualifications
<ul><li>BS in Computer Science or a related field with 4-5 years of experience in BI and data management projects.</li><li>Strong expertise in database and data warehouse design, support, and maintenance.</li><li>Proficiency in writing complex SQL and SparkSQL queries.</li><li>Experience in Python and its data-related frameworks.</li><li>Hands-on experience with Databricks and PySpark for data engineering tasks.</li><li>Strong proficiency in Power BI; experience with other BI tools is a plus.</li><li>Experience with Azure Data Platform (Data Factory, Azure SQL, Synapse, Data Lake) is preferred.</li><li>Ability to generate and maintain comprehensive technical documentation.</li><li>Excellent communication and interpersonal skills.</li><li>Strong analytical and problem-solving abilities.</li><li>Willingness to learn and adapt to new technologies and project requirements.</li><li>Experience in data analysis is a plus.</li><li>Ability to work independently and handle critical situations confidently.</li><li>A collaborative, team-oriented mindset.</li></ul></div>

Data Engineer (Azure Platform)

Prismatic Technologies Limited

We are seeking a Senior Backend Engineer with expertise in AI/ML infrastructure to build scalable systems that power our AI-driven products. Key Responsibilities<ul><li>Design and develop high-performance backend services and APIs using Python and Go</li><li>Build infrastructure for training, fine-tuning, and deploying large language models</li><li>Implement vector database solutions for similarity search and RAG applications</li><li>Develop MLOps pipelines for model deployment and monitoring</li><li>Architect scalable solutions on Google Cloud Platform (GCP)</li><li>Create data pipelines and ensure system reliability across distributed systems</li></ul>Required Qualifications<ul><li>5+ years backend engineering experience with production systems</li><li>Expert-level Python and proficient Go programming</li><li>2+ years hands-on experience with LLM training, fine-tuning, or deployment</li><li>Strong experience with vector databases (Pinecone, Weaviate, Chroma)</li><li>Extensive GCP experience including GKE, Cloud Storage, and ML services</li><li>Experience with ML frameworks (PyTorch, TensorFlow, Hugging Face)</li><li>Proficiency with SQL/NoSQL databases and containerization (Docker, Kubernetes)</li><li>Understanding of transformer architectures and distributed training techniques</li></ul>Preferred Qualifications<ul><li>Advanced degree in Computer Science or related field</li><li>Experience with message queues, monitoring tools, and big data frameworks</li><li>Open source contributions to ML or backend engineering projects</li></ul>Job Type: Full-timeWork Location: In person

Senior Backend Engineer - AI/ML Platform

Explore 953+ Big data engineer in Lahore this October. Find roles across top companies and apply now to boost your career.

953 big data engineer jobs IN Lahore

Python Data Engineer (ETL & AWS)

Data Engineer in Test

Azure Data Engineer

Data Engineer

Data Engineer

Data Engineer (Azure Platform)

Senior Backend Engineer - AI/ML Platform