devops engineer

software engineer

backend engineer

data & reporting analyst

data engineer

data pipeline engineer

Systems Limited

<div><h4 class="jobSectionHeader">We are looking for a Data Engineer with 3&ndash;4 years of experience in data engineering, data integration, or a related role.</h4>
<h4 class="jobSectionHeader">Responsibilities</h4>
<ul>
<li>Develop scalable ETL processes using Spark, Hadoop, and other big data technologies.
</li>
<li>Design, test, and maintain pipelines that transform raw data into structured formats for analysis and reporting.
</li>
<li>Utilize tools such as Hive, HBase, MapReduce, and Spark for both real-time and batch data processing.
</li>
<li>Manage and optimize relational and NoSQL databases (including Vertica) and write complex SQL queries for data manipulation.
</li>
<li>Automate data workflows and routine processes through shell scripting and related automation tools.
</li>
<li>Enhance performance, scalability, and cost efficiency across data storage, retrieval, and transformation layers.
</li>
<li>Partner with data analysts, data scientists, and business teams to deliver reliable, high-quality data solutions.
</li>
<li>Monitor ETL processes for data accuracy, troubleshoot issues, and ensure data integrity across environments.
</li>
<li>Maintain detailed documentation of pipelines, workflows, and processes for transparency and continuity.</li></ul> 

<h4 class="jobSectionHeader">Requirements:</h4>
<ul>
<li>3&ndash;4 years of experience in data engineering, data integration, or a similar role.
</li>
<li>Strong hands-on experience with the Hadoop ecosystem (HDFS, Hive, HBase, MapReduce).
</li>
<li>Proficiency in Apache Spark for large-scale data processing.
</li>
<li>Advanced SQL skills and experience working with Vertica and other relational/NoSQL databases.
</li>
<li>Familiarity with ETL processes, data integration, and transformation best practices.
</li>
<li>Proficiency in shell scripting for automating data workflows.
</li>
<li>Experience with data pipeline orchestration tools (e.g., Airflow, Oozie, or similar) is a plus.
</li>
<li>Strong problem-solving and troubleshooting skills with high attention to detail.</li></ul></div><div></div>

Senior Consultant Data Analytics

digital.enterprises

<div>
 
 Data Engineer - Build the Data Backbone of ADAPT
 
 
 
 
 About Digital.enterprises
 
 
 
 digital.enterprises is shaping the future of the energy sector.
 
 
 We help companies run smarter integrating people, data, and technology to create intelligent, adaptive, and human-centred operations.
 
 
 Based in Doha, the gas capital of the world, we bring deep industry expertise together with cutting-edge digital thinking to transform how energy companies work, connect, and grow.
 
 
 If youre driven by impact, speed, and purpose not titles or bureaucracy youll fit right in.
 
 
 
 About ADAPT
 
 
 
 ADAPT is our flagship digital platform a real-time digital mesh connecting the energy sectors Maintenance, Repair &amp; Operations (MRO) ecosystem.
 
 
 It replaces slow, fragmented processes with real-time intelligence and automation, connecting operators, contractors, and suppliers through live data, adaptive analytics, and secure, human-in-the-loop governance.
 
 
 Built on Microsoft cloud and AI, ADAPT delivers visibility, intelligence, and agility at industrial scale redefining how energy companies collaborate and compete.
 
 
 
 About The Role
 
 
 
 We are hiring a Data Engineer to design and build secure, scalable data infrastructure for the energy sector. This role focuses on developing robust, high-performance data solutions that enable seamless connectivity across the supply chain from urgent maintenance events to complex planned turnarounds.
 
 
 You will help create the real-time data foundation that powers ADAPT, providing instant visibility and insights that drive smarter, faster, and safer decisions in mission-critical environments.
 
 
 The ideal candidate will have at least five years professional experience and demonstrate excellence in building well-documented, secure, and reliable data solutions that underpin digital transformation at scale.
 
 
 
 Key Responsibilities
 
 
 
 Data Pipeline Development &amp; Optimisation
 
 
 <ul>
 <li>
 Design and implement highly optimised pipelines for processing large-scale supply-chain data supplier performance, inventory, procurement transactions, and real-time equipment status.
 </li>
 <li>
 Develop maintainable ETL/ELT processes supporting both planned and emergency operations, with emphasis on code reusability and long-term stability for 24/7 uptime.
 </li>
 <li>
 Optimise performance to ensure sub-second response for live dashboards and supplier availability.
 </li>
 <li>
 Build automated data-quality frameworks to validate supplier qualifications, inventory accuracy, and compliance data essential to safety and reliability.
 </li>
 <li>
 Support real-time analytics through streaming data pipelines powering live operational intelligence.
 
 
 
 </li>
 </ul>
 Security &amp; Compliance
 
 
 <ul>
 <li>
 Implement strong data-security controls encryption, access management, and masking.
 </li>
 <li>
 Design and enforce data-governance policies aligned with international standards (GDPR, HIPAA, etc.).
 </li>
 <li>
 Conduct regular security audits and vulnerability assessments of data systems.
 </li>
 <li>
 Apply row- and column-level security to protect sensitive data where required.
 
 
 
 </li>
 </ul>
 
 
 
 Azure Cloud Infrastructure
 
 
 
 
 
 <ul>
 <li>
 Architect and maintain data solutions using Azure Data Factory, Databricks, Synapse Analytics, and Data Lake Storage.
 </li>
 <li>
 Integrate Azure Key Vault, Active Directory, and managed identities for secure operations.
 </li>
 <li>
 Optimise Azure resources for cost efficiency and performance.
 </li>
 <li>
 Design and implement backup and disaster-recovery strategies.
 </li>
 <li>
 Leverage Azure Monitor and Application Insights for proactive monitoring and alerting.
 
 
 
 </li>
 </ul>
 
 
 
 Maintainability &amp; Documentation
 
 
 
 
 
 <ul>
 <li>
 Create comprehensive technical documentation for pipelines, architectures, and processes.
 </li>
 <li>
 Maintain detailed runbooks and operational procedures.
 </li>
 <li>
 Implement version control and CI/CD pipelines for data workflows.
 </li>
 <li>
 Document data lineage, transformation logic, and metadata repositories.
 
 
 
 </li>
 </ul>
 
 Communication &amp; Collaboration
 
 
 
 <ul>
 <li>
 Communicate technical concepts clearly to both technical and business stakeholders.
 </li>
 <li>
 Collaborate with developers, analysts, and business teams to translate requirements into data solutions.
 </li>
 <li>
 Provide regular status updates and progress reports to management.
 
 
 
 </li>
 </ul>
 
 System Maintenance &amp; Optimisation
 
 
 
 <ul>
 <li>
 Monitor system health proactively and implement preventive maintenance.
 </li>
 <li>
 Design with maintainability at the core for fast troubleshooting and iteration.
 </li>
 <li>
 Implement automated testing for pipelines.
 </li>
 <li>
 Define and uphold SLAs for data availability and quality.
 </li>
 <li>
 Optimise storage and retention for cost-effectiveness.
 
 
 
 </li>
 </ul>
 
 Requirements
 
 
 
 
 Education &amp; Experience
 
 
 
 <ul>
 <li>
 Bachelors degree in Computer Science, Engineering, or Information Systems.
 </li>
 <li>
 Minimum 5 years professional experience in data engineering or related fields.
 </li>
 <li>
 Proven success designing and implementing enterprise-scale data solutions.
 
 
 
 </li>
 </ul>
 
 Technical Skills
 
 
 
 <ul>
 <li>
 Hands-on expertise with Azure data services Data Factory, Databricks, Synapse Analytics, Data Lake.
 </li>
 <li>
 Proficiency in Python, SQL, Scala, or C#.
 </li>
 <li>
 Experience implementing data-security and access-control mechanisms.
 </li>
 <li>
 Strong knowledge of database-performance optimisation.
 </li>
 <li>
 Proficiency in data-quality and governance frameworks.
 </li>
 <li>
 Understanding of batch and real-time processing architectures.
 
 
 
 </li>
 </ul>
 
 Core Competencies
 
 
 
 <ul>
 <li>
 Documentation excellence: produces clear, thorough, and maintainable documentation.
 </li>
 <li>
 Communication: clear, confident, and adaptable to diverse audiences.
 </li>
 <li>
 Security mindset: embeds data protection into every design decision.
 </li>
 <li>
 Optimisation focus: constantly seeks performance and cost improvements.
 </li>
 <li>
 Maintainability approach: builds systems designed for the long term.
 </li>
 <li>
 Willingness to travel for client implementations and support.
 
 
 
 </li>
 </ul>
 Why Join Us
 
 
 At digital.enterprises, youll help build the data engine that transforms how energy ecosystems operate.
 
 
 Your work will empower people across plants, control rooms, and offices to make decisions in real time supported by data that is secure, trustworthy, and always available.
 
 
 This is your opportunity to contribute to Industry 5.0 in action technology amplifying human capability to deliver safer, cleaner, and more reliable energy for everyone.
</div>

Data Engineer

Assurety Consulting & Solutions Pvt. ltd

Assurety Consulting is looking for a skilled Data Engineer to design, develop, and maintain robust data solutions. The ideal candidate will have hands-on experience with SQL Server, SSIS, and Azure Data Factory, along with strong knowledge of ETL processes and data optimization.Key Responsibilities:<ul><li>Develop, optimize, and maintain ETL pipelines and data workflows.</li><li>Work with SQL Server and Azure Data Factory (ADF) for data integration.</li><li>Implement data warehousing, data lake, and data modeling solutions.</li><li>Collaborate with business and analytics teams to ensure reliable data delivery.</li><li>Improve data quality, performance, and scalability.</li></ul>Requirements:<ul><li>Bachelor&rsquo;s degree in Computer Science, Information Systems, or a related field.</li><li>Minimum 3 years of experience as a Data Engineer.</li><li>Strong expertise in SQL Server, SSIS, and Azure Data Factory (ADF).</li><li>Experience in ETL, Data Warehousing, and performance optimization.</li><li>Excellent analytical and problem-solving skills.</li></ul>Why Join Us:<ul><li>Collaborative and growth-oriented work environment.</li><li>Opportunity to work with cutting-edge data technologies.</li><li>Clear career progression paths and skill-building opportunities.</li></ul>Location: Shahrah - e - Faisal, KarachiJob Type: Full-timeWork Location: In person

Confiz

<div>We are seeking an experienced Azure Data Engineer (5+ years) with strong expertise in data warehousing on lakehouse architecture, data engineering, data quality, and governance. The ideal candidate will design and build scalable data pipelines on Microsoft Fabric, implement data quality frameworks, and operationalize governance processes using Microsoft Purview. This role combines technical delivery with data compliance, ensuring trusted and well-governed data across the organization.
Key Responsibilities
<ul><li>Design and develop batch data pipelines using Fabric Pipelines and PySpark.</li>
<li>Implement data quality rules, validation checks, and monitoring dashboards.</li>
<li>Develop data catalog, lineage, classification, and business glossary in Microsoft Purview.</li>
<li>Enforce data governance policies, standards, and best practices across Microsoft Fabric</li>
<li>Collaborate with DevOps to automate deployments using Azure DevOps.</li>
<li>Integrate data quality in CI/CD pipelines through Azure DevOps.</li>
<li>Ensure compliance with data privacy regulations (e.g., PDPL).</li>
<li>Partner with business and data stewards to improve overall data integrity and usability.</li>
</ul>
Required Skills &amp; Experience
<ul><li>5+ years of experience in data engineering, quality, and governance roles.</li>
<li>Strong hands-on experience with Azure Data Factory, Apache Spark (PySpark), and Azure Synapse/Fabric.</li>
<li>Proven expertise in Microsoft Purview for governance and catalog management.</li>
<li>Proficient in Python and SQL for data processing and validation.</li>
<li>Understanding of data quality dimensions, profiling, and cleansing techniques.</li>
<li>Strong analytical, problem-solving, and communication skills.</li>
<li>Experience with Great Expectations or similar data validation tools is a plus.</li>
</ul>
Preferred Qualifications
<ul><li>Microsoft Certified: Fabric Data Engineer Associate or equivalent certification.</li>
<li>Experience with Microsoft Fabric and AI-driven metadata or quality tools.</li>
</ul>
We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015, 27001:2013 &amp; 20000-1:2018 certified. We have a vibrant culture of learning via collaboration and making the workplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/</div>

Principal Data Engineer – Data Quality & Governance

DM Clinical Research

<div>The Junior Data Engineer will be responsible for creating, maintaining, and modifying data pipelines for the reporting and system&rsquo;s needs. 
DUTIES &amp; RESPONSIBILITIES 
<ul><li>
Design, build, and orchestrate scalable data workflows and architecture aligned with business goals. Develop and maintain robust batch and real-time data pipelines using modern tools and platforms.</li><li>
Manage structured and unstructured databases with a focus on performance, availability, and optimisation</li><li>
Ensure high standards of data quality, consistency, and accessibility across integrated systems</li><li>
Collaborate with cross-functional teams to gather requirements and translate them into data solutions</li><li>
Implement data governance standards covering security, privacy, and compliance</li><li>
Proactively monitor and troubleshoot system performance, ensuring uptime and reliability of pipelines</li><li>
Transform raw data into clean, well-documented, and report-ready datasets</li><li>
Maintain clear documentation of data processes, workflows, and architecture for knowledge sharing</li><li>
Other duties as assigned by the manager</li></ul> 
KNOWLEDGE &amp; EXPERIENCE 
Education:<ul><li>
Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Data Engineering, or a related field</li></ul> 
Experience:<ul><li>
3+ years of experience working with data-driven solutions, with a focus on transforming healthcare or operational datasets into actionable insights to support process improvement and analytics initiatives.</li><li>
2+ years of experience collaborating with stakeholders to design, build, and deploy scalable data engineering deliverables, including data pipelines, ETL workflows, and integrated data models tailored for analytical needs</li><li>
2+ years of experience creating and maintaining self-service data infrastructure, such as datasets, dashboards, and backend integrations that empower end-users to explore metrics and monitor KPIs through BI tools</li></ul> 
Credentials:<ul><li>
Industry certifications in data engineering or cloud platforms/frameworks.</li></ul> 
Knowledge and Skills:<ul><li>
Data architecture design and data modeling (relational &amp; dimensional), Development of batch and real-time data pipelines using ETL/ELT tools</li><li>
Strong proficiency in SQL, Python, and optionally Scala/Java</li><li>
Hands-on experience with cloud platforms: AWS, Azure, GCP</li><li>
Advanced database management with SQL Server, PostgreSQL, MongoDB, etc.</li><li>
Experience with big data technologies like Spark, Hadoop, and Kafka</li><li>
Data quality assurance, profiling, cleansing, and governance practices</li><li>
Use of orchestration and workflow tools such as Apache Airflow, DBT, and Talend</li><li>
Expertise in Microsoft Excel (pivot tables, macros, Google scripts)</li><li>
Familiar with documentation and design tools: Microsoft Word, PowerPoint, Visio, G Suite</li><li>
Skilled in handling and optimizing large-scale datasets and infrastructure</li></ul></div>

Junior Data Engineer

NorthBay - Pakistan

<div>
 
 Position: Database Engineer (Migration)
 
 
 
 
 Location:
 
 Lahore / Karachi / Islamabad (Hybrid)
 
 
 
 Experience:
 
 3+ Years of Relevant Experience
 
 
 
 Salary Range:
 
 PKR 250,000 &ndash; 350,000 per month
 
 
 
 About The Role
 
 
 
 NorthBay is seeking skilled
 
 Database Engineers
 
 with hands-on experience in
 
 database management, administration, and migrations
 
 . The ideal candidate will possess in-depth knowledge of database engines, schema design, and performance optimization &mdash; with a focus on
 
 migrating databases across platforms such as PostgreSQL, MongoDB, DocumentDB, MySQL, and Oracle
 
 using
 
 AWS Database Migration Services (DMS)
 
 .
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Collaborate with technical leads to ensure smooth and successful database migrations.
 </li>
 <li>
 Design and implement database migration strategies, ensuring integrity, security, and performance post-migration.
 </li>
 <li>
 Conduct data and object validation to verify database readiness after migration.
 </li>
 <li>
 Troubleshoot, monitor, and optimize database performance using appropriate tools and methodologies.
 </li>
 <li>
 Work closely with application teams to ensure business functionality and SLAs are met.
 </li>
 <li>
 Support backup, recovery, replication, and clustering operations.
 </li>
 <li>
 Analyze complex database workloads (OLTP/OLAP) and provide recommendations for optimization.
 </li>
 <li>
 Participate in data engineering and ETL/ELT pipeline activities as needed.
 
 
 </li>
 </ul>
 
 Required Skills &amp; Experience
 
 
 
 <ul>
 <li>
 Minimum 3 years of experience in database deployment, administration, and migration.
 </li>
 <li>
 Strong experience with PostgreSQL, DocumentDB/MongoDB, and AWS DMS.
 </li>
 <li>
 Proficient in backup/recovery, replication, sharding, and CDC processes.
 </li>
 <li>
 Solid understanding of NoSQL databases; experience with DocumentDB is a plus.
 </li>
 <li>
 Exposure to data pipeline and data engineering workflows.
 </li>
 <li>
 Strong troubleshooting, diagnostic, and performance tuning skills.
 </li>
 <li>
 Good understanding of RBAC, database security, and logical/physical database structures.
 </li>
 <li>
 Excellent problem-solving and communication skills.
 
 
 </li>
 </ul>
 
 What We Offer
 
 
 
 <ul>
 <li>
 Competitive salary and benefits package.
 </li>
 <li>
 Fuel expense reimbursement.
 </li>
 <li>
 Paid holidays and vacation leaves.
 </li>
 <li>
 Medical outpatient reimbursement and health insurance coverage.
 </li>
 <li>
 A dynamic and collaborative environment with opportunities for professional growth.
 </li>
 </ul>
</div>

Database Engineer (Migration)

NorthBay Solutions

<div><h3 class="jobSectionHeader">Position: Database Engineer (Migration)</h3>
Location: Lahore / Karachi / Islamabad (Hybrid) 
Experience: 3+ Years of Relevant Experience 
Salary Range: PKR 250,000 &ndash; 350,000 per month<h4 class="jobSectionHeader">
About the Role</h4>
NorthBay is seeking skilled Database Engineers with hands-on experience in database management, administration, and migrations. The ideal candidate will possess in-depth knowledge of database engines, schema design, and performance optimization &mdash; with a focus on migrating databases across platforms such as PostgreSQL, MongoDB, DocumentDB, MySQL, and Oracle using AWS Database Migration Services (DMS).<h4 class="jobSectionHeader">
Key Responsibilities</h4><ul><li>
Collaborate with technical leads to ensure smooth and successful database migrations.</li><li>
Design and implement database migration strategies, ensuring integrity, security, and performance post-migration.</li><li>
Conduct data and object validation to verify database readiness after migration.</li><li>
Troubleshoot, monitor, and optimize database performance using appropriate tools and methodologies.</li><li>
Work closely with application teams to ensure business functionality and SLAs are met.</li><li>
Support backup, recovery, replication, and clustering operations.</li><li>
Analyze complex database workloads (OLTP/OLAP) and provide recommendations for optimization.</li><li>
Participate in data engineering and ETL/ELT pipeline activities as needed.</li></ul><h4 class="jobSectionHeader">
Required Skills &amp; Experience</h4><ul><li>
Minimum 3 years of experience in database deployment, administration, and migration.</li><li>
Strong experience with PostgreSQL, DocumentDB/MongoDB, and AWS DMS.</li><li>
Proficient in backup/recovery, replication, sharding, and CDC processes.</li><li>
Solid understanding of NoSQL databases; experience with DocumentDB is a plus.</li><li>
Exposure to data pipeline and data engineering workflows.</li><li>
Strong troubleshooting, diagnostic, and performance tuning skills.</li><li>
Good understanding of RBAC, database security, and logical/physical database structures.</li><li>
Excellent problem-solving and communication skills.</li></ul><h4 class="jobSectionHeader">
What We Offer</h4><ul><li>
Competitive salary and benefits package.</li><li>
Fuel expense reimbursement.</li><li>
Paid holidays and vacation leaves.</li><li>
Medical outpatient reimbursement and health insurance coverage.</li><li>
A dynamic and collaborative environment with opportunities for professional growth.</li></ul>
PO3sqopkFW</div>

Explore 931+ Data pipeline engineer in Karachi this October. Find roles across top companies and apply now to boost your career.

931 data pipeline engineer jobs IN Karachi

Senior Consultant Data Analytics

Data Engineer

Data Engineer

Principal Data Engineer – Data Quality & Governance

Junior Data Engineer

Database Engineer (Migration)

Database Engineer (Migration)