software engineer

full stack engineer

backend engineer

data & reporting analyst

data engineer

big data engineer

Systems Limited

<div><h4 class="jobSectionHeader">We are looking for a Data Engineer with 3&ndash;4 years of experience in data engineering, data integration, or a related role.</h4>
<h4 class="jobSectionHeader">Responsibilities</h4>
<ul>
<li>Develop scalable ETL processes using Spark, Hadoop, and other big data technologies.
</li>
<li>Design, test, and maintain pipelines that transform raw data into structured formats for analysis and reporting.
</li>
<li>Utilize tools such as Hive, HBase, MapReduce, and Spark for both real-time and batch data processing.
</li>
<li>Manage and optimize relational and NoSQL databases (including Vertica) and write complex SQL queries for data manipulation.
</li>
<li>Automate data workflows and routine processes through shell scripting and related automation tools.
</li>
<li>Enhance performance, scalability, and cost efficiency across data storage, retrieval, and transformation layers.
</li>
<li>Partner with data analysts, data scientists, and business teams to deliver reliable, high-quality data solutions.
</li>
<li>Monitor ETL processes for data accuracy, troubleshoot issues, and ensure data integrity across environments.
</li>
<li>Maintain detailed documentation of pipelines, workflows, and processes for transparency and continuity.</li></ul> 

<h4 class="jobSectionHeader">Requirements:</h4>
<ul>
<li>3&ndash;4 years of experience in data engineering, data integration, or a similar role.
</li>
<li>Strong hands-on experience with the Hadoop ecosystem (HDFS, Hive, HBase, MapReduce).
</li>
<li>Proficiency in Apache Spark for large-scale data processing.
</li>
<li>Advanced SQL skills and experience working with Vertica and other relational/NoSQL databases.
</li>
<li>Familiarity with ETL processes, data integration, and transformation best practices.
</li>
<li>Proficiency in shell scripting for automating data workflows.
</li>
<li>Experience with data pipeline orchestration tools (e.g., Airflow, Oozie, or similar) is a plus.
</li>
<li>Strong problem-solving and troubleshooting skills with high attention to detail.</li></ul></div><div></div>

Senior Consultant Data Analytics

Assurety Consulting & Solutions Pvt. ltd

Assurety Consulting is looking for a skilled Data Engineer to design, develop, and maintain robust data solutions. The ideal candidate will have hands-on experience with SQL Server, SSIS, and Azure Data Factory, along with strong knowledge of ETL processes and data optimization.Key Responsibilities:<ul><li>Develop, optimize, and maintain ETL pipelines and data workflows.</li><li>Work with SQL Server and Azure Data Factory (ADF) for data integration.</li><li>Implement data warehousing, data lake, and data modeling solutions.</li><li>Collaborate with business and analytics teams to ensure reliable data delivery.</li><li>Improve data quality, performance, and scalability.</li></ul>Requirements:<ul><li>Bachelor&rsquo;s degree in Computer Science, Information Systems, or a related field.</li><li>Minimum 3 years of experience as a Data Engineer.</li><li>Strong expertise in SQL Server, SSIS, and Azure Data Factory (ADF).</li><li>Experience in ETL, Data Warehousing, and performance optimization.</li><li>Excellent analytical and problem-solving skills.</li></ul>Why Join Us:<ul><li>Collaborative and growth-oriented work environment.</li><li>Opportunity to work with cutting-edge data technologies.</li><li>Clear career progression paths and skill-building opportunities.</li></ul>Location: Shahrah - e - Faisal, KarachiJob Type: Full-timeWork Location: In person

Data Engineer

digital.enterprises

<div>
 
 Data Engineer - Build the Data Backbone of ADAPT
 
 
 
 
 About Digital.enterprises
 
 
 
 digital.enterprises is shaping the future of the energy sector.
 
 
 We help companies run smarter integrating people, data, and technology to create intelligent, adaptive, and human-centred operations.
 
 
 Based in Doha, the gas capital of the world, we bring deep industry expertise together with cutting-edge digital thinking to transform how energy companies work, connect, and grow.
 
 
 If youre driven by impact, speed, and purpose not titles or bureaucracy youll fit right in.
 
 
 
 About ADAPT
 
 
 
 ADAPT is our flagship digital platform a real-time digital mesh connecting the energy sectors Maintenance, Repair &amp; Operations (MRO) ecosystem.
 
 
 It replaces slow, fragmented processes with real-time intelligence and automation, connecting operators, contractors, and suppliers through live data, adaptive analytics, and secure, human-in-the-loop governance.
 
 
 Built on Microsoft cloud and AI, ADAPT delivers visibility, intelligence, and agility at industrial scale redefining how energy companies collaborate and compete.
 
 
 
 About The Role
 
 
 
 We are hiring a Data Engineer to design and build secure, scalable data infrastructure for the energy sector. This role focuses on developing robust, high-performance data solutions that enable seamless connectivity across the supply chain from urgent maintenance events to complex planned turnarounds.
 
 
 You will help create the real-time data foundation that powers ADAPT, providing instant visibility and insights that drive smarter, faster, and safer decisions in mission-critical environments.
 
 
 The ideal candidate will have at least five years professional experience and demonstrate excellence in building well-documented, secure, and reliable data solutions that underpin digital transformation at scale.
 
 
 
 Key Responsibilities
 
 
 
 Data Pipeline Development &amp; Optimisation
 
 
 <ul>
 <li>
 Design and implement highly optimised pipelines for processing large-scale supply-chain data supplier performance, inventory, procurement transactions, and real-time equipment status.
 </li>
 <li>
 Develop maintainable ETL/ELT processes supporting both planned and emergency operations, with emphasis on code reusability and long-term stability for 24/7 uptime.
 </li>
 <li>
 Optimise performance to ensure sub-second response for live dashboards and supplier availability.
 </li>
 <li>
 Build automated data-quality frameworks to validate supplier qualifications, inventory accuracy, and compliance data essential to safety and reliability.
 </li>
 <li>
 Support real-time analytics through streaming data pipelines powering live operational intelligence.
 
 
 
 </li>
 </ul>
 Security &amp; Compliance
 
 
 <ul>
 <li>
 Implement strong data-security controls encryption, access management, and masking.
 </li>
 <li>
 Design and enforce data-governance policies aligned with international standards (GDPR, HIPAA, etc.).
 </li>
 <li>
 Conduct regular security audits and vulnerability assessments of data systems.
 </li>
 <li>
 Apply row- and column-level security to protect sensitive data where required.
 
 
 
 </li>
 </ul>
 
 
 
 Azure Cloud Infrastructure
 
 
 
 
 
 <ul>
 <li>
 Architect and maintain data solutions using Azure Data Factory, Databricks, Synapse Analytics, and Data Lake Storage.
 </li>
 <li>
 Integrate Azure Key Vault, Active Directory, and managed identities for secure operations.
 </li>
 <li>
 Optimise Azure resources for cost efficiency and performance.
 </li>
 <li>
 Design and implement backup and disaster-recovery strategies.
 </li>
 <li>
 Leverage Azure Monitor and Application Insights for proactive monitoring and alerting.
 
 
 
 </li>
 </ul>
 
 
 
 Maintainability &amp; Documentation
 
 
 
 
 
 <ul>
 <li>
 Create comprehensive technical documentation for pipelines, architectures, and processes.
 </li>
 <li>
 Maintain detailed runbooks and operational procedures.
 </li>
 <li>
 Implement version control and CI/CD pipelines for data workflows.
 </li>
 <li>
 Document data lineage, transformation logic, and metadata repositories.
 
 
 
 </li>
 </ul>
 
 Communication &amp; Collaboration
 
 
 
 <ul>
 <li>
 Communicate technical concepts clearly to both technical and business stakeholders.
 </li>
 <li>
 Collaborate with developers, analysts, and business teams to translate requirements into data solutions.
 </li>
 <li>
 Provide regular status updates and progress reports to management.
 
 
 
 </li>
 </ul>
 
 System Maintenance &amp; Optimisation
 
 
 
 <ul>
 <li>
 Monitor system health proactively and implement preventive maintenance.
 </li>
 <li>
 Design with maintainability at the core for fast troubleshooting and iteration.
 </li>
 <li>
 Implement automated testing for pipelines.
 </li>
 <li>
 Define and uphold SLAs for data availability and quality.
 </li>
 <li>
 Optimise storage and retention for cost-effectiveness.
 
 
 
 </li>
 </ul>
 
 Requirements
 
 
 
 
 Education &amp; Experience
 
 
 
 <ul>
 <li>
 Bachelors degree in Computer Science, Engineering, or Information Systems.
 </li>
 <li>
 Minimum 5 years professional experience in data engineering or related fields.
 </li>
 <li>
 Proven success designing and implementing enterprise-scale data solutions.
 
 
 
 </li>
 </ul>
 
 Technical Skills
 
 
 
 <ul>
 <li>
 Hands-on expertise with Azure data services Data Factory, Databricks, Synapse Analytics, Data Lake.
 </li>
 <li>
 Proficiency in Python, SQL, Scala, or C#.
 </li>
 <li>
 Experience implementing data-security and access-control mechanisms.
 </li>
 <li>
 Strong knowledge of database-performance optimisation.
 </li>
 <li>
 Proficiency in data-quality and governance frameworks.
 </li>
 <li>
 Understanding of batch and real-time processing architectures.
 
 
 
 </li>
 </ul>
 
 Core Competencies
 
 
 
 <ul>
 <li>
 Documentation excellence: produces clear, thorough, and maintainable documentation.
 </li>
 <li>
 Communication: clear, confident, and adaptable to diverse audiences.
 </li>
 <li>
 Security mindset: embeds data protection into every design decision.
 </li>
 <li>
 Optimisation focus: constantly seeks performance and cost improvements.
 </li>
 <li>
 Maintainability approach: builds systems designed for the long term.
 </li>
 <li>
 Willingness to travel for client implementations and support.
 
 
 
 </li>
 </ul>
 Why Join Us
 
 
 At digital.enterprises, youll help build the data engine that transforms how energy ecosystems operate.
 
 
 Your work will empower people across plants, control rooms, and offices to make decisions in real time supported by data that is secure, trustworthy, and always available.
 
 
 This is your opportunity to contribute to Industry 5.0 in action technology amplifying human capability to deliver safer, cleaner, and more reliable energy for everyone.
</div>

<div>We are seeking a Senior Data Engineer with strong expertise in Informatica and SQL to design, develop, and optimize data pipelines and ETL workflows. The ideal candidate will have hands-on experience in data integration, data warehousing, and performance tuning across enterprise environments.
<h3 class="jobSectionHeader">
Responsibilities:</h3>
<ul>
<li>Design, build, and maintain ETL workflows using Informatica PowerCenter (or Informatica Cloud).
</li>
<li>Develop and optimize SQL queries, stored procedures, and views for data extraction and transformation.
</li>
<li>Work closely with data modelers, analysts, and business teams to understand data requirements.
</li>
<li>Ensure data quality, integrity, and consistency across multiple systems.
</li>
<li>Perform root cause analysis on data and ETL issues, ensuring timely resolution.
</li>
<li>Support data warehouse development and manage data integration across different sources.
</li>
<li>Monitor and enhance ETL performance, implementing best practices for scalability and reliability.
</li>
<li>Collaborate with infrastructure and DevOps teams for deployment and job scheduling (e.g., Autosys, Control-M).
</li>
</ul><h3 class="jobSectionHeader">Requirements</h3>
<ul>
<li>8&ndash;10 years of experience in Data Engineering or related roles.
</li>
<li>Strong hands-on experience with Informatica PowerCenter / IICS.
</li>
<li>Advanced proficiency in SQL (Oracle, SQL Server, or similar).
</li>
<li>Solid understanding of data warehousing concepts (Star/Snowflake schema, fact/dimension modeling).
</li>
<li>Experience with performance tuning of ETL processes and database queries.
</li>
<li>Familiarity with data governance, data quality, and metadata management practices.
</li>
<li>Experience working in cloud-based or hybrid data environments (Azure, AWS, or GCP) is a plus.
</li>
<li>Strong problem-solving skills and ability to work in cross-functional teams.</li></ul></div><div></div>

Principal Data Engineer

Confiz

<div>This role requires a professional with a deep background in data engineering and expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate will be a strategic thinker with a proven record of accomplishment of delivering scalable and efficient data solutions to meet complex business requirements.
Responsibilities:
<ul><li>Design and implement highly scalable, high performance data warehousing solutions in Azure Synapse.</li>
<li>Analyze and migrate existing data systems to Azure Cloud, optimizing data flow and collection to improve data accuracy and utility.</li>
<li>Contribute to data architecture design and modeling initiatives, ensuring alignment with business needs and compliance with data governance standards.</li>
<li>Consult with stakeholders to define data requirements, deliverables, and timelines, providing technical leadership and guidance throughout project lifecycles.</li>
<li>Implement data security and privacy policies in line with industry best practices and organizational standards.</li>
<li>Optimize data integration pipelines for performance and scalability.</li>
<li>Develop and maintain documentation regarding data architectures, procedures, and solutions.</li>
</ul>
Qualifications
<ul><li>Bachelor&rsquo;s or master's degree in computer science, Engineering, Information Technology, or a related field.</li>
<li>5+ years of experience in data engineering with a strong focus on cloud-based solutions.</li>
<li>Expertise in Azure Synapse Analytics, including data integration, management, and security.</li>
<li>Proficient with SQL, Python, PySpark, and other scripting languages commonly used in data engineering.</li>
<li>Familiar with Azure IaC (Infrastructure as Code) and CI/CD automation using ARM, Bicep or Terraform</li>
<li>Deep knowledge of ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes and experience with Azure Data Factory.</li>
<li>Strong understanding of data modeling (Data Vault 2.0 experience or certification preferred), data warehousing, and data lakes.</li>
<li>Proven consulting or advisory roles in the design and deployment of large-scale data solutions in Azure environments.</li>
<li>Experience working directly with clients or stakeholders in a consulting capacity, translating business needs into technical specifications and actionable plans.</li>
<li>Demonstrated ability to contribute to project leadership, coordinate across client functional groups, and manage client relationships.</li>
<li>Microsoft Certified: Azure Data Engineer Associate preferrable</li>
<li>Microsoft Certified: Azure Solutions Architect Expert preferrable</li>
<li>Certified Data Vault 2.0 Practitioner (CDVP2) preferrable</li>
</ul>
We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), ISO 14001:2015 (EMS), ISO 45001:2018 (OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/</div>

Azure Data Engineer - Pyspark

Enterprise64

<div>Overview 
Enterprise64 is a U.S.-based technology company that creates digital solutions for startups to Fortune 500 companies in the United States, Europe, and the United Arab Emirates. We are growing rapidly across all our global offices and have career opportunities for tech professionals who are looking to work in a fast-growing company, work in a fun environment, be challenged, grow, and fast-track their careers.
Job Overview 
We are hiring a Senior Python Backend Developer to join our dynamic team (Contract Role). The ideal candidate will have strong expertise in backend development, API design, and database optimization, ensuring high-performance, scalable, and secure applications. You will collaborate with cross-functional teams to build efficient, maintainable, and reliable backend solutions that drive our innovative products.
Key Responsibilities<ul><li>
Design, develop, and maintain ETL pipelines for large-scale data processing and integration.</li><li>
Work with AWS Glue, PySpark, and Apache Spark to process structured and unstructured data efficiently.</li><li>
Build and optimize data ingestion workflows from multiple sources into data lakes and warehouses.</li><li>
Ensure data quality, consistency, and reliability through validation and monitoring.</li><li>
Collaborate with cross-functional teams, including data scientists, analysts, and backend engineers, to deliver scalable data solutions.</li><li>
Implement and manage data transformation and schema evolution using AWS services (Glue, S3, Lambda, Redshift, etc.).</li><li>
Optimize Spark jobs for performance and cost efficiency.</li><li>
Develop and maintain metadata management and data cataloging in AWS Glue.</li><li>
Ensure adherence to data security, compliance, and governance best practices.</li><li>
Use Python for automation, data manipulation, and integration tasks.</li><li>
Implement CI/CD pipelines for data workflows and maintain infrastructure-as-code (IaC) using tools like Terraform or CloudFormation (a plus).</li></ul> 
Preferred Qualifications<ul><li>
Strong expertise in Python and PySpark for large-scale data processing.</li><li>
Hands-on experience with AWS Glue, AWS Lambda, S3, and Redshift.</li><li>
Solid understanding of ETL frameworks, data modeling, and data warehousing concepts.</li><li>
Experience with Apache Spark and distributed computing principles.</li><li>
Familiarity with workflow orchestration tools (e.g., Airflow, Step Functions).</li><li>
Knowledge of SQL and NoSQL databases for data querying and optimization.</li><li>
Strong problem-solving and debugging skills for data-intensive applications.</li><li>
Experience working in agile environments and collaborating with cross-functional teams.</li></ul></div>

Senior Python Developer - Contractor

DM Clinical Research

<div>The Junior Data Engineer will be responsible for creating, maintaining, and modifying data pipelines for the reporting and system&rsquo;s needs. 
DUTIES &amp; RESPONSIBILITIES 
<ul><li>
Design, build, and orchestrate scalable data workflows and architecture aligned with business goals. Develop and maintain robust batch and real-time data pipelines using modern tools and platforms.</li><li>
Manage structured and unstructured databases with a focus on performance, availability, and optimisation</li><li>
Ensure high standards of data quality, consistency, and accessibility across integrated systems</li><li>
Collaborate with cross-functional teams to gather requirements and translate them into data solutions</li><li>
Implement data governance standards covering security, privacy, and compliance</li><li>
Proactively monitor and troubleshoot system performance, ensuring uptime and reliability of pipelines</li><li>
Transform raw data into clean, well-documented, and report-ready datasets</li><li>
Maintain clear documentation of data processes, workflows, and architecture for knowledge sharing</li><li>
Other duties as assigned by the manager</li></ul> 
KNOWLEDGE &amp; EXPERIENCE 
Education:<ul><li>
Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Data Engineering, or a related field</li></ul> 
Experience:<ul><li>
3+ years of experience working with data-driven solutions, with a focus on transforming healthcare or operational datasets into actionable insights to support process improvement and analytics initiatives.</li><li>
2+ years of experience collaborating with stakeholders to design, build, and deploy scalable data engineering deliverables, including data pipelines, ETL workflows, and integrated data models tailored for analytical needs</li><li>
2+ years of experience creating and maintaining self-service data infrastructure, such as datasets, dashboards, and backend integrations that empower end-users to explore metrics and monitor KPIs through BI tools</li></ul> 
Credentials:<ul><li>
Industry certifications in data engineering or cloud platforms/frameworks.</li></ul> 
Knowledge and Skills:<ul><li>
Data architecture design and data modeling (relational &amp; dimensional), Development of batch and real-time data pipelines using ETL/ELT tools</li><li>
Strong proficiency in SQL, Python, and optionally Scala/Java</li><li>
Hands-on experience with cloud platforms: AWS, Azure, GCP</li><li>
Advanced database management with SQL Server, PostgreSQL, MongoDB, etc.</li><li>
Experience with big data technologies like Spark, Hadoop, and Kafka</li><li>
Data quality assurance, profiling, cleansing, and governance practices</li><li>
Use of orchestration and workflow tools such as Apache Airflow, DBT, and Talend</li><li>
Expertise in Microsoft Excel (pivot tables, macros, Google scripts)</li><li>
Familiar with documentation and design tools: Microsoft Word, PowerPoint, Visio, G Suite</li><li>
Skilled in handling and optimizing large-scale datasets and infrastructure</li></ul></div>

Junior Data Engineer

Explore 991+ Big data engineer in Karachi this October. Find roles across top companies and apply now to boost your career.

991 big data engineer jobs IN Karachi

Senior Consultant Data Analytics

Data Engineer

Data Engineer

Principal Data Engineer

Azure Data Engineer - Pyspark

Senior Python Developer - Contractor

Junior Data Engineer