software engineer

data infrastructure engineer Jobs in Karachi

data infrastructure engineer

data scientist

ai/ml engineer

automation engineer

data engineer

NextGENi - A DotZero Company

<div>
 
 Job Details
 
 
 
 <ul>
 <li>
 Role: Data Engineer
 </li>
 <li>
 Location: Karachi (Onsite)
 </li>
 <li>
 Type: Full-Time
 </li>
 <li>
 Experience Range: 2-5 years
 
 
 </li>
 </ul>
 
 About NextGENi
 
 
 
 NextGENi (Next Generation Innovations) is transforming how regional startups build their technology teams. We help ambitious founders build and manage their offshore technology teams at twice the speed and fraction of the cost. We have built tech teams for some of the leading startups in the region including Careem, Dubizzle, and Kavak. Our mission is to create exceptional tech teams while maintaining an unparalleled culture and the highest regard for professional principles.
 
 
 
 About The Role
 
 
 
 We are looking for a Data Engineer to join our fast-paced and data-driven engineering team. In this role, the applicant will take ownership of data engineering solutions. As a client-facing professional, the selected applicant will be responsible for designing and implementing ETL pipelines and leveraging AWS services to manage and process large volumes of data efficiently.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Lead the design and implementation of ETL processes for data integration and transformation.
 </li>
 <li>
 Work extensively with AWS services including Lambda, Glue, Redshift, and QuickSight.
 </li>
 <li>
 Collaborate closely with clients and stakeholders to understand their data needs and provide strategic solutions.
 </li>
 <li>
 Ensure data quality, integrity, and scalability across various data systems.
 </li>
 <li>
 Optimize and maintain data pipelines and processes to meet performance standards.
 
 
 </li>
 </ul>
 
 Key Requirements
 
 
 
 <ul>
 <li>
 Extensive experience with ETL processes and data integration.
 </li>
 <li>
 Proficiency in AWS services such as Lambda, Glue, Redshift, and QuickSight.
 </li>
 <li>
 Strong communication skills with the ability to explain technical solutions.
 </li>
 <li>
 Ability to work independently and manage complex data engineering projects
 
 
 </li>
 </ul>
 
 Instructions to Apply
 
 
 
 To Apply, send your resumes to talent@nextgeni.com with subject mentioning &ldquo;NGI-DE-001&rsquo;&rsquo;
 
 
 
 Download a blank applicant form
 
 
 
 Download Form
 
 
 
 Disclaimer
 
 
 
 Kindly refrain from renaming this file or altering the form&rsquo;s format, as it may result in rejection by the ATS. member at NextGENi, and you have cleared the assignment.
</div>

Data Engineer

HR Ways

Client C&#65279;ompany Introduction: &#65279;*It is a leading &#65279;&#65279;*software engineering company delivering innovative, AI-powered platforms for global clients.&#65279;Opening: Data Engineer (AWS Integration)Key Responsibilities:Data Lake Architecture: -Design, implement, and maintain a data lake on AWS using Iceberg tables on S3, ensuring data consistency, high availability, and easy querying. &#65279; &#65279;-Work with AWS Glue for ETL processes, creating Glue jobs to process, transform, and load data from SQL Server and other sources into Iceberg tables. &#65279;&#65279;-Implement and optimize Spark-based data transformations in AWS Glue, ensuring efficient and scalable data workflows.&#65279; &#65279; &#65279;SQL Server to AWS Migration: &#65279;-Lead the migration of on-premises SQL Server data to AWS S3 using AWS Glue, DMS, and other relevant tools. &#65279;-Design and implement CDC (Change Data Capture) pipelines to enable real-time data replication from SQL Server to AWS services like S3, Iceberg, and Redshift. &#65279; &#65279;Data Integration &amp; Management: &#65279;-Design and implement data pipelines for batch and real-time data processing, leveraging AWS DMS, Kinesis, and Glue Streaming. &#65279;-Automate data loading, transformation, and archiving processes with Glue and ensure the correct data schema management and data governance. &#65279;-Set up and maintain data cataloging systems using AWS Glue Data Catalog to organize and manage metadata for Iceberg tables. &#65279; &#65279;Querying with Athena: &#65279;-Use AWS Athena for querying Iceberg tables on S3, enabling high-performance, low-latency SQL querying on large datasets stored in Iceberg format. &#65279;-Optimize Athena queries to improve performance and manage large-scale data sets effectively. &#65279;-Design efficient partitioning strategies and manage the Iceberg tables using Athena's native support for Iceberg. &#65279; &#65279;Continuous Improvement &amp; Optimization: &#65279;-Implement data compaction strategies to reduce small file issues in Iceberg and optimize storage and query performance. &#65279;-Continuously monitor, troubleshoot, and optimize data pipelines for performance, cost efficiency, and data quality. &#65279; &#65279;Collaboration &amp; Documentation: &#65279;-Work closely with data scientists, analysts, and business teams to understand data needs and develop solutions that support their goals. &#65279;-Provide clear documentation on architecture, solutions, and workflows to ensure smooth knowledge transfer and maintainability. &#65279; &#65279;Required Skills &amp; Qualifications: &#65279;Experience: &#65279;-Proven experience (3+ years) in data engineering roles with expertise in SQL Server, AWS services, and Iceberg. &#65279;-Hands-on experience with AWS Glue, AWS DMS, S3, and Kinesis in building scalable and reliable data pipelines. -Solid understanding of Change Data Capture (CDC) and its implementation with SQL Server and AWS DMS. &#65279;-Experience with Apache Iceberg for building data lakes and managing large-scale, versioned data on S3. &#65279;-Strong knowledge of ETL processes, data modeling, and data transformation using Spark and Glue. &#65279;-AWS Athena experience for querying and managing Iceberg tables in S3. &#65279; &#65279; Technical Skills: &#65279;-SQL Server: Expertise in database administration, SQL queries, stored procedures, and performance tuning. &#65279;-AWS Glue: Experience in creating, debugging, and deploying Glue jobs and managing Glue Data Catalog. &#65279;-AWS DMS: Experience with migrating and replicating data from SQL Server to AWS cloud services, including CDC. &#65279;-Apache Iceberg: Practical knowledge of Iceberg table formats, partitioning, compaction, and schema evolution. &#65279;-AWS S3: Experience managing large datasets in S3, implementing partitioning strategies, and optimizing storage. &#65279;-Kinesis: Familiarity with real-time streaming data pipelines using Kinesis Data Streams and Glue Streaming. &#65279;-AWS Athena: Strong experience querying Iceberg tables and optimizing large-scale data queries. &#65279; &#65279; Tools &amp; Technologies: &#65279;-Apache Spark (for Glue and standalone Spark jobs) &#65279;-SQL, Python, AWS SDK for automation, and scripting tasks. &#65279;-Data governance: Experience with AWS Lake Formation for security and access management in a data lake environment. &#65279; &#65279;Desired Soft Skills: &#65279;-Strong problem-solving skills with the ability to troubleshoot complex data issues. &#65279;-Ability to collaborate effectively with cross-functional teams (data scientists, analysts, DevOps, and stakeholders). &#65279;-Strong communication skills to document and explain technical concepts clearly to both technical and non-technical audiences. &#65279;-Detail-oriented with a focus on data quality, integrity, and performance.&#65279;Experience: 3 + years &#65279;Work Timings: (Monday to Fri:11:00 AM - 7:30 PM)&#65279; &#65279;Work Mode: (Hybrid - Karachi, Pakistan) &amp; (Hybrid - Kolkata and Ahmadabad, India) &#65279;Salary: Tax-free (USD)&#65279;&#65279;&#65279;&#65279;About HR Ways: HR Ways is an award-winning Technical Recruitment Firm helping software houses and IT Product companies internationally and locally to find IT Talent. HR Ways is engaged by 300+ Employers worldwide ranging from the world's biggest SaaS Companies to the most competitive Startups. We have entities in Dubai, Canada, the US, the UK, Pakistan, India, Saudi Arabia, Portugal, Brazil, and other parts of the world. Join our Whatsapp Channel https://shorturl.at/983az to stay updated or visit www.hrways.co to know more.Job Type: Full-timeWork Location: In person

About the job Data Engineer - (On-site | Karachi | PKR)Client company introduction: &#65279;The company is a growing consultancy specializing in data analytics, providing high-quality, impactful data solutions to clients based in the UK.Job Description: &#65279;*The Data Engineer *will play a pivotal role in shaping the companys data capabilities, working on projects for UK-based clients. Joining a new and dynamic team, this role offers the opportunity to implement best practices, introduce innovative tools and technologies, and contribute to tasks beyond traditional data engineering. The ideal candidate is proactive, versatile, and eager to make their own mark in a startup-like environment. You will receive mentorship from the UK-based founder, fostering professional growth and the chance to significantly impact the company's success.Key Responsibilities:Design and Implement Data Infrastructure:<ul><li>Develop, maintain, and optimize scalable data pipelines and architectures to support data analytics projects.</li><li>Implement best practices in data warehousing, ETL/ELT processes, and data integration to ensure efficient data flow.</li><li>Introduce and leverage tools and technologies that enhance data processing and storage capabilities.</li></ul>Implement Best Practices and Innovation:<ul><li>Establish data engineering standards and procedures to ensure data integrity, quality, and security.</li><li>Stay abreast of emerging technologies and industry trends, integrating innovative solutions where appropriate.</li><li>Evaluate and introduce tools (e.g., data pipeline frameworks, automation scripts) to improve workflow efficiency.</li></ul>Dynamic Role in a Startup Environment:<ul><li>Contribute to various aspects of the business, such as assisting with technical input for the company website, supporting social media initiatives, or aiding in recruitment efforts as needed.</li><li>Embrace the flexibility of a startup setting, proactively addressing challenges and seizing opportunities to add value.</li></ul>Collaboration and Team Support:<ul><li>Work closely with data analysts, project managers, and other team members to understand data requirements and deliver optimal solutions.</li><li>Participate in team meetings, providing technical insights and contributing to project planning and execution.</li><li>Mentor junior team members, sharing knowledge and fostering a collaborative learning environment.</li></ul>Client Engagement:<ul><li>Occasionally interact with UK-based clients to understand their data needs, provide updates, and ensure satisfaction with data solutions.</li><li>Translate complex technical concepts into clear, understandable language for clients and non-technical stakeholders.</li></ul>Data Quality and Continuous Improvement:<ul><li>Implement data validation and monitoring processes to maintain high data quality and reliability.</li><li>Gather feedback on data solutions and processes, identifying areas for improvement and implementing enhancements.</li><li>Track and report on data engineering metrics to monitor performance and identify optimization opportunities.</li></ul>Qualifications:<ul><li>Bachelor's degree in Computer Science, Information Systems, or a related field.</li><li>Minimum of 3 years of experience in data engineering, preferably within data analytics or consulting environments.</li><li>Proficiency in SQL and programming languages such as Python or Java.</li><li>Experience with cloud-based data services (e.g., Azure Data Factory, Azure SQL Database) and familiarity with Power BI integration.</li><li>Strong understanding of data warehousing concepts, ETL/ELT processes, and best practices in data management.</li><li>Excellent problem-solving skills and the ability to work independently in a dynamic environment.</li><li>Strong communication skills, with the ability to convey complex technical information to both technical and non-technical audiences.</li><li>A proactive mindset with a passion for innovation and continuous improvement.</li></ul>What We Offer:<ul><li>Opportunity to Make Your Mark: Join a growing team where your contributions will have a significant impact on the company's success.</li><li>Mentorship: Work closely with the UK-based founder, gaining valuable insights and advancing your professional development.</li><li>Dynamic Environment: Experience the excitement and challenges of a startup-like setting, where flexibility and innovation are highly valued.</li></ul>Client Exposure: Collaborate with UK-based clients, enhancing your international experience and expanding your professional network&#65279;Other Details:<ul><li>Experience: 3 years or above</li><li>Location: Karachi, Pakistan (on-site)</li><li>&#65279;Timings: 12:00PM - 9:00PM Summer &amp; 1:00PM - 10:00PM Winter</li><li>Working Days: Monday to Friday</li></ul>Apply at jobs@hrways.co (not com)&#65279;About HR Ways: &#65279;&#65279;&#65279;HR Ways is an Award winning Technical Recruitment Firm helping software houses and IT Product companies internationally and locally to find IT Talent. HR Ways is engaged by 300+ Employers worldwide ranging from worlds biggest SaaS Companies to most competitive Startups. We have entities in Dubai, Canada, US, UK, Pakistan, India, Saudi Arabia, Portugal, Brazil and other parts of the world. Join our WhatsApp Channel https://shorturl.at/983az to stay updated or visit www.hrways.co to know more.Job Type: Full-timeWork Location: In person

Datamatics Global Services Ltd

<div><h2 class="jobSectionHeader">Cloudera Data Engineer</h2>
Location: Remote (UAE Time Zone) 
Experience: 5+ Years 
Availability: Immediate joiners or candidates who can start within 30 days preferred<h3 class="jobSectionHeader">
Role Overview</h3>
We are seeking an experienced Cloudera Data Engineer to design, build, and maintain data pipelines and processing frameworks across Cloudera&rsquo;s ecosystem. The ideal candidate will have strong expertise in Spark, Hive, Impala, NiFi, and Oozie, and proven experience optimizing large-scale data pipelines for performance and reliability.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, build, and maintain ETL/ELT pipelines using Spark, Hive, Impala, NiFi, and Oozie.</li><li>
Optimize data pipelines for performance, reliability, and cost efficiency across batch and streaming workloads.</li><li>
Develop automation scripts and reusable frameworks for data ingestion, transformation, and cleansing.</li><li>
Collaborate with Cloudera Administrators to tune performance and manage cluster resources efficiently.</li><li>
Troubleshoot and resolve data pipeline failures, performance bottlenecks, and data quality issues.</li><li>
Monitor cluster utilization, job performance, and data throughput using Cloudera Manager.</li><li>
Work with DevOps/Infrastructure teams to define and maintain CI/CD pipelines, automation for deployments, and monitoring of data jobs.</li><li>
Participate in incident management, root cause analysis, and preventive maintenance.</li><li>
Ensure pipelines meet SLAs, data quality, and latency requirements for analytics workloads.</li></ul><h3 class="jobSectionHeader">
Requirements</h3><ul><li>
5+ years of experience as a Data Engineer in a Cloudera-based environment.</li><li>
Strong hands-on experience with Spark, Hive, Impala, NiFi, and Oozie.</li><li>
Solid understanding of ETL design, performance optimization, and data governance principles.</li><li>
Experience with Linux/Unix scripting and CI/CD integration.</li><li>
Excellent troubleshooting and communication skills.</li></ul>
BJoI7cAFtW</div>

Cloudera Data Engineer

VIRTUOSOFT

Job Summary:We are seeking a Junior Data Engineer with strong logical thinking, fast query-writing ability, and a passion for learning modern data technologies. The ideal candidate will support the development of data pipelines, data models, ETL processes, and reporting solutions using SQL, Python, and cloud platforms. This role is perfect for someone who is eager to grow in the data engineering domain.Key Responsibilities<ul><li>Develop, test, and maintain data pipelines using SQL and Python</li><li>Assist in building and optimizing data models for analytics and reporting</li><li>Support ETL/ELT processes and ensure smooth data flow across systems</li><li>Work with data warehousing concepts to improve data availability and quality</li><li>Write efficient, optimized SQL queries for reporting and analytics</li><li>Assist with dashboard/report development using Power BI</li><li>Work with cloud platforms such as AWS (EC2, Lambda, Redshift) and GCP at a basic level</li><li>Collaborate with senior data engineers and analysts to support ongoing projects</li><li>Troubleshoot data issues and ensure data accuracy and reliability</li></ul>Required Skills &amp; Qualifications<ul><li>6&ndash;18 months of experience in Data Engineering or a similar role</li><li>Strong logical thinking and problem-solving skills</li><li>Fast and efficient SQL query writing</li><li>Basic to intermediate Python programming skills</li><li>Understanding of Data Warehousing principles</li><li>Knowledge of ETL/ELT processes</li><li>Basic understanding of data modeling</li><li>Familiarity with Power BI</li><li>Basic knowledge of AWS services (EC2, Lambda, Redshift) and/or GCP</li></ul>Preferred Attributes<ul><li>Eagerness to learn new data tools and cloud technologies</li><li>Strong communication and teamwork skills</li><li>Ability to adapt quickly to new platforms and tasks</li></ul>Job Type: Full-timeWork Location: In person

Junior Data Engineer

Godai Tech

About GodaitecAt Godaitec, we are a full-service technology thought partner dedicated to empowering innovation. We blend creativity, strategy, and technology to transform ideas into scalable, future-ready solutions. From Software Development and Solution Consulting to cutting-edge Data Analytics and Emerging Technologies (AI, IoT, Blockchain), we help businesses turn their data into strategic value.We are looking for a passionate Data Engineer to join our growing team. If you are driven by building robust data ecosystems and have a knack for solving complex data challenges, we want to hear from you.Role OverviewWe are seeking a skilled Data Engineer with up to 2 years of hands-on experience to build, optimize, and maintain our data infrastructure. You will play a critical role in our Data Analytics vertical, working on high-impact projects involving ETL pipelines, cloud data warehousing, and data governance. You will bridge the gap between raw data and actionable insights, ensuring our clients can make smarter, faster decisions.Key Responsibilities<ul><li>Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using industry-standard tools (Informatica, Talend, Spark) to ingest data from various sources.</li><li>Data Modeling &amp; Architecture: Develop robust data models and architectures that support business intelligence and advanced analytics requirements.</li><li>Cloud Data Engineering: Implement and manage data solutions on cloud platforms (Databricks, Azure, AWS, or GCP).</li><li>Data Quality &amp; Governance: Establish frameworks for data quality, reliability, and governance to ensure data accuracy and compliance across the organization.</li><li>Orchestration &amp; Automation: Schedule and monitor workflows using orchestration tools like Airflow or Prefect to ensure timely data delivery.</li><li>Containerization &amp; CI/CD: Utilize Docker and Kubernetes for containerization and Jenkins for CI/CD pipelines to streamline deployment processes.</li><li>Collaboration: Work closely with Data Scientists and Analysts to prepare data for visualization and machine learning models.</li></ul>Candidate Profile &amp; Requirements1. Education &amp; Experience<ul><li>Bachelor&rsquo;s degree in computer science, Mathematics and statistics, or a related field.</li><li>Up to 2 years of proven hands-on experience in data engineering.</li><li>I must have prior experience working on Data Modeling, Data Operations, ETL pipelines, Data Quality, and Governance related projects.</li></ul>2. Technical Proficiency<ul><li>ETL &amp; Big Data: Strong proficiency in tools like Informatica or Talend. Experience with Big Data technologies such as Hadoop, Spark, and Kafka.</li><li>Languages &amp; Frameworks: Expert-level SQL and Python skills. Experience with Linux environments and PySpark for large-scale data processing.</li><li>Cloud Platforms: Hands-on experience with Databricks and major cloud providers (Azure, AWS, or GCP).</li><li>Orchestration: Proficiency in workflow management using Apache Airflow or Prefect.</li><li>Containerization &amp; CI/CD: Familiarity with Jenkins, Docker, and Kubernetes for deploying and scaling applications.</li><li>Data Visualization: Ability to integrate data with visualization tools like Tableau or Power BI, and Python libraries like Matplotlib or Seaborn.</li></ul>3. &quot;Good to Have&quot; (Bonus Skills)<ul><li>Generative AI &amp; Agentic AI: Knowledge of or interest in GenAI applications and Agentic AI workflows is a significant plus as we expand into emerging technologies.</li><li>Certifications: Any active Data Engineering certification from GCP, AWS, or Azure will be considered a strong advantage.</li></ul>Why Join Godaitec?<ul><li>Work on Emerging Tech: Get the chance to work not just on traditional data stacks but also explore AI, IoT, and Blockchain integrations.</li><li>Growth &amp; Learning: We are a learning-centric organization that supports your professional development through exposure to diverse industries (Finance, Healthcare, Retail, etc.).</li><li>Impact: Your work will directly influence the strategic decisions of global clients.</li></ul>Job Type: Full-timeEducation:<ul><li>Bachelor's (Preferred)</li></ul>Location:<ul><li>Karachi (Preferred)</li></ul>Work Location: In person

Data Engineer (Mid-Level)

NorthBay Solutions

<div><h3 class="jobSectionHeader">Position: Senior Data Engineer (Migration / NoSQL / SQL)</h3>
Location: Lahore / Islamabad / Karachi (Hybrid) 
Experience: Up to 3 Years of Relevant Experience 
Salary: Up to PKR 350,000 
Company: NorthBay Solutions 
 
About the Role:
NorthBay is looking for a Senior Data Engineer with a strong passion for database management, data engineering, and migration projects. The ideal candidate will have a solid understanding of database systems, data migration frameworks, and AWS cloud data services. This role involves working on complex migration projects across PostgreSQL, MongoDB, DocumentDB, MySQL, and Oracle databases using AWS Database Migration Services (AWS DMS) and other modern data tools. 
 
Key Responsibilities:<ul><li>
Support and execute database migration initiatives across multiple database platforms and AWS environments.</li><li>
Collaborate with technical leads to ensure successful, secure, and validated database migrations.</li><li>
Develop and maintain data validation plans, migration scripts, and testing frameworks.</li><li>
Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration.</li><li>
Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability.</li><li>
Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies.</li><li>
Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices</li></ul>
Requirements:<ul><li>
Up to 3 years of relevant experience in database deployment, management, or migration.</li><li>
Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle.</li><li>
Experience using AWS Database Migration Services (AWS DMS) for data migration projects.</li><li>
Knowledge of NoSQL databases and DocumentDB is a plus.</li><li>
Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration.</li><li>
Familiarity with backup/recovery, replication, and clustering concepts.</li><li>
Strong analytical, problem-solving, and communication skills.</li></ul><h3 class="jobSectionHeader">
What We Offer:</h3><ul><li>
Competitive salary (up to PKR 350K)</li><li>
Fuel expense reimbursement</li><li>
Paid holidays and vacation</li><li>
Medical outpatient reimbursement &amp; health insurance</li><li>
Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects</li></ul>
fHRARfeHLY</div>

Senior Data Engineer (Migration / NoSQL / SQL)

Explore 969+ Data engineer in Karachi this December. Find roles across top companies and apply now to boost your career.

969 data engineer jobs IN Karachi

Data Engineer

Data Engineer

Data Engineer

Cloudera Data Engineer

Junior Data Engineer

Data Engineer (Mid-Level)

Senior Data Engineer (Migration / NoSQL / SQL)