data analyst

data engineer

data scientist

cloudera data engineer

senior ai engineer

big data engineer

Godai Tech

About GodaitecAt Godaitec, we are a full-service technology thought partner dedicated to empowering innovation. We blend creativity, strategy, and technology to transform ideas into scalable, future-ready solutions. From Software Development and Solution Consulting to cutting-edge Data Analytics and Emerging Technologies (AI, IoT, Blockchain), we help businesses turn their data into strategic value.We are looking for a passionate Data Engineer to join our growing team. If you are driven by building robust data ecosystems and have a knack for solving complex data challenges, we want to hear from you.Role OverviewWe are seeking a skilled Data Engineer with up to 2 years of hands-on experience to build, optimize, and maintain our data infrastructure. You will play a critical role in our Data Analytics vertical, working on high-impact projects involving ETL pipelines, cloud data warehousing, and data governance. You will bridge the gap between raw data and actionable insights, ensuring our clients can make smarter, faster decisions.Key Responsibilities<ul><li>Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using industry-standard tools (Informatica, Talend, Spark) to ingest data from various sources.</li><li>Data Modeling &amp; Architecture: Develop robust data models and architectures that support business intelligence and advanced analytics requirements.</li><li>Cloud Data Engineering: Implement and manage data solutions on cloud platforms (Databricks, Azure, AWS, or GCP).</li><li>Data Quality &amp; Governance: Establish frameworks for data quality, reliability, and governance to ensure data accuracy and compliance across the organization.</li><li>Orchestration &amp; Automation: Schedule and monitor workflows using orchestration tools like Airflow or Prefect to ensure timely data delivery.</li><li>Containerization &amp; CI/CD: Utilize Docker and Kubernetes for containerization and Jenkins for CI/CD pipelines to streamline deployment processes.</li><li>Collaboration: Work closely with Data Scientists and Analysts to prepare data for visualization and machine learning models.</li></ul>Candidate Profile &amp; Requirements1. Education &amp; Experience<ul><li>Bachelor&rsquo;s degree in computer science, Mathematics and statistics, or a related field.</li><li>Up to 2 years of proven hands-on experience in data engineering.</li><li>I must have prior experience working on Data Modeling, Data Operations, ETL pipelines, Data Quality, and Governance related projects.</li></ul>2. Technical Proficiency<ul><li>ETL &amp; Big Data: Strong proficiency in tools like Informatica or Talend. Experience with Big Data technologies such as Hadoop, Spark, and Kafka.</li><li>Languages &amp; Frameworks: Expert-level SQL and Python skills. Experience with Linux environments and PySpark for large-scale data processing.</li><li>Cloud Platforms: Hands-on experience with Databricks and major cloud providers (Azure, AWS, or GCP).</li><li>Orchestration: Proficiency in workflow management using Apache Airflow or Prefect.</li><li>Containerization &amp; CI/CD: Familiarity with Jenkins, Docker, and Kubernetes for deploying and scaling applications.</li><li>Data Visualization: Ability to integrate data with visualization tools like Tableau or Power BI, and Python libraries like Matplotlib or Seaborn.</li></ul>3. &quot;Good to Have&quot; (Bonus Skills)<ul><li>Generative AI &amp; Agentic AI: Knowledge of or interest in GenAI applications and Agentic AI workflows is a significant plus as we expand into emerging technologies.</li><li>Certifications: Any active Data Engineering certification from GCP, AWS, or Azure will be considered a strong advantage.</li></ul>Why Join Godaitec?<ul><li>Work on Emerging Tech: Get the chance to work not just on traditional data stacks but also explore AI, IoT, and Blockchain integrations.</li><li>Growth &amp; Learning: We are a learning-centric organization that supports your professional development through exposure to diverse industries (Finance, Healthcare, Retail, etc.).</li><li>Impact: Your work will directly influence the strategic decisions of global clients.</li></ul>Job Type: Full-timeEducation:<ul><li>Bachelor's (Preferred)</li></ul>Location:<ul><li>Karachi (Preferred)</li></ul>Work Location: In person

Data Engineer (Mid-Level)

Datamatics Technologies

<div>
 
 Cloudera Data Engineer
 
 
 
 Location:
 
 Remote (UAE Time Zone)
 
 
 Experience:
 
 5+ Years
 
 
 Availability:
 
 Immediate joiners or candidates who can start within 30 days preferred
 
 
 Role Overview
 
 
 We are seeking an experienced
 
 Cloudera Data Engineer
 
 to design, build, and maintain data pipelines and processing frameworks across Cloudera&rsquo;s ecosystem. The ideal candidate will have strong expertise in Spark, Hive, Impala, NiFi, and Oozie, and proven experience optimizing large-scale data pipelines for performance and reliability.
 
 
 Key Responsibilities
 
 <ul>
 <li>
 
 Design, build, and maintain
 
 ETL/ELT pipelines
 
 using Spark, Hive, Impala, NiFi, and Oozie.
 
 </li>
 <li>
 
 Optimize data pipelines for
 
 performance, reliability, and cost efficiency
 
 across batch and streaming workloads.
 
 </li>
 <li>
 
 Develop
 
 automation scripts and reusable frameworks
 
 for data ingestion, transformation, and cleansing.
 
 </li>
 <li>
 
 Collaborate with Cloudera Administrators to
 
 tune performance
 
 and manage cluster resources efficiently.
 
 </li>
 <li>
 
 Troubleshoot and resolve
 
 data pipeline failures, performance bottlenecks, and data quality issues
 
 .
 
 </li>
 <li>
 
 Monitor
 
 cluster utilization, job performance, and data throughput
 
 using Cloudera Manager.
 
 </li>
 <li>
 
 Work with DevOps/Infrastructure teams to define and maintain
 
 CI/CD pipelines, automation for deployments
 
 , and monitoring of data jobs.
 
 </li>
 <li>
 
 Participate in
 
 incident management, root cause analysis, and preventive maintenance
 
 .
 
 </li>
 <li>
 
 Ensure pipelines meet
 
 SLAs, data quality, and latency requirements
 
 for analytics workloads.
 
 </li>
 </ul>
 
 Requirements
 
 <ul>
 <li>
 
 5+ years of experience as a
 
 Data Engineer
 
 in a Cloudera-based environment.
 
 </li>
 <li>
 
 Strong hands-on experience with
 
 Spark, Hive, Impala, NiFi, and Oozie
 
 .
 
 </li>
 <li>
 
 Solid understanding of
 
 ETL design, performance optimization
 
 , and
 
 data governance
 
 principles.
 
 </li>
 <li>
 
 Experience with
 
 Linux/Unix scripting
 
 and
 
 CI/CD integration
 
 .
 
 </li>
 <li>
 
 Excellent troubleshooting and communication skills.
 
 </li>
 </ul>
</div>

Cloudera Data Engineer

Datamatics Global Services Ltd

<div><h2 class="jobSectionHeader">Cloudera Data Engineer</h2>
Location: Remote (UAE Time Zone) 
Experience: 5+ Years 
Availability: Immediate joiners or candidates who can start within 30 days preferred<h3 class="jobSectionHeader">
Role Overview</h3>
We are seeking an experienced Cloudera Data Engineer to design, build, and maintain data pipelines and processing frameworks across Cloudera&rsquo;s ecosystem. The ideal candidate will have strong expertise in Spark, Hive, Impala, NiFi, and Oozie, and proven experience optimizing large-scale data pipelines for performance and reliability.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, build, and maintain ETL/ELT pipelines using Spark, Hive, Impala, NiFi, and Oozie.</li><li>
Optimize data pipelines for performance, reliability, and cost efficiency across batch and streaming workloads.</li><li>
Develop automation scripts and reusable frameworks for data ingestion, transformation, and cleansing.</li><li>
Collaborate with Cloudera Administrators to tune performance and manage cluster resources efficiently.</li><li>
Troubleshoot and resolve data pipeline failures, performance bottlenecks, and data quality issues.</li><li>
Monitor cluster utilization, job performance, and data throughput using Cloudera Manager.</li><li>
Work with DevOps/Infrastructure teams to define and maintain CI/CD pipelines, automation for deployments, and monitoring of data jobs.</li><li>
Participate in incident management, root cause analysis, and preventive maintenance.</li><li>
Ensure pipelines meet SLAs, data quality, and latency requirements for analytics workloads.</li></ul><h3 class="jobSectionHeader">
Requirements</h3><ul><li>
5+ years of experience as a Data Engineer in a Cloudera-based environment.</li><li>
Strong hands-on experience with Spark, Hive, Impala, NiFi, and Oozie.</li><li>
Solid understanding of ETL design, performance optimization, and data governance principles.</li><li>
Experience with Linux/Unix scripting and CI/CD integration.</li><li>
Excellent troubleshooting and communication skills.</li></ul>
BJoI7cAFtW</div>

NextGENi - A DotZero Company

<div>
 
 Job Details
 
 
 
 <ul>
 <li>
 Role: Data Engineer
 </li>
 <li>
 Location: Karachi (Onsite)
 </li>
 <li>
 Type: Full-Time
 </li>
 <li>
 Experience Range: 2-5 years
 
 
 </li>
 </ul>
 
 About NextGENi
 
 
 
 NextGENi (Next Generation Innovations) is transforming how regional startups build their technology teams. We help ambitious founders build and manage their offshore technology teams at twice the speed and fraction of the cost. We have built tech teams for some of the leading startups in the region including Careem, Dubizzle, and Kavak. Our mission is to create exceptional tech teams while maintaining an unparalleled culture and the highest regard for professional principles.
 
 
 
 About The Role
 
 
 
 We are looking for a Data Engineer to join our fast-paced and data-driven engineering team. In this role, the applicant will take ownership of data engineering solutions. As a client-facing professional, the selected applicant will be responsible for designing and implementing ETL pipelines and leveraging AWS services to manage and process large volumes of data efficiently.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Lead the design and implementation of ETL processes for data integration and transformation.
 </li>
 <li>
 Work extensively with AWS services including Lambda, Glue, Redshift, and QuickSight.
 </li>
 <li>
 Collaborate closely with clients and stakeholders to understand their data needs and provide strategic solutions.
 </li>
 <li>
 Ensure data quality, integrity, and scalability across various data systems.
 </li>
 <li>
 Optimize and maintain data pipelines and processes to meet performance standards.
 
 
 </li>
 </ul>
 
 Key Requirements
 
 
 
 <ul>
 <li>
 Extensive experience with ETL processes and data integration.
 </li>
 <li>
 Proficiency in AWS services such as Lambda, Glue, Redshift, and QuickSight.
 </li>
 <li>
 Strong communication skills with the ability to explain technical solutions.
 </li>
 <li>
 Ability to work independently and manage complex data engineering projects
 
 
 </li>
 </ul>
 
 Instructions to Apply
 
 
 
 To Apply, send your resumes to talent@nextgeni.com with subject mentioning &ldquo;NGI-DE-001&rsquo;&rsquo;
 
 
 
 Download a blank applicant form
 
 
 
 Download Form
 
 
 
 Disclaimer
 
 
 
 Kindly refrain from renaming this file or altering the form&rsquo;s format, as it may result in rejection by the ATS. member at NextGENi, and you have cleared the assignment.
</div>

Data Engineer

HR Ways

About the job Data Engineer - (On-site | Karachi | PKR)Client company introduction: &#65279;The company is a growing consultancy specializing in data analytics, providing high-quality, impactful data solutions to clients based in the UK.Job Description: &#65279;*The Data Engineer *will play a pivotal role in shaping the companys data capabilities, working on projects for UK-based clients. Joining a new and dynamic team, this role offers the opportunity to implement best practices, introduce innovative tools and technologies, and contribute to tasks beyond traditional data engineering. The ideal candidate is proactive, versatile, and eager to make their own mark in a startup-like environment. You will receive mentorship from the UK-based founder, fostering professional growth and the chance to significantly impact the company's success.Key Responsibilities:Design and Implement Data Infrastructure:<ul><li>Develop, maintain, and optimize scalable data pipelines and architectures to support data analytics projects.</li><li>Implement best practices in data warehousing, ETL/ELT processes, and data integration to ensure efficient data flow.</li><li>Introduce and leverage tools and technologies that enhance data processing and storage capabilities.</li></ul>Implement Best Practices and Innovation:<ul><li>Establish data engineering standards and procedures to ensure data integrity, quality, and security.</li><li>Stay abreast of emerging technologies and industry trends, integrating innovative solutions where appropriate.</li><li>Evaluate and introduce tools (e.g., data pipeline frameworks, automation scripts) to improve workflow efficiency.</li></ul>Dynamic Role in a Startup Environment:<ul><li>Contribute to various aspects of the business, such as assisting with technical input for the company website, supporting social media initiatives, or aiding in recruitment efforts as needed.</li><li>Embrace the flexibility of a startup setting, proactively addressing challenges and seizing opportunities to add value.</li></ul>Collaboration and Team Support:<ul><li>Work closely with data analysts, project managers, and other team members to understand data requirements and deliver optimal solutions.</li><li>Participate in team meetings, providing technical insights and contributing to project planning and execution.</li><li>Mentor junior team members, sharing knowledge and fostering a collaborative learning environment.</li></ul>Client Engagement:<ul><li>Occasionally interact with UK-based clients to understand their data needs, provide updates, and ensure satisfaction with data solutions.</li><li>Translate complex technical concepts into clear, understandable language for clients and non-technical stakeholders.</li></ul>Data Quality and Continuous Improvement:<ul><li>Implement data validation and monitoring processes to maintain high data quality and reliability.</li><li>Gather feedback on data solutions and processes, identifying areas for improvement and implementing enhancements.</li><li>Track and report on data engineering metrics to monitor performance and identify optimization opportunities.</li></ul>Qualifications:<ul><li>Bachelor's degree in Computer Science, Information Systems, or a related field.</li><li>Minimum of 3 years of experience in data engineering, preferably within data analytics or consulting environments.</li><li>Proficiency in SQL and programming languages such as Python or Java.</li><li>Experience with cloud-based data services (e.g., Azure Data Factory, Azure SQL Database) and familiarity with Power BI integration.</li><li>Strong understanding of data warehousing concepts, ETL/ELT processes, and best practices in data management.</li><li>Excellent problem-solving skills and the ability to work independently in a dynamic environment.</li><li>Strong communication skills, with the ability to convey complex technical information to both technical and non-technical audiences.</li><li>A proactive mindset with a passion for innovation and continuous improvement.</li></ul>What We Offer:<ul><li>Opportunity to Make Your Mark: Join a growing team where your contributions will have a significant impact on the company's success.</li><li>Mentorship: Work closely with the UK-based founder, gaining valuable insights and advancing your professional development.</li><li>Dynamic Environment: Experience the excitement and challenges of a startup-like setting, where flexibility and innovation are highly valued.</li></ul>Client Exposure: Collaborate with UK-based clients, enhancing your international experience and expanding your professional network&#65279;Other Details:<ul><li>Experience: 3 years or above</li><li>Location: Karachi, Pakistan (on-site)</li><li>&#65279;Timings: 12:00PM - 9:00PM Summer &amp; 1:00PM - 10:00PM Winter</li><li>Working Days: Monday to Friday</li></ul>Apply at jobs@hrways.co (not com)&#65279;About HR Ways: &#65279;&#65279;&#65279;HR Ways is an Award winning Technical Recruitment Firm helping software houses and IT Product companies internationally and locally to find IT Talent. HR Ways is engaged by 300+ Employers worldwide ranging from worlds biggest SaaS Companies to most competitive Startups. We have entities in Dubai, Canada, US, UK, Pakistan, India, Saudi Arabia, Portugal, Brazil and other parts of the world. Join our WhatsApp Channel https://shorturl.at/983az to stay updated or visit www.hrways.co to know more.Job Type: Full-timeWork Location: In person

Systems Limited

<div>We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate should have strong experience with cloud data engineering, ELT/ETL frameworks, and modern data technologies, enabling the business to make data-driven decisions efficiently.<h3 class="jobSectionHeader"> 
</h3>
<h3 class="jobSectionHeader">Responsibilities</h3>
<ul>
<li>Design, develop, and maintain scalable data pipelines for batch and real-time processing.
</li>
<li>Build and optimize data lake, data warehouse, and data mart architectures.
</li>
<li>Develop and enhance ETL/ELT workflows using best practices.
</li>
<li>Work with large datasets, ensuring data quality, integrity, and governance.
</li>
<li>Collaborate with Data Scientists, Analysts, and Product teams to understand data needs.
</li>
<li>Implement data modeling (Star, Snowflake, 3NF) for analytics and reporting.
</li>
<li>Optimize database performance, query tuning, and data storage solutions.
</li>
<li>Ensure data security, access control, and compliance standards.
</li>
<li>Lead technical design discussions and mentor junior data engineers.
</li>
<li>Work with CI/CD pipelines, version control, and automation tools.</li> 
</ul>
<h3 class="jobSectionHeader">Requirements:</h3>
<ul>
<li>Strong experience with cloud platforms: AWS / Azure / GCP.
</li>
<li>Hands-on experience in SQL, Python, and distributed data processing.
</li>
<li>Expertise in tools like Spark, Databricks, Hadoop, Hive, Airflow, Kafka or similar.
</li>
<li>Experience with data warehouses such as Snowflake, Redshift, BigQuery, or Synapse.
</li>
<li>Strong understanding of ETL/ELT, data modeling, and data architecture principles.
</li>
<li>Experience building real-time streaming pipelines (Kafka, Kinesis, EventHub).
</li>
<li>Proficiency with CI/CD, Git, DevOps workflows.
</li>
<li>Knowledge of data governance, security, and metadata management.</li></ul></div>

Managing Consultant Data Engineering

Client C&#65279;ompany Introduction: &#65279;*It is a leading &#65279;&#65279;*software engineering company delivering innovative, AI-powered platforms for global clients.&#65279;Opening: Data Engineer (AWS Integration)Key Responsibilities:Data Lake Architecture: -Design, implement, and maintain a data lake on AWS using Iceberg tables on S3, ensuring data consistency, high availability, and easy querying. &#65279; &#65279;-Work with AWS Glue for ETL processes, creating Glue jobs to process, transform, and load data from SQL Server and other sources into Iceberg tables. &#65279;&#65279;-Implement and optimize Spark-based data transformations in AWS Glue, ensuring efficient and scalable data workflows.&#65279; &#65279; &#65279;SQL Server to AWS Migration: &#65279;-Lead the migration of on-premises SQL Server data to AWS S3 using AWS Glue, DMS, and other relevant tools. &#65279;-Design and implement CDC (Change Data Capture) pipelines to enable real-time data replication from SQL Server to AWS services like S3, Iceberg, and Redshift. &#65279; &#65279;Data Integration &amp; Management: &#65279;-Design and implement data pipelines for batch and real-time data processing, leveraging AWS DMS, Kinesis, and Glue Streaming. &#65279;-Automate data loading, transformation, and archiving processes with Glue and ensure the correct data schema management and data governance. &#65279;-Set up and maintain data cataloging systems using AWS Glue Data Catalog to organize and manage metadata for Iceberg tables. &#65279; &#65279;Querying with Athena: &#65279;-Use AWS Athena for querying Iceberg tables on S3, enabling high-performance, low-latency SQL querying on large datasets stored in Iceberg format. &#65279;-Optimize Athena queries to improve performance and manage large-scale data sets effectively. &#65279;-Design efficient partitioning strategies and manage the Iceberg tables using Athena's native support for Iceberg. &#65279; &#65279;Continuous Improvement &amp; Optimization: &#65279;-Implement data compaction strategies to reduce small file issues in Iceberg and optimize storage and query performance. &#65279;-Continuously monitor, troubleshoot, and optimize data pipelines for performance, cost efficiency, and data quality. &#65279; &#65279;Collaboration &amp; Documentation: &#65279;-Work closely with data scientists, analysts, and business teams to understand data needs and develop solutions that support their goals. &#65279;-Provide clear documentation on architecture, solutions, and workflows to ensure smooth knowledge transfer and maintainability. &#65279; &#65279;Required Skills &amp; Qualifications: &#65279;Experience: &#65279;-Proven experience (3+ years) in data engineering roles with expertise in SQL Server, AWS services, and Iceberg. &#65279;-Hands-on experience with AWS Glue, AWS DMS, S3, and Kinesis in building scalable and reliable data pipelines. -Solid understanding of Change Data Capture (CDC) and its implementation with SQL Server and AWS DMS. &#65279;-Experience with Apache Iceberg for building data lakes and managing large-scale, versioned data on S3. &#65279;-Strong knowledge of ETL processes, data modeling, and data transformation using Spark and Glue. &#65279;-AWS Athena experience for querying and managing Iceberg tables in S3. &#65279; &#65279; Technical Skills: &#65279;-SQL Server: Expertise in database administration, SQL queries, stored procedures, and performance tuning. &#65279;-AWS Glue: Experience in creating, debugging, and deploying Glue jobs and managing Glue Data Catalog. &#65279;-AWS DMS: Experience with migrating and replicating data from SQL Server to AWS cloud services, including CDC. &#65279;-Apache Iceberg: Practical knowledge of Iceberg table formats, partitioning, compaction, and schema evolution. &#65279;-AWS S3: Experience managing large datasets in S3, implementing partitioning strategies, and optimizing storage. &#65279;-Kinesis: Familiarity with real-time streaming data pipelines using Kinesis Data Streams and Glue Streaming. &#65279;-AWS Athena: Strong experience querying Iceberg tables and optimizing large-scale data queries. &#65279; &#65279; Tools &amp; Technologies: &#65279;-Apache Spark (for Glue and standalone Spark jobs) &#65279;-SQL, Python, AWS SDK for automation, and scripting tasks. &#65279;-Data governance: Experience with AWS Lake Formation for security and access management in a data lake environment. &#65279; &#65279;Desired Soft Skills: &#65279;-Strong problem-solving skills with the ability to troubleshoot complex data issues. &#65279;-Ability to collaborate effectively with cross-functional teams (data scientists, analysts, DevOps, and stakeholders). &#65279;-Strong communication skills to document and explain technical concepts clearly to both technical and non-technical audiences. &#65279;-Detail-oriented with a focus on data quality, integrity, and performance.&#65279;Experience: 3 + years &#65279;Work Timings: (Monday to Fri:11:00 AM - 7:30 PM)&#65279; &#65279;Work Mode: (Hybrid - Karachi, Pakistan) &amp; (Hybrid - Kolkata and Ahmadabad, India) &#65279;Salary: Tax-free (USD)&#65279;&#65279;&#65279;&#65279;About HR Ways: HR Ways is an award-winning Technical Recruitment Firm helping software houses and IT Product companies internationally and locally to find IT Talent. HR Ways is engaged by 300+ Employers worldwide ranging from the world's biggest SaaS Companies to the most competitive Startups. We have entities in Dubai, Canada, the US, the UK, Pakistan, India, Saudi Arabia, Portugal, Brazil, and other parts of the world. Join our Whatsapp Channel https://shorturl.at/983az to stay updated or visit www.hrways.co to know more.Job Type: Full-timeWork Location: In person

Explore 1081+ Big data engineer in Karachi this December. Find roles across top companies and apply now to boost your career.

1081 big data engineer jobs IN Karachi

Data Engineer (Mid-Level)

Cloudera Data Engineer

Cloudera Data Engineer

Data Engineer

Data Engineer

Managing Consultant Data Engineering

Data Engineer