data analyst

devops engineer

ai developer/engineer

ai engineer

aws data engineer

data pipeline engineer

Datamatics Global Services Ltd

<div><h2 class="jobSectionHeader">Cloudera Data Engineer</h2>
Location: Remote (UAE Time Zone) 
Experience: 5+ Years 
Availability: Immediate joiners or candidates who can start within 30 days preferred<h3 class="jobSectionHeader">
Role Overview</h3>
We are seeking an experienced Cloudera Data Engineer to design, build, and maintain data pipelines and processing frameworks across Cloudera&rsquo;s ecosystem. The ideal candidate will have strong expertise in Spark, Hive, Impala, NiFi, and Oozie, and proven experience optimizing large-scale data pipelines for performance and reliability.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, build, and maintain ETL/ELT pipelines using Spark, Hive, Impala, NiFi, and Oozie.</li><li>
Optimize data pipelines for performance, reliability, and cost efficiency across batch and streaming workloads.</li><li>
Develop automation scripts and reusable frameworks for data ingestion, transformation, and cleansing.</li><li>
Collaborate with Cloudera Administrators to tune performance and manage cluster resources efficiently.</li><li>
Troubleshoot and resolve data pipeline failures, performance bottlenecks, and data quality issues.</li><li>
Monitor cluster utilization, job performance, and data throughput using Cloudera Manager.</li><li>
Work with DevOps/Infrastructure teams to define and maintain CI/CD pipelines, automation for deployments, and monitoring of data jobs.</li><li>
Participate in incident management, root cause analysis, and preventive maintenance.</li><li>
Ensure pipelines meet SLAs, data quality, and latency requirements for analytics workloads.</li></ul><h3 class="jobSectionHeader">
Requirements</h3><ul><li>
5+ years of experience as a Data Engineer in a Cloudera-based environment.</li><li>
Strong hands-on experience with Spark, Hive, Impala, NiFi, and Oozie.</li><li>
Solid understanding of ETL design, performance optimization, and data governance principles.</li><li>
Experience with Linux/Unix scripting and CI/CD integration.</li><li>
Excellent troubleshooting and communication skills.</li></ul>
l17IPmQvjU</div>

Cloudera Data Engineer

KEMAT CONSULTING

Position Title: Data Engineer Architect Department: Data &amp; Technology Employment Type: Full-Time Location: On-site &mdash; Blue Area, IslamabadTime: 9am-5pm (Uk-Time)Position OverviewThe Data Engineer Architect is responsible for designing robust, scalable, and efficient data architectures and pipelines to support enterprise-wide analytics, reporting, and machine learning initiatives. This role ensures seamless ingestion, transformation, governance, and availability of data across cloud environments. The architect will drive technical direction, security, and quality across all data systems while supporting migration from legacy infrastructures to modern cloud-based platforms.Key Responsibilities1. Data Architecture &amp; Design<ul><li>Design scalable, secure, and future-ready enterprise data architectures.</li><li>Build strong and flexible data models, ingestion frameworks, and transformation layers.</li><li>Define schemas for various data types (transactional, structured, unstructured, CRM, web analytics).</li><li>Create data environments that support both experimental (&ldquo;Lab&rdquo;) and production (&ldquo;Factory&rdquo;) analytics.</li><li>Build structures enabling predictive, prescriptive analytics and ML/AI model training.</li><li>Ensure architecture supports BI/reporting tools such as PowerBI.</li></ul>2. Data Engineering &amp; Pipeline Development<ul><li>Design and implement robust ETL/ELT data pipelines for diverse internal and external data sources.</li><li>Develop high-performance batch and real-time data processing pipelines using Spark, Kafka, Databricks, or similar tools.</li><li>Optimize pipelines for performance, efficiency, and cost-effectiveness.</li><li>Support ingestion and migration of legacy data into Snowflake or other cloud warehouses.</li></ul>3. Cloud &amp; Infrastructure<ul><li>Architect cloud-based data engineering, BI, and data science solutions on Azure, AWS, or GCP.</li><li>Build and maintain modern cloud data lakes and transformed data layers.</li><li>Work with engineering teams to design complex cloud-based environments.</li><li>Implement CI/CD pipelines and automation for data workflows.</li><li>Lead migration of legacy physical infrastructures into cloud platforms.</li></ul>4. Security, Governance &amp; Monitoring<ul><li>Apply &ldquo;quality by design&rdquo; and &ldquo;security by design&rdquo; principles in all architectures.</li><li>Ensure compliance with GDPR and company data governance frameworks.</li><li>Implement data validation, monitoring, alerting, and telemetry systems (e.g., Sifflet).</li><li>Maintain metadata, data lineage, documentation, and governance structures.</li><li>Partner with governance teams to embed real-time alerting and monitoring.</li></ul>5. Collaboration &amp; Leadership<ul><li>Work closely with the Head of Data Engineering &amp; Data Platform to align with enterprise strategy.</li><li>Collaborate with product managers, data scientists, and analytics teams to translate business needs into actionable data solutions.</li><li>Provide technical guidance, direction, and support to engineers and project teams.</li><li>Communicate architectural decisions and technical recommendations clearly to stakeholders.</li></ul>Required QualificationsEducation<ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Data Engineering, Information Systems, or a related field.</li></ul>Experience<ul><li>5+ years of experience in Data Engineering or Data Architecture.</li><li>Proven experience architecting cloud-based data engineering, BI, and/or data science solutions.</li><li>Experience migrating legacy data solutions into the cloud (refactoring, modernization).</li><li>Strong experience with database technologies, data modeling, and schema design.</li><li>Experience building data structures that support first- and third-party data analysis under GDPR guidelines.</li></ul>Technical Skills<ul><li>Very strong SQL skills.</li><li>Proficiency in Python and advanced data modeling.</li><li>Experience with Snowflake, Azure Synapse, BigQuery, or Redshift.</li><li>Hands-on experience with ETL/ELT tools (Azure Data Factory, dbt, Informatica, Talend).</li><li>Familiarity with Spark, Kafka, Databricks, Hadoop ecosystem.</li><li>Experience with Docker, Kubernetes, Git, DevOps, and CI/CD workflows.</li><li>Strong understanding of data warehousing methodologies (Kimball/Inmon).</li><li>Knowledge of telemetry, monitoring, and alerting tools.</li></ul>Preferred Skills<ul><li>Professional certifications (Azure Data Engineer, AWS Big Data, Google Data Engineer).</li><li>Experience supporting AI/ML teams with high-quality training datasets.</li><li>Experience with MLOps or ML pipeline automation.</li><li>Strong analytical, architectural, and communication abilities.</li></ul>Soft Skills<ul><li>Excellent communication and documentation skills.</li><li>Strong problem-solving and critical thinking abilities.</li><li>Leadership mindset with the ability to mentor junior engineers.</li><li>Detail-oriented with focus on data quality, accuracy, and governance.</li></ul>What We Offer<ul><li>Competitive salary and comprehensive benefits package.</li><li>On-site working environment in Blue Area, Islamabad.</li><li>Exposure to modern technology stacks and architectural frameworks.</li><li>Opportunities for continuous learning, certifications, and career growth.</li></ul>Job Type: Full-timePay: Rs400,000.00 - Rs600,000.00 per monthWork Location: In person

Data Engineer Architect

<div><h1 class="jobSectionHeader">Data Engineer (SQL Server, ETL &amp; Performance Optimization)</h1>
Location: Islamabad 
Job Type: Full-Time 
Experience Level: 5 - 7 Years 
Industry: Banking / Financial Services (Preferred)<h2 class="jobSectionHeader">
Role Summary</h2>
We are seeking a highly skilled Data Engineer with deep expertise in SQL Server performance optimization, high-volume ETL operations, and large-scale data processing. The ideal candidate will have hands-on experience managing complex data ecosystems, optimizing long-running jobs, and ensuring robust, efficient, and scalable ETL pipelines. Experience in financial systems or large MIS/reporting environments will be a strong plus.<h2 class="jobSectionHeader"> 
Key Responsibilities</h2><ul><li>
Design, develop, and optimize SQL Server queries, indexes, partitions, and overall database performance.</li><li>
Perform SQL Server performance tuning to support high-volume OLTP and OLAP workloads.</li><li>
Optimize and maintain ETL batch jobs, ensuring efficient execution and minimal downtime.</li><li>
Handle large-volume data loads, ensuring reliability, consistency, and performance across data pipelines.</li><li>
Troubleshoot and resolve long-running or failing ETL jobs, bottlenecks, and inefficiencies.</li><li>
Develop and maintain CDC (Change Data Capture)-based incremental data models.</li><li>
Manage end-to-end ETL processes, including scheduling, orchestration, monitoring, and debugging.</li><li>
Work with SQL CLR functions and assemblies, including reviewing, debugging, updating, and replacing them when necessary.</li><li>
Collaborate closely with BI, Data Analytics, and Application teams to support data integration requirements.</li><li>
Ensure data quality, consistency, and compliance across all integrated systems.</li></ul><h2 class="jobSectionHeader"> 
Required Skills &amp; Expertise</h2><ul><li>
Strong hands-on experience with SQL Server (performance tuning, indexing, partitioning, query optimization).</li><li>
Deep understanding of ETL frameworks, including batch processing and incremental loads.</li><li>
Experience managing large ETL architectures with complex dependencies.</li><li>
Strong knowledge of CDC and incremental data movement strategies.</li><li>
Expertise in working with large OLTP and OLAP environments.</li><li>
Experience with SQL CLR functions and assemblies (reading, debugging, modifying).</li><li>
Strong troubleshooting skills for long-running processes, query slowness, and data pipeline issues.</li></ul><h2 class="jobSectionHeader"> 
Preferred Experience</h2><ul><li>
Experience in the banking or financial domain (T24 or similar core banking systems).</li><li>
Hands-on experience working with heavy reporting or MIS environments with demanding data refresh cycles.</li><li>
Exposure to large-scale ETL ecosystems involving 500+ tables or high-volume enterprise data models.</li></ul><h2 class="jobSectionHeader"> 
Soft Skills</h2><ul><li>
Strong problem-solving and analytical abilities.</li><li>
Effective communication and collaboration skills.</li><li>
Ability to work independently in high-pressure, data-intensive environments.</li><li>
Attention to detail with a commitment to data accuracy and quality.</li></ul>
f5WKf99vdd</div>

Data Engineer

Company: Kemat Consulting Limited Location: Blue Area, Islamabad Job Type: Full-TimeAbout the Role:The principal responsibility of the Data Engineer role is to contribute to the development of digital tools, processes, and outputs, including the data infrastructure that underpins all BI activity. You will support the wider project team, enabling effective delivery of projects for our clients.You will work closely with project teams and occasionally with stakeholders from other organizations, especially in joint ventures or direct client projects. This is an excellent opportunity to learn from experienced practitioners and enhance your technical skill set.Key Responsibilities:<ul><li>Develop and maintain data pipelines and orchestration using Microsoft Fabric and Azure ecosystem.</li><li>Build and manage data warehouses and data marts.</li><li>Apply ELT/ETL, medallion architecture, and lakehouse design principles.</li><li>Work with the modern data engineering lifecycle, ensuring best practices are followed.</li><li>Interface with project teams and stakeholders to provide timely access to data.</li><li>Adhere to a structured development lifecycle: requirements definition, design, development, testing, deployment, and post-implementation support.</li><li>Ensure version control and high standards of data security throughout the development process.</li></ul>Required Skills &amp; Qualifications:<ul><li>Expert understanding of SQL.</li><li>Experience with Microsoft Azure and Microsoft Fabric ecosystem (preferably within the last 12 months).</li><li>Proficient in data integration methods and tools.</li><li>Hands-on experience with data pipelines, warehouses, and marts.</li><li>Knowledge of Azure DevOps for CI/CD and deployment.</li><li>Expertise in SQL, Python, PowerShell, DAX, M.</li><li>Understanding of modern data engineering best practices.</li><li>Ability to work within an Agile framework.</li><li>Microsoft DP-600 or DP-700 (Fabric Data Engineer) certification preferred.</li><li>Familiarity with Microsoft productivity suite: SharePoint, Teams, Office 365.</li><li>Strong understanding of data structures, security, and governance.</li><li>Excellent organizational skills and ability to manage deliverables to time and quality.</li><li>Experience working in a consultancy environment and managing multiple stakeholders.</li></ul>Desirable Skills &amp; Attributes:<ul><li>Experience supporting BI and data analytics software.</li><li>Collaborative team player with a willingness to share knowledge and mentor others.</li><li>Confident in asking questions, making suggestions, and challenging the status quo.</li><li>Excellent written, verbal, and presentation skills in English.</li><li>Commitment to inclusive working practices.</li><li>Strong problem-solving and interpersonal skills.</li></ul>Why Join Us:<ul><li>Opportunity to work with cutting-edge Microsoft Fabric and Azure technologies.</li><li>Exposure to high-profile projects and client engagements.</li><li>Career growth through structured training, mentoring, and hands-on experience.</li></ul>Job Type: Full-timePay: Rs250,000.00 - Rs800,000.00 per monthWork Location: In person

Data Engineer – Microsoft Fabric

Confiz

<div>
 We are seeking a Data Engineer with 5+ years of hands-on experience and a strong background in real-time and batch data processing, containerization, and cloud-based data orchestration. This role is ideal for someone passionate about building robust, scalable, and efficient data pipelines, and who thrives in agile, collaborative environments.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Design, build, and maintain real-time data pipelines using streaming frameworks such as Kafka, Apache Flink, and Spark Structured Streaming.
 </li>
 <li>
 Develop batch processing workflows with Apache Spark (PySpark)
 </li>
 <li>
 Orchestrate and schedule data workflows using orchestration frameworks such as Apache Airflow and Azure Data Factory
 </li>
 <li>
 Containerize applications using Docker, manage deployments with Helm, and run them on Kubernetes
 </li>
 <li>
 Implement modern storage solutions using open formats such as Parquet, Delta Lake, and Apache Iceberg
 </li>
 <li>
 Build high-performance analytics engines using tools like Trino or Presto
 </li>
 <li>
 Collaborate with DevOps to manage infrastructure with Terraform and integrate with CI/CD pipelines via Azure DevOps
 </li>
 <li>
 Ensure data quality and consistency using tools like Great Expectations
 </li>
 <li>
 Write modular, well-tested, and maintainable Python and SQL code
 </li>
 <li>
 Develop an observability layer to monitor and optimize performance across data pipelines
 </li>
 <li>
 Participate in agile ceremonies and contribute to sprint planning and reviews
 
 
 </li>
 </ul>
 
 Required Skills &amp; Experience
 
 
 
 <ul>
 <li>
 Advanced Python programming with a strong focus on modular and testable code
 </li>
 <li>
 Strong knowledge of SQL and experience working with large-scale datasets
 </li>
 <li>
 Hands-on experience with at least one major cloud platform (Azure preferred)
 </li>
 <li>
 Solid experience with real-time data processing (Kafka, Flink, or Spark Streaming)
 </li>
 <li>
 Expertise in Apache Spark (PySpark) for batch processing
 </li>
 <li>
 Experience implementing lakehouse architectures and working with columnar storage (e.g., ClickHouse)
 </li>
 <li>
 Proficient in using Azure Data Factory or Apache Airflow for data orchestration
 </li>
 <li>
 Experience in building APIs to expose large datasets
 </li>
 <li>
 Solid experience with Docker, Kubernetes, and Helm
 </li>
 <li>
 Familiarity with data lake open formats such as Parquet, Delta Lake, and Iceberg
 </li>
 <li>
 Basic experience with Terraform for infrastructure provisioning
 </li>
 <li>
 Practical experience with data quality frameworks (e.g., Great Expectations)
 </li>
 <li>
 Comfortable working in agile development teams
 </li>
 <li>
 Proven ability in debugging and performance tuning of streaming and batch data jobs
 </li>
 <li>
 Experience with AI-driven tools (e.g., text-to-SQL) is a plus
 </li>
 <li>
 Bachelor&rsquo;s degree in computer science or related discipline
 
 
 </li>
 </ul>
 We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.
 
 
 What makes Confiz stand out is our focus on processes and culture. Confiz is
 
 ISO 9001:2015
 
 (QMS),
 
 ISO 27001:2022
 
 (ISMS),
 
 ISO 20000-1:2018
 
 (ITSM),
 
 ISO 14001:2015
 
 (EMS),
 
 ISO 45001:2018
 
 (OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
 
 
 People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
 
 
 To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/
</div>

Senior/Principal Data Engineer

Jtechinc.

About usJTech Projects is an EPC firm focusing on providing top quality EPC and project management services to pipeline and oil and gas industry in PakistanPosition: Project Engineer (Part-time) &mdash; Fresh GraduateWe are looking for entry level Project Engineers to join our team on our clients&rsquo; cross-country pipeline projects. This is an exciting opportunity to start your career as Project Engineer working on mega oil and gas and pipeline projects in Pakistan.Job Details:Remote, Working from homeHours: 9 am - 1 pm PSTMust have a reliable computer and uninterrupted internet connectionJob Function:&middot; Assist Lead Project Engineer in preparation of engineering deliverables&middot; Perform engineering calculations related to pipeline design and engineering using design software or spreadsheets&middot; Perform stress analysis on buried pipelines&middot; Create pipeline engineering drawings including Alignment Sheets, Crossing Drawings etc.&middot; Prepare material requisitions including bill of material; perform bid evaluations&middot; Prepare engineering work packages to support construction award&middot; Coordinate with other team members in support of project completion&middot; Other tasks as per Project scope and requirements.Qualifications:&middot; Fresh Graduates or few years experience. Bachelor of Engineering (B.E.) Degree in Mechanical Engineering&middot; High aptitude towards learning pipeline engineering knowledge and its application&middot; Excellent time management and organizational skills&middot; Ability to take responsibility&middot; Provide attention to detailJob Types: Part-time, FresherPay: From Rs20,000.00 per monthWork Location: Remote

Project Engineer - Part time

Fusemachines

<div>
 
 About Fusemachines
 
 
 
 Fusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, our company is on a steadfast mission to democratize AI and harness the power of global AI talent from underserved communities. With a robust presence in four countries and a dedicated team of over 400 full-time employees, we are committed to fostering AI transformation journeys for businesses worldwide. At Fusemachines, we not only bridge the gap between AI advancement and its global impact but also strive to deliver the most advanced technology solutions to the world.
 
 
 
 Type: Remote Full-time
 
 
 
 Senior Data Engineer
 
 
 Are you an experienced Data Engineering professional with a passion for building scalable, reliable, and high-performance data systems? Do you have hands-on experience designing and optimizing end-to-end real-time and batch pipelines, and developing cloud-native data architectures using modern technologies such as AWS, GCP, Azure, Databricks, and Snowflake?
 
 
 We are building a dynamic pipeline of pre-qualified talent to fill critical data engineering roles as our business continues to scale.
 
 
 By providing your information, you are included in our priority pipeline of highly qualified candidates across various specialized Data Engineering opportunities within Fusemachines. This curated list ensures you will be among the very first to receive consideration for future full-time opportunities, giving you a significant advantage and leading to a much shorter evaluation and interview process when a critical role opens.
 
 
 
 Fusemachines is an Equal Opportunities Employer, committed to diversity and inclusion. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or any other characteristic protected by applicable federal, state, or local laws.
 
 
 
 Powered by JazzHR
 
 
 MgfZrPiZzF
</div>

Senior Data Engineer

Explore 638+ Data pipeline engineer in Islamabad this December. Find roles across top companies and apply now to boost your career.