ai engineer

big data engineer

data analyst

data engineer

data scientist

senior data engineer

Datamatics Global Services Ltd

<div><h2 class="jobSectionHeader">Job Title: Senior Data Engineer</h2>
Location: Remote 
Experience: 7 - 10 Years 
 
Only CV's which are as per JD will be shortlisted<h3 class="jobSectionHeader">
Role Purpose</h3>
We are seeking a highly skilled Senior Data Engineer to design, develop, and maintain scalable data pipelines and modern data platforms leveraging the Microsoft Fabric and Azure ecosystem. This role is critical in enabling data-driven decision-making by building efficient, reliable, and high-performance data solutions that support analytics, reporting, and advanced data use cases across the organization.<h3 class="jobSectionHeader">
Key Responsibilities</h3><h4 class="jobSectionHeader">
Data Engineering &amp; Development</h4><ul><li>
Design, build, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF) and Microsoft Fabric</li><li>
Develop and optimize data workflows using PySpark and SQL</li><li>
Implement and manage Lakehouse architecture using the Medallion (Bronze, Silver, Gold) layers</li><li>
Work with Azure Data Lake Storage (ADLS) and Delta Lake for scalable data storage and processing</li><li>
Integrate data from multiple sources while ensuring data quality, consistency, and reliability</li></ul><h4 class="jobSectionHeader">
Collaboration &amp; Enablement</h4><ul><li>
Partner with BI developers and analysts to enable data models and reporting solutions</li><li>
Collaborate with cross-functional stakeholders to translate business requirements into technical solutions</li></ul><h4 class="jobSectionHeader">
Performance &amp; Reliability</h4><ul><li>
Monitor, troubleshoot, and optimize data pipelines and system performance</li><li>
Ensure high availability and scalability of data platforms</li></ul><h4 class="jobSectionHeader">
Governance &amp; Compliance</h4><ul><li>
Implement and enforce data governance, security, and compliance best practices</li><li>
Ensure proper data lineage, cataloging, and documentation</li></ul><h3 class="jobSectionHeader">
Additional Responsibilities (Senior Level)</h3><ul><li>
Lead the design and architecture of scalable data platforms and solutions</li><li>
Define and enforce data engineering standards, frameworks, and best practices</li><li>
Mentor junior data engineers and conduct code reviews to ensure quality and performance</li><li>
Optimize large-scale data processing and improve system efficiency and cost optimization</li><li>
Drive adoption of Microsoft Fabric and modern data engineering practices across teams</li></ul><h3 class="jobSectionHeader">
Required Skills &amp; Qualifications</h3><ul><li>
5+ years of experience in Data Engineering</li><li>
Strong hands-on experience with:<ul><li>
Azure Data Factory (ADF)</li><li>
Microsoft Fabric</li><li>
PySpark and SQL</li><li>
Azure Data Lake Storage (ADLS)</li><li>
Delta Lake</li></ul></li><li>
Solid understanding of data modeling, ETL/ELT concepts, and Lakehouse architecture</li><li>
Experience with Medallion architecture (Bronze, Silver, Gold layers)</li><li>
Strong problem-solving and performance optimization skills</li><li>
Experience working in cloud-based data platforms (Azure preferred)</li></ul><h3 class="jobSectionHeader">
Preferred Qualifications</h3><ul><li>
Experience with Power BI or other BI tools</li><li>
Familiarity with data governance and security frameworks</li><li>
Exposure to CI/CD pipelines for data engineering workflows</li><li>
Experience working in Agile/Scrum environments</li></ul>
yYDt4WOcQ2</div>

Senior Data Engineer

Polarity Holdings

Starting Salary: Rs 501,000 PKR / monthSchedule: U.S. Eastern, Monday through FridayLocation: 100% Remote, Full-TimeAbout the RoleFalcon Scaling and PolarityIQ build private capital markets intelligence products. Our clients are family offices, institutional LPs, fund managers, investment banks, and registered investment advisors. They pay premium prices for verified, decision-maker-level intelligence on capital allocators worldwide.We operate a commercially active library of more than two hundred data products spanning family offices, institutional investors, venture capital, private equity, fund of funds, mutual funds, real estate, and high net worth individuals. Our flagship products include Family Office MAX (25,000+ executives across 10,000+ family offices) and LP MAX Bundle (80,000+ contacts across 17,000+ institutional LPs representing over $2 trillion in AUM).The Senior Data Engineer (Full Chain Builder) owns Project NOVA: the three-stage production pipeline that acquires records at scale, enriches them to the granularity capital allocators will pay for, and activates them inside PolarityIQ through agentic retrieval that surfaces signals autonomously.This is hands-on, high-autonomy work. You will build original scraping pipelines, architect multi-provider enrichment waterfalls, deploy production RAG systems, and build the agentic retrieval layer across our intelligence library. You ship products paying customers rely on, not internal demos.Before You ApplyIf your resume does not name a specific client, a real user volume, and what breaks when your system goes down: do not apply.If you have not deployed at least one production RAG system that a non-technical user relied on: do not apply.If Claude Code is not already part of your daily workflow, this role will move too fast for you.CompensationStarting salary is Rs 501,000 PKR per month. The role includes a revenue-sharing component tied directly to your contributions. You are paid weekly, on time.Strong performers regularly see total earnings scale meaningfully within the first four to eight weeks, with continued upside as contributions compound. On-target monthly earnings can exceed Rs 1,000,000 PKR within six to eight months.How You Enter &mdash; The 30-Day SprintThis role begins with a paid, deliverable-based 30-Day Build and Monetization Sprint at Rs 501,000 per month. You do not need to leave your current position. You operate on your own schedule, deploy existing products against real demand, and report what happens when your work meets the market.This is not a trial period. It is a real operating environment. At day 31, both sides hold 30 days of evidence. You will know whether the earnings trajectory and autonomy are real. We will know how you operate under real conditions.What You'll OwnAcquire &mdash; Sourcing and Scraping<ul><li>Build scraping pipelines against family office sites, regulatory filings, SEC EDGAR, state corporate registration databases, and professional networks.</li><li>Handle production anti-bot environments &mdash; Cloudflare, DataDome, PerimeterX &mdash; through residential proxies, CAPTCHA solvers, and stealth browser configurations.</li><li>Orchestrate recurring scraping with Apache Airflow, Prefect, or equivalent. Scheduled, monitored, recoverable.</li><li>Validate sourced records against schema contracts using Pydantic or equivalent. Every record passes the validation gate before entering the pipeline.</li></ul>Enrich &mdash; Multi-Provider Waterfalls<ul><li>Build and manage multi-source enrichment waterfalls using Clay.com, Apollo, Hunter, People Data Labs, Clearbit, and similar platforms.</li><li>Know the cost, coverage, and reliability tradeoffs between providers field by field. Build waterfalls that minimize cost while maximizing coverage.</li><li>Add granularity dimensions that matter: decision-maker layer, investment thesis, activity signals, relationship graph, structural classification, validation metadata.</li><li>Apply data hygiene principles across all pipelines: bounce rates, email verification, contact scoring, stale record detection.</li><li>Operate orchestration tooling that lets enrichment chains run end-to-end without manual stitching: n8n, Apache Airflow, Prefect, Make, or equivalent. The waterfall is one workflow, not a sequence of disconnected scripts.</li><li>Build cost-efficient pipelines that scale without proportional cost growth.</li></ul>Activate &mdash; Agentic RAG and RetrievalPolarityIQ's core intelligence layer is built on RAG. This is not experimental. It is the foundation of how our platform transforms raw family office data into queryable, actionable intelligence.<ul><li>Architect end-to-end RAG systems: document ingestion, chunking strategy, embedding model selection, vector database architecture, retrieval pipeline design.</li><li>Select and justify vector database choices (ChromaDB, Pinecone, Supabase pgvector, Weaviate, or equivalent) based on cost, latency, and scale requirements.</li><li>Implement hybrid retrieval strategies combining semantic vector search with keyword matching (BM25) for higher relevance and accuracy.</li><li>Build retrieval evaluation loops. Assess whether your system returns accurate, grounded results and diagnose when it does not.</li><li>Design and deploy autonomous AI agents using LangChain, CrewAI, or equivalent frameworks. Agents that gather, validate, and synthesize intelligence across data sources.</li><li>Integrate agentic workflows into the PolarityIQ platform so users receive signal delivery, not just search results.</li></ul>Database Architecture<ul><li>Own the architecture, integrity, and growth of PolarityIQ's core intelligence database.</li><li>Design and manage relational schema across Supabase/PostgreSQL, ensuring normalization, indexing, and query performance at scale.</li></ul>Technical StackScraping and AcquisitionScrapy, Playwright, curl_cffi, BeautifulSoup, Requests. Apify, Phantombuster, Browse AI at production scale. Anti-bot fluency: Cloudflare, DataDome, PerimeterX (named experience, not theoretical). Proxies: Bright Data, Oxylabs, Zyte, Smartproxy. CAPTCHA solvers: 2Captcha, Anti-Captcha, CapSolver. Orchestration: Apache Airflow, Prefect, AWS Lambda.EnrichmentClay.com as primary environment: tables, waterfalls, formulas, AI columns. Provider depth: Apollo, Hunter, People Data Labs, Clearbit, BetterContact, Cognism. Validation: Pydantic, Pandera, or Great Expectations applied to scraping output.RAG and Agentic SystemsProduction RAG deployment covering document ingestion, chunking, embeddings, hybrid retrieval, re-ranking, grounding. Vector databases: ChromaDB, Pinecone, Supabase pgvector, Weaviate. Agent frameworks: LangChain, CrewAI, LlamaIndex. LLM APIs: OpenAI, Anthropic Claude, Gemini, with understanding of cost, latency, and reliability tradeoffs.Claude Code &mdash; Non-NegotiableYou operate Claude Code in terminal-based, agentic workflows. Not as a code completer but as a development collaborator you direct, correct, and build with autonomously. You know its limits and call them without hand-holding.Development and InfrastructureBackend with Python, Node.js, or similar. SQL, relational schema design, query optimization. Managed platforms (Supabase, PostgreSQL). API integration (REST, GraphQL, webhooks). Git / GitHub.Who You AreThe technical skills matter. This section matters more.You take ownership before being asked. You measure yourself by outcomes, not activity. You are honest, even when it is uncomfortable. You are reliable, not occasionally but consistently. You are resourceful enough to treat every dollar spent like it is coming out of your own pocket.Your thought process is disciplined. You verify before you assert. You distinguish between facts, inferences, and conclusions, and you never conflate them. You test your assumptions before acting. You are willing to challenge your own hypotheses when the evidence points elsewhere.You use AI extensively but think independently first. Claude Code feels like a natural extension of how you work. You know when it is wrong, when it is shallow, and when to apply the human layer of judgment no prompt can replicate.You communicate in flawless English. Your first draft should be publishable. You do not require heavy editing cycles.Job Type: Full-timePay: Rs501,000.00 per monthEducation:<ul><li>Master's (Preferred)</li></ul>Language:<ul><li>English (Preferred)</li></ul>Work Location: In person

<div><h2 class="jobSectionHeader">Job Title: Senior Data Engineer (AWS)</h2>
Experience: 6&ndash;8 Years 
Location: Remote 
Industry: Retail / Data &amp; Analytics<h3 class="jobSectionHeader"> 
Job Summary</h3>
We are seeking highly skilled and innovative Senior Data Engineers (AWS) to join a dynamic team supporting advanced data initiatives. The ideal candidates will have strong hands-on experience in building scalable data pipelines, working with AWS data services, and delivering high-quality data solutions in fast-paced environments.
This role requires individuals who are problem-solvers, adaptable, and capable of working collaboratively within high-performing teams.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, develop, and maintain scalable data pipelines using AWS services.</li><li>
Build and optimize ETL/ELT processes using AWS Glue and DBT (Data Build Tool).</li><li>
Manage and configure data workflows and orchestration within the Orion framework.</li><li>
Develop and maintain configuration files and ensure seamless integration across systems.</li><li>
Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.</li><li>
Optimize data processing performance and ensure data quality and reliability.</li><li>
Work on data modeling, transformation, and warehousing solutions.</li><li>
Implement best practices for data governance, security, and compliance.</li><li>
Troubleshoot and resolve data-related issues across pipelines and infrastructure.</li><li>
Contribute to continuous improvement and innovation in data engineering practices.</li></ul><h3 class="jobSectionHeader">
Required Skills &amp; Expertise</h3><ul><li>
Strong experience with AWS ecosystem, including:<ul><li>
AWS Glue</li><li>
Amazon S3</li><li>
AWS Lambda</li><li>
Amazon Redshift / RDS</li></ul></li><li>
Hands-on expertise in DBT (Data Build Tool) for data transformation.</li><li>
Solid understanding of data pipeline architecture and ETL/ELT processes.</li><li>
Experience working with Orion framework and handling configuration-driven workflows.</li><li>
Good understanding of networking concepts within AWS environments (VPC, subnets, security groups).</li><li>
Proficiency in SQL and Python for data processing.</li><li>
Experience with version control systems (Git).</li><li>
Familiarity with CI/CD pipelines for data workflows.</li></ul><h3 class="jobSectionHeader">
Preferred Qualifications</h3><ul><li>
Experience in retail or supply chain data environments.</li><li>
Exposure to real-time data processing and streaming frameworks.</li><li>
Knowledge of data lake and lakehouse architectures.</li><li>
AWS certifications (e.g., AWS Certified Data Analytics or Solutions Architect).</li></ul><h3 class="jobSectionHeader">
Key Competencies</h3><ul><li>
Strong analytical and problem-solving skills</li><li>
Innovative mindset with a focus on continuous improvement</li><li>
Ability to work in high-performance, collaborative teams</li><li>
Excellent communication and stakeholder management skills</li><li>
Ownership and accountability for deliverables</li></ul>
7A69crohYg</div>

Senior Data Engineer (AWS)

<div><h2 class="jobSectionHeader">Note: Only CV which are as per JD will be contacted. 
 
Job Title: Data Engineer / Senior Data Engineer 
Location : UAE - Onsite 
</h2><h3 class="jobSectionHeader">
Role Purpose</h3>
Design, develop, and maintain scalable data pipelines and modern data platforms using Microsoft Fabric and Azure ecosystem. The role involves building efficient data solutions that support analytics, reporting, and advanced data use cases across the organization.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, build, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF) and Microsoft Fabric</li><li>
Develop and optimize data workflows using PySpark and SQL</li><li>
Implement and manage Lakehouse architecture using Medallion (Bronze, Silver, Gold) layers</li><li>
Work with Azure Data Lake Storage (ADLS) and Delta Lake for efficient data storage and processing</li><li>
Integrate data from multiple sources ensuring data quality, consistency, and reliability</li><li>
Collaborate with BI developers and analysts to enable data models and reporting solutions</li><li>
Monitor, troubleshoot, and optimize data pipelines and performance issues</li><li>
Ensure data governance, security, and compliance best practices</li></ul><h3 class="jobSectionHeader">
Additional Responsibilities (Senior Data Engineer)</h3><ul><li>
Lead the design and architecture of scalable data platforms and solutions</li><li>
Define data engineering standards, best practices, and frameworks</li><li>
Mentor junior data engineers and review code for quality and performance</li><li>
Optimize large-scale data processing and improve system efficiency</li><li>
Collaborate with stakeholders to translate business requirements into technical solutions</li><li>
Drive adoption of Microsoft Fabric and modern data engineering practices across teams</li></ul><h3 class="jobSectionHeader">
Required Skills &amp; Experience</h3><h4 class="jobSectionHeader">
For Data Engineer (3&ndash;5 Years)</h4><ul><li>
Hands-on experience with Azure Data Factory (ADF) and ADLS</li><li>
Strong programming skills in PySpark and SQL</li><li>
Experience in building ETL pipelines and working with structured/unstructured data</li><li>
Basic understanding of Lakehouse and Medallion architecture</li><li>
Familiarity with Delta Lake concepts</li><li>
Good problem-solving and debugging skills</li></ul><h4 class="jobSectionHeader">
For Senior Data Engineer (5&ndash;10 Years)</h4><ul><li>
Extensive experience in Azure data ecosystem and Microsoft Fabric</li><li>
Strong expertise in designing end-to-end data architectures</li><li>
Deep understanding of Lakehouse, Medallion architecture, and Delta Lake</li><li>
Proven experience in handling large-scale distributed data processing</li><li>
Strong performance tuning and optimization skills</li><li>
Experience leading projects and mentoring teams</li></ul><h3 class="jobSectionHeader">
Preferred Qualifications</h3><ul><li>
Experience in Azure Databricks</li><li>
Knowledge of data modeling and data warehousing concepts</li><li>
Exposure to data governance and data quality frameworks</li><li>
Experience working in Agile environments</li></ul><h3 class="jobSectionHeader">
Soft Skills</h3><ul><li>
Strong communication and stakeholder management skills</li><li>
Analytical thinking and problem-solving mindset</li><li>
Ability to work independently and in a collaborative team environment</li></ul>
Pi3WGqPOnG</div>

Data Engineer / Senior Data Engineer

Mashreq

<div>
 Data &amp; Analytics Driven Organization: One Data Analytics &amp; AI Business Unit drive the vision to transform the Bank into a Data Driven Organization (DDO) using latest tools and technologies in Data space. Wholesale &amp; Ops Data team is a stream within One Data Organization driving this agenda for Wholesale &amp; Ops Banking function.
 
 
 - Data Engineer will design and maintain data pipelines of real-time and batch, creates data strategy, data architecture, best practices and who can lead the organization in making strategical improvements in the data engineering solutions.
 
 - This role requires to have a knowledge of core system, payment systems, digital journeys, marketing systems, risk and compliance systems which are very data intensive systems across UAE, Egypt, Pakistan and other IBG regions etc.
 
 - Our core function spans multiple platforms like Enterprise Data Lake, Azure Data Lake, Business Intelligence, Advanced Analytics and Realtime Streaming platforms.
 
 - The work involves developing new requirements in both on-premises and cloud data lake&rsquo;s estimating the efforts, designing an effective solution, data architecture and management, change release management, resource management, handling the deliverables across the business groups in the Bank. Also, handling critical applications that influence bank&rsquo;s management decision making process, regulatory reporting (which can influence financial/non-financial penalties) and operational reporting.
</div>

Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE

LeadingEdge HR Solutions

<div>
 
 NOW HIRING | SENIOR AI ENGINEER &ndash; REMOTE | BAHRAIN
 
 
 
 
 Position Title:
 
 Senior AI Engineer
 
 
 
 Location:
 
 Bahrain (Remote)
 
 
 
 Contract Type:
 
 Full-Time Permanent
 
 
 
 Role Overview
 
 
 
 Our Client is a forward-thinking organisation based in Bahrain, operating at the intersection of technology and financial services. They are seeking a skilled
 
 Senior AI Engineer
 
 to
 
 design, develop, and deliver end-to-end AI solutions
 
 &mdash; bringing a strong
 
 consultancy or banking background
 
 and the ability to translate complex business challenges into scalable, production-ready AI applications on a fully
 
 remote basis.
 
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Design, develop, and deploy end-to-end AI use cases that are directly aligned to business objectives and organisational priorities.
 </li>
 <li>
 Engage with business stakeholders across consulting and banking functions to identify, scope, and prioritise AI opportunities with measurable impact.
 </li>
 <li>
 Translate complex operational and business requirements into intelligent, production-ready AI and machine learning solutions.
 </li>
 <li>
 Build, optimise, and maintain machine learning models, data pipelines, and AI-driven applications to the highest technical standards.
 </li>
 <li>
 Ensure all AI solutions are robust, scalable, and suitable for live production environments.
 </li>
 <li>
 Continuously monitor industry developments, emerging AI tools, and evolving best practices within the banking and consulting sectors.
 </li>
 <li>
 Clearly document technical processes, methodologies, and outcomes; present findings to both technical teams and senior non-technical stakeholders.
 
 
 
 </li>
 </ul>
 
 Required Experience &amp; Skills
 
 
 
 <ul>
 <li>
 Minimum 2 years of hands-on experience in designing, building, and deploying AI and machine learning solutions.
 </li>
 <li>
 Demonstrated ability to deliver end-to-end AI projects independently from concept through to full production deployment.
 </li>
 <li>
 Prior experience within consulting and/or banking and financial services is strongly preferred.
 </li>
 <li>
 Strong proficiency in Python with practical experience across leading AI tools, machine learning libraries, and development frameworks.
 </li>
 <li>
 Proven working knowledge of cloud platforms including AWS, Microsoft Azure, or Google Cloud.
 </li>
 <li>
 Solid experience working with large-scale datasets and building predictive or natural language processing models.
 </li>
 <li>
 Exceptional communication skills with the ability to articulate complex technical concepts to both technical and non-technical stakeholders.
 </li>
 <li>
 Highly self-managed, organised, and dependable in a fully remote working environment.
 
 
 
 </li>
 </ul>
 
 Apply Now:
 
 
 
 
 Interested candidates can share there resume at
 
 talent@leadingedge.plus
 
 mentioning title in the subject line.
 
</div>

SENIOR AI ENGINEER – ONSITE_KHI

<div><h2 class="jobSectionHeader">Job Title: Data Engineer</h2>
Experience: 3&ndash;5 Years 
Location: Remote 
 
Only CV matching with JD will be Shortlisted<h3 class="jobSectionHeader">
Role Purpose</h3>
We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines within the Azure ecosystem. You will play a key role in enabling data-driven insights by developing reliable data solutions that support analytics, reporting, and business intelligence initiatives.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF)</li><li>
Work with Azure Data Lake Storage (ADLS) for data ingestion, storage, and processing</li><li>
Build and optimize data transformations using PySpark and SQL</li><li>
Integrate data from multiple structured and unstructured sources</li><li>
Ensure data quality, integrity, and consistency across pipelines</li><li>
Support implementation of Lakehouse architecture and Medallion (Bronze, Silver, Gold) layers</li><li>
Collaborate with analysts and BI teams to enable reporting and data models</li><li>
Monitor, troubleshoot, and resolve data pipeline issues</li><li>
Document data processes, workflows, and pipeline logic</li></ul><h3 class="jobSectionHeader">
Required Skills &amp; Experience (3&ndash;5 Years)</h3><ul><li>
Hands-on experience with Azure Data Factory (ADF) and ADLS</li><li>
Strong programming skills in PySpark and SQL</li><li>
Experience in building and maintaining ETL pipelines</li><li>
Working knowledge of structured and unstructured data processing</li><li>
Basic understanding of Lakehouse architecture and Medallion framework</li><li>
Familiarity with Delta Lake concepts</li><li>
Strong problem-solving and debugging skills</li></ul><h3 class="jobSectionHeader">
Preferred Qualifications</h3><ul><li>
Experience with Azure Databricks</li><li>
Understanding of data modeling and data warehousing concepts</li><li>
Exposure to data governance and data quality frameworks</li><li>
Experience working in Agile/Scrum environments</li></ul><h3 class="jobSectionHeader">
Soft Skills</h3><ul><li>
Strong communication and stakeholder collaboration skills</li><li>
Analytical mindset with attention to detail</li><li>
Ability to work independently in a remote setup</li><li>
Team player with a proactive approach to problem-solving</li></ul><h3 class="jobSectionHeader">
Career Progression Opportunity</h3>
This role provides a pathway to grow into a Senior Data Engineer (5&ndash;10 Years) position, where responsibilities include:<ul><li>
Designing end-to-end data architectures</li><li>
Working extensively with Microsoft Fabric and advanced Azure services</li><li>
Leading data engineering initiatives and mentoring team members</li><li>
Optimizing large-scale distributed data systems</li></ul>
OkBtJaBo56</div>

Data Engineer

Explore 1033+ Senior data engineer in Karachi this May. Find roles across top companies and apply now to boost your career.

1033 senior data engineer jobs In Karachi

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer (AWS)

Data Engineer / Senior Data Engineer

Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE

SENIOR AI ENGINEER – ONSITE_KHI

Data Engineer