business analyst

data analyst

assistant engineer

data engineer

ai agent & automation engineer Jobs in Karachi

ai agent & automation engineer

azure data engineer

RGH Global

Role: Azure Data EngineerLocation: Karachi Work Arrangement: On-site Employment Type: Full-timeOverviewWe are seeking a highly experienced Azure Data Engineer with 6+ years of hands-on experience in Azure and Databricks architecture, migration, and development. This role requires strong ownership, clear communication, and the ability to overlap up to 6 hours with US CST.Key Responsibilities<ul><li>Design, develop, and implement advanced analytics solutions using Azure and Databricks</li><li>Perform data migration and transformation on Databricks</li><li>Build and maintain scalable data pipelines and API integrations</li><li>Collaborate with data engineers, data scientists, and business stakeholders</li><li>Optimize performance of Azure and Databricks solutions</li><li>Monitor and manage Databricks environments for reliability</li><li>Lead architecture and development of complex data integration projects</li><li>Conduct code reviews and enforce best practices</li><li>Own and self-manage tasks to ensure timely, high-quality delivery</li></ul>Qualifications<ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, IT, or related field</li><li>6+ years of experience with Azure and Databricks</li><li>Strong experience with data pipelines, data architecture, and ETL</li><li>Proficiency in Python, Scala, or Java</li><li>Hands-on experience with Spark, Hadoop, or similar tools</li><li>Strong SQL and relational database knowledge</li><li>Experience with cloud infrastructure monitoring</li><li>Excellent problem-solving and communication skills</li><li>Ability to work with US CST (up to 6 hours overlap)</li></ul>Preferred<ul><li>Azure and/or Databricks certification</li></ul>Technical Skills<ul><li>Azure Data Factory (ADF)</li><li>Databricks</li><li>Azure Synapse Analytics</li><li>SQL &amp; NoSQL databases</li><li>ETL &amp; data warehousing</li><li>Python / Scala</li><li>Power BI or similar visualization tools</li></ul>Job Type: Full-timePay: Rs400,000.00 - Rs600,000.00 per monthApplication Question(s):<ul><li>Are you based in Karachi and willing to work from office</li><li>Kindly quote your monthly salary expectations</li></ul>Experience:<ul><li>data engineering: 5 years (Required)</li></ul>Work Location: In person

Azure Data Engineer

HRCONSOL

We&rsquo;re Hiring: Azure Data EngineerClient: Leading USA-Based Software House Location: Karachi (On-Site) Employment Type: Full-Time Work Arrangement: On-Site Work Hours: Ability to overlap up to 6 hours with US CSTRole OverviewHRCONSOL is hiring an experienced Azure Data Engineer for a leading US-based software organization&rsquo;s Karachi Head Office. This role is ideal for a self-driven professional with strong expertise in Azure and Databricks, capable of owning end-to-end data engineering solutions and collaborating with global teams.Key Responsibilities<ul><li>Design, develop, and implement advanced analytics solutions using Azure &amp; Databricks</li><li>Perform data migration and transformation on Databricks</li><li>Build and maintain scalable data pipelines and API integrations</li><li>Collaborate with data engineers, data scientists, and business stakeholders</li><li>Optimize and tune performance of Azure-based and Databricks solutions</li><li>Monitor and manage Databricks environments for reliability and efficiency</li><li>Lead architecture and development of complex data integration projects</li><li>Conduct code reviews and enforce best practices</li><li>Independently own and manage tasks with timely, high-quality delivery</li><li>Work effectively with cross-functional and remote US-based teams</li></ul>Qualifications<ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, IT, or related field</li><li>6+ years of hands-on experience in Azure &amp; Databricks architecture, migration, and development</li><li>Strong experience in data pipelines, architectures, and data optimization</li><li>Proficiency in Python, Scala, or Java</li><li>Experience with Spark, Hadoop, or other big data technologies</li><li>Strong SQL and relational database knowledge</li><li>Experience with cloud infrastructure monitoring and management tools</li><li>Excellent analytical, troubleshooting, and communication skills</li><li>Ability to work independently and overlap with US CST hours (up to 6 hours)</li></ul>Preferred<ul><li>Azure and/or Databricks certifications</li></ul>Technical Skill Set<ul><li>Azure Data Factory (ADF)</li><li>Databricks</li><li>SQL &amp; NoSQL Databases</li><li>Data Modeling &amp; Data Warehousing</li><li>ETL Tools &amp; Processes</li><li>Azure Synapse Analytics</li><li>Python and/or Scala</li><li>Power BI or other data visualization tools</li></ul>How to ApplyInterested candidates can apply by sending their updated CV to: jobs@hrconsol.com Mention &ldquo;Azure Data Engineer &ndash; Karachi&rdquo; in the subject line.Job Type: Full-timePay: Rs300,000.00 - Rs600,000.00 per monthWork Location: In person

Cosmo Resources

Overview:We are looking for a highly experienced and motivated Azure Data Engineer to join our team. The successful candidate will have a minimum of 6 years of hands-on experience in Azure and Databricks architecture, migration, and development. This role requires excellent communication skills and the ability to own and self-manage work. The candidate must be able to overlap with US CST work hours for up to 6 hours daily.Key Responsibilities:&middot; Design, develop, and implement advanced analytics solutions using Azure and Databricks.&middot; Perform data migration and transformation tasks on Databricks.&middot; Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.&middot; Work closely with data engineers, data scientists, and business stakeholders to understand their requirements and provide expert guidance.&middot; Optimize and tune the performance of Databricks and Azure-based solutions.&middot; Manage and monitor the Databricks environment to ensure reliability and performance.&middot; Lead the architecture and development of complex data integration projects.&middot; Conduct code reviews, provide feedback, and ensure best practices are followed.&middot; Own and self-manage assigned tasks, ensuring timely delivery with high quality.&middot; Collaborate with cross-functional teams and stakeholders in a remote work environment.Qualifications:&middot; Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Information Technology, or related field.&middot; 6+ years of experience with Azure and Databricks architecture, migration, and development.&middot; Strong experience in building and optimizing data pipelines, architectures, and data sets.&middot; Proficiency in programming languages such as Python, Scala, or Java.&middot; Experience with big data tools and technologies (Spark, Hadoop, etc.).&middot; Solid understanding of SQL and relational databases.&middot; Experience with cloud infrastructure management and monitoring tools.&middot; Excellent problem-solving skills and the ability to troubleshoot complex issues.&middot; Strong communication skills and the ability to work effectively in a remote team.&middot; Ability to work in the US CST time zone with up to 6 hours of overlap.Preferred Skills:&middot; Certification in Azure and/or Databricks is a plus.Technical Skills:&middot; Azure Data Factory (ADF)&middot; Databricks&middot; SQL and NoSQL databases&middot; Data modeling and data warehousing&middot; ETL processes and tools&middot; Azure Synapse Analytics&middot; Python and/or Scala&middot; Power BI or other data visualization toolsJob Type: Full-timePay: Rs300,000.00 - Rs600,000.00 per monthWork Location: In person

Fiblix

Position Type: Full-Time, Remote Location: Remote (Worldwide) Reports to: Technical Director / CTOAbout the RoleWe are seeking a highly experienced AI/ML Engineer &amp; Data Scientist to work on a large-scale enterprise software platform. This is a senior-level position requiring deep expertise in artificial intelligence, machine learning, and data science with proven experience in building and deploying production-grade AI systems.You will be responsible for architecting intelligent features, building ML pipelines, integrating cutting-edge AI capabilities, and transforming complex data into actionable insights.Key ResponsibilitiesAI/ML Development<ul><li>Design and build end-to-end machine learning systems for production deployment</li><li>Develop deep learning models (CNNs, RNNs, Transformers, GANs)</li><li>Implement recommendation engines, predictive analytics, and intelligent automation</li><li>Optimize models for performance, scalability, and cost efficiency</li></ul>LLM &amp; NLP Integration<ul><li>Integrate and fine-tune Large Language Models (GPT-4, Claude, LLaMA, Mistral)</li><li>Build NLP pipelines for text classification, sentiment analysis, and entity recognition</li><li>Develop RAG systems, chatbots, and conversational AI features</li><li>Implement prompt engineering and chain-of-thought reasoning</li></ul>Data Science &amp; Analytics<ul><li>Conduct exploratory data analysis on large, complex datasets</li><li>Perform statistical analysis, hypothesis testing, and causal inference</li><li>Build automated data pipelines and feature engineering workflows</li><li>Create data visualizations and reporting dashboards</li></ul>MLOps &amp; Production Systems<ul><li>Design MLOps pipelines for continuous training and deployment</li><li>Implement model monitoring, drift detection, and automated retraining</li><li>Build scalable model serving infrastructure</li><li>Establish testing frameworks and deployment strategies</li></ul>AI Integrations<ul><li>Integrate third-party AI APIs (OpenAI, Anthropic, Google AI, Azure AI, AWS)</li><li>Design RESTful APIs for model serving</li><li>Implement vector databases and semantic search capabilities</li><li>Build microservices architecture for AI features</li></ul>Required QualificationsExperience<ul><li>Minimum 5-8 years in AI/ML and Data Science</li><li>Minimum 5 years deploying production ML systems at scale</li><li>Minimum 3 years with deep learning frameworks</li><li>Minimum 2 years with LLMs and modern NLP</li><li>Proven track record of delivering impactful AI projects</li></ul>Education<ul><li>Bachelor's in Computer Science, ML, AI, Data Science, Statistics, or related field</li></ul>Technical SkillsProgramming:<ul><li>Python (expert level), SQL, and one additional language (R, Scala, or Java)</li></ul>ML Frameworks:<ul><li>TensorFlow/Keras, PyTorch, Scikit-learn, XGBoost/LightGBM</li></ul>NLP &amp; LLMs:<ul><li>Hugging Face Transformers, LangChain, OpenAI/Anthropic APIs</li><li>Vector databases (Pinecone, Weaviate, Milvus, Chroma)</li></ul>MLOps:<ul><li>MLflow, Weights &amp; Biases, Docker, Kubernetes</li><li>Model serving (TensorFlow Serving, TorchServe, BentoML)</li></ul>Cloud Platforms (at least two):<ul><li>AWS (SageMaker, Bedrock), GCP (Vertex AI), Azure ML</li></ul>Data Engineering:<ul><li>Apache Spark, data warehousing, stream processing</li></ul>Soft Skills<ul><li>Excellent English communication (written and verbal)</li><li>Self-motivated with ability to work independently</li><li>Strong problem-solving and analytical thinking</li><li>Experience working in remote, distributed teams</li></ul>Preferred Qualifications<ul><li>Publications in top ML/AI conferences (NeurIPS, ICML, ICLR, ACL)</li><li>Open-source contributions to ML frameworks</li><li>Experience with AI safety and alignment</li><li>Cloud ML certifications (AWS ML Specialty, GCP ML Engineer, Azure AI Engineer)</li><li>Domain expertise in enterprise software, fintech, healthcare, or e-commerce</li></ul>Job Type: Full-timePay: From Rs200,000.00 per month

Senior AI/ML Engineer & Data Scientist

Confiz

<div>We are seeking a Principal Data Engineer with 5+ years of hands-on experience and a strong background in real-time and batch data processing, containerization, and cloud-based data orchestration. This role is ideal for someone passionate about building robust, scalable, and efficient data pipelines, and who thrives in agile, collaborative environments.
Key Responsibilities
<ul><li>Design, build, and maintain real-time data pipelines using streaming frameworks such as Kafka, Apache Flink, and Spark Structured Streaming.</li>
<li>Develop batch processing workflows with Apache Spark (PySpark)</li>
<li>Orchestrate and schedule data workflows using orchestration frameworks such as Apache Airflow and Azure Data Factory</li>
<li>Containerize applications using Docker, manage deployments with Helm, and run them on Kubernetes</li>
<li>Implement modern storage solutions using open formats such as Parquet, Delta Lake, and Apache Iceberg</li>
<li>Build high-performance analytics engines using tools like Trino or Presto</li>
<li>Collaborate with DevOps to manage infrastructure with Terraform and integrate with CI/CD pipelines via Azure DevOps</li>
<li>Ensure data quality and consistency using tools like Great Expectations</li>
<li>Write modular, well-tested, and maintainable Python and SQL code</li>
<li>Develop an observability layer to monitor and optimize performance across data pipelines</li>
<li>Lead and mentor a team of data engineers</li>
<li>Participate in agile ceremonies and contribute to sprint planning and reviews</li>
</ul>
Required Skills &amp; Experience
<ul><li>Advanced Python programming with a strong focus on modular and testable code</li>
<li>Strong knowledge of SQL and experience working with large-scale datasets</li>
<li>Hands-on experience with at least one major cloud platform (Azure preferred)</li>
<li>Solid experience with real-time data processing (Kafka, Flink, or Spark Streaming)</li>
<li>Expertise in Apache Spark (PySpark) for batch processing</li>
<li>Experience implementing lakehouse architectures and working with columnar storage (e.g., ClickHouse)</li>
<li>Proficient in using Azure Data Factory or Apache Airflow for data orchestration</li>
<li>Experience in building APIs to expose large datasets</li>
<li>Solid experience with Docker, Kubernetes, and Helm</li>
<li>Familiarity with data lake open formats such as Parquet, Delta Lake, and Iceberg</li>
<li>Basic experience with Terraform for infrastructure provisioning</li>
<li>Practical experience with data quality frameworks (e.g., Great Expectations)</li>
<li>Comfortable working in agile development teams</li>
<li>Proven ability in debugging and performance tuning of streaming and batch data jobs</li>
<li>Experience with AI-driven tools (e.g., text-to-SQL) is a plus</li>
<li>Bachelor&rsquo;s degree in computer science or related discipline</li>
</ul>
We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), ISO 14001:2015 (EMS), ISO 45001:2018 (OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/</div>

Principal Data Engineer (PySpark)

NorthBay Solutions

<div>Job Title: SDLC Security Operations Engineer (DevSecOps)
Experience: 7&ndash;9 Years 
Location: Pakistan - Remote (UAE Business Hours) 
Employment Type: Full-Time
Job Summary
We are looking for a hands-on SDLC Security Operations Engineer to embed security controls into CI/CD pipelines and engineering workflows for a larger enterprise customer in the UAE. This role focuses on operationalizing DevSecOps integrating scanning tools, enforcing pipeline guardrails, reducing security debt, and ensuring SDLC controls align with ISO 27001, SOC 2, PIC/DSS etc.
Key Responsibilities<ul><li>
Integrate and operate security controls across CI/CD pipelines using GitHub, GitLab, Azure DevOps, and Jenkins</li><li>
Implement and manage SAST/DAST, dependency scanning, secret scanning, and pipeline security gates (build-time enforcement)</li><li>
Establish secure build and release practices: artifact integrity, signing/verification, and controlled promotions across environments</li><li>
Implement secure secrets management practices and prevent credential leakage in repos and pipelines</li><li>
Drive remediation workflows with developers: triage findings, validate fixes, reduce false positives, and improve rule tuning</li><li>
Embed security checks for infrastructure-as-code and configuration where applicable; ensure consistent secure-by-default patterns</li><li>
Support secure SDLC documentation, control mapping, and audit evidence for ISO 27001, SOC 2, etc. (policies, logs, approvals, attestations)</li><li>
Contribute to developer enablement via secure coding guidance, playbooks, and integration patterns that reduce friction</li></ul>
Required Skills &amp; Qualifications<ul><li>
7&ndash;9 years of experience in DevSecOps / Application Security Engineering / SDLC Security Operations</li><li>
Strong hands-on experience with CI/CD tools: GitHub, GitLab, Azure DevOps, Jenkins</li><li>
Hands-on experience operating AppSec tooling: SAST/DAST and software supply chain controls (dependency risk management)</li><li>
Strong understanding of secure SDLC concepts (threat modeling basics, security testing, release governance)</li><li>
Ability to collaborate deeply with engineering teams and translate findings into actionable fixes</li><li>
Familiarity with Linux-based build environments and common developer workflows</li></ul>
Preferred Certifications<ul><li>
CSSLP or equivalent application security certifications</li><li>
CISSP or CISM</li></ul>
PCI DSS / Payment Security:<ul><li>
PCIP (ISA) &ndash; PCI Professional (Internal Security Assessor)</li><li>
Qualified Security Assessor (QSA) (where applicable/available)</li></ul>
Audit / Compliance:<ul><li>
CISA</li></ul>
Cloud / DevOps:<ul><li>
AWS Certified DevOps Engineer &ndash; Professional</li><li>
AWS Certified Security &ndash; Specialty</li><li>
Microsoft Azure DevOps Engineer Expert (AZ-400)</li><li>
Microsoft Azure Security Engineer Associate (AZ-500)</li></ul>
Good to Have<ul><li>
Experience in telecom, government or regulated environments with audit-driven SDLC controls</li><li>
Exposure to container security, artifact repositories, and release governance patterns</li><li>
Automation skills (Python/Bash) to streamline scanning, reporting, and control enforcement</li></ul>
l9l3kZpOZg</div>

SDLC Security Operations Engineer (DevSecOps)

<div>We are seeking an experienced engineer to design and implement a Quality Assurance (QA) framework for automated testing across our cloud-native, real-time, and batch data pipelines. The ideal candidate will have deep expertise in Python-based test frameworks, data validation at scale, and CI/CD integration, ensuring reliability, accuracy, and performance in our data platform.
Key Responsibilities
<ul><li>Design and develop a scalable automated data quality and testing framework for real-time (Kafka/Flink/Spark Streaming) and batch (PySpark) data pipelines.</li>
<li>Integrate automated data validation (schema checks, statistical profiling, anomaly detection) into data workflows using tools like Great Expectations, Deequ, or custom-built Python solutions.</li>
<li>Build test harnesses and reusable libraries for unit, integration, and regression testing of ETL pipelines and APIs.</li>
<li>Implement continuous testing pipelines integrated with CI/CD tools (Azure DevOps, GitHub Actions, or Jenkins).</li>
<li>Collaborate with data engineers to embed data quality gates within orchestration tools (Azure Data Factory / Airflow).</li>
<li>Define and monitor data quality KPIs, thresholds, and alerting using observability tools (Datadog, Prometheus, etc.).</li>
<li>Develop mock data generation and simulation frameworks for performance and stress testing.</li>
<li>Ensure comprehensive test coverage for schema evolution, transformation logic, and downstream data consumption APIs.</li>
<li>Contribute to best practices and documentation around test-driven data engineering and quality-first development culture</li>
<li>Have experience of Shift-Left Testing and Test-Driven Data Engineering</li>
<li>Integrate QA Framework with Orchestration and Monitoring Pipelines</li>
<li>Develop Synthetic Data Generators for Edge Cases and Negative Testing</li>
<li>Validate Schema Evolution and Backward Compatibility</li>
<li>Optimize Testing for Cost Efficiency</li>
<li>Ensure Stability of Every Release</li>
</ul>
Required Skills
<ul><li>Strong knowledge of data warehousing, lakehouse architectures, and data lake</li>
<li>Overall 6+ years of experience in data warehousing domain and 3+ in ETL testing and data quality</li>
<li>Strong Python development skills, emphasizing modular, testable, and reusable code.</li>
<li>Hands on knowledge of test automation tools and libraries for data warehouse solutions.</li>
<li>Expertise with data quality libraries such as Great Expectations, Deequ, Soda Core, or equivalent.</li>
<li>Solid understanding of SQL and ability to validate transformations over large-scale datasets.</li>
<li>Familiarity with Apache Spark (PySpark) and real-time data processing frameworks (Kafka, Flink, Spark Streaming).</li>
<li>Experience with Azure ecosystem (Data Factory, Databricks, Storage, Synapse).</li>
<li>Experience with CI/CD pipelines and automated testing workflows.</li>
<li>Exposure to monitoring and alerting for data quality metrics</li>
</ul>
We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), ISO 14001:2015 (EMS), ISO 45001:2018 (OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/</div>

Data Quality & Test Automation Framework Engineer

Explore 275+ Azure data engineer in Karachi this February. Find roles across top companies and apply now to boost your career.

275 azure data engineer jobs In Karachi

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Senior AI/ML Engineer & Data Scientist

Principal Data Engineer (PySpark)

SDLC Security Operations Engineer (DevSecOps)

Data Quality & Test Automation Framework Engineer