ai engineer

data analyst

data engineer

data scientist

senior data engineer

big data engineer

Datamatics Global Services Ltd

<div><h2 class="jobSectionHeader"><b>Job Title: Big Data Engineer</b><br>
<b>Expericence - 5 to 8 Years - </b><b>CV with relevant skills will be contacted.</b></h2><h3 class="jobSectionHeader"><b>
Role Purpose</b></h3><p>
The Big Data Engineer is responsible for designing, developing, and maintaining scalable data pipelines and distributed data processing systems. This role enables efficient data ingestion, transformation, and analytics across batch and real-time environments, supporting enterprise-wide data initiatives.</p><p></p><h3 class="jobSectionHeader"><b>
Key Responsibilities</b></h3><ul><li>
Design, develop, and maintain scalable <b>batch and real-time data pipelines</b> to support analytics and business intelligence use cases</li><li>
Build and manage distributed data processing solutions using <b>Apache Hadoop</b> and <b>Apache Spark</b> within <b>Cloudera Data Platform (CDP)</b></li><li>
Develop and orchestrate <b>ETL workflows</b> using tools such as <b>Apache NiFi</b></li><li>
Implement and manage <b>real-time streaming pipelines</b> using <b>Apache Kafka</b></li><li>
Work with distributed storage systems such as <b>Hadoop Distributed File System (HDFS)</b></li><li>
Utilize query engines like <b>Apache Hive</b> and <b>Apache Impala</b> for data access and analytics</li><li>
Perform <b>data ingestion, transformation, and integration</b> from multiple structured and unstructured enterprise data sources</li><li>
Optimize data pipelines for <b>performance, scalability, and reliability</b></li><li>
Monitor and troubleshoot data workflows, ensuring high availability and data integrity</li><li>
Collaborate closely with <b>data architects, analysts, and business stakeholders</b> to deliver data solutions aligned with business needs</li><li>
Ensure adherence to <b>data governance, security, and data quality standards</b></li><li>
Document data processes, architectures, and workflows for operational efficiency</li></ul><p></p><h3 class="jobSectionHeader"><b>
Required Skills &amp; Experience</b></h3><ul><li><b>
5&ndash;8 years</b> of experience in Big Data Engineering or related roles</li><li>
Strong hands-on experience with:<ul><li>
Apache Hadoop ecosystem</li><li>
Apache Spark (PySpark/Scala preferred)</li><li>
Apache Kafka (streaming)</li><li>
Apache NiFi (data ingestion/ETL)</li></ul></li><li>
Experience with <b>Cloudera Data Platform (CDP)</b> or similar big data platforms</li><li>
Proficiency in <b>SQL</b> and at least one programming language (Python, Scala, or Java)</li><li>
Solid understanding of <b>distributed computing and parallel processing concepts</b></li><li>
Experience working with <b>HDFS, Hive, and Impala</b></li><li>
Knowledge of <b>data modeling, ETL design, and data warehousing concepts</b></li><li>
Familiarity with <b>data governance, security, and compliance frameworks</b></li><li>
Strong problem-solving and performance tuning skills</li></ul><p></p><h3 class="jobSectionHeader"><b>
Preferred Qualifications</b></h3><ul><li>
Experience with <b>cloud platforms</b> (AWS, Azure, or GCP) in big data environments</li><li>
Knowledge of <b>containerization (Docker/Kubernetes)</b> is a plus</li><li>
Exposure to <b>CI/CD pipelines</b> for data engineering workflows</li><li>
Understanding of <b>real-time analytics and event-driven architectures</b></li></ul><p></p><h3 class="jobSectionHeader"><b>
Key Competencies</b></h3><ul><li>
Analytical thinking and problem-solving</li><li>
Strong collaboration and communication skills</li><li>
Ability to work in fast-paced, data-driven environments</li><li>
Attention to detail and commitment to data quality</li></ul><p></p><h3 class="jobSectionHeader"><b>
Education</b></h3><ul><li>
Bachelor&rsquo;s or Master&rsquo;s degree in <b>Computer Science, Information Technology, Data Engineering</b>, or a related field</li></ul><p>
</p><p>x05bomsehO</p></div>

Big Data Engineer

Datamatics Technologies

<div>
 <strong>
  Job Title: Big Data Engineer
  <br/>
  Expericence - 5 to 8 Years -
 </strong>
 <u>
  <strong>
   CV with relevant skills will be contacted.
  </strong>
 </u>
 <strong>
  Role Purpose
 </strong>
 <p>
  The Big Data Engineer is responsible for designing, developing, and maintaining scalable data pipelines and distributed data processing systems. This role enables efficient data ingestion, transformation, and analytics across batch and real-time environments, supporting enterprise-wide data initiatives.
 </p>
 <strong>
  Key Responsibilities
 </strong>
 <ul>
  <li>
   Design, develop, and maintain scalable
   <strong>
    batch and real-time data pipelines
   </strong>
   to support analytics and business intelligence use cases
  </li>
  <li>
   Build and manage distributed data processing solutions using
   <strong>
    Apache Hadoop
   </strong>
   and
   <strong>
    Apache Spark
   </strong>
   within
   <strong>
    Cloudera Data Platform (CDP)
   </strong>
  </li>
  <li>
   Develop and orchestrate
   <strong>
    ETL workflows
   </strong>
   using tools such as
   <strong>
    Apache NiFi
   </strong>
  </li>
  <li>
   Implement and manage
   <strong>
    real-time streaming pipelines
   </strong>
   using
   <strong>
    Apache Kafka
   </strong>
  </li>
  <li>
   Work with distributed storage systems such as
   <strong>
    Hadoop Distributed File System (HDFS)
   </strong>
  </li>
  <li>
   Utilize query engines like
   <strong>
    Apache Hive
   </strong>
   and
   <strong>
    Apache Impala
   </strong>
   for data access and analytics
  </li>
  <li>
   Perform
   <strong>
    data ingestion, transformation, and integration
   </strong>
   from multiple structured and unstructured enterprise data sources
  </li>
  <li>
   Optimize data pipelines for
   <strong>
    performance, scalability, and reliability
   </strong>
  </li>
  <li>
   Monitor and troubleshoot data workflows, ensuring high availability and data integrity
  </li>
  <li>
   Collaborate closely with
   <strong>
    data architects, analysts, and business stakeholders
   </strong>
   to deliver data solutions aligned with business needs
  </li>
  <li>
   Ensure adherence to
   <strong>
    data governance, security, and data quality standards
   </strong>
  </li>
  <li>
   Document data processes, architectures, and workflows for operational efficiency
  </li>
 </ul>
 <strong>
  Required Skills &amp; Experience
 </strong>
 <ul>
  <li>
   <strong>
    5&ndash;8 years
   </strong>
   of experience in Big Data Engineering or related roles
  </li>
  <li>
   Strong hands-on experience with:
   <ul>
    <li>
     Apache Hadoop ecosystem
    </li>
    <li>
     Apache Spark (PySpark/Scala preferred)
    </li>
    <li>
     Apache Kafka (streaming)
    </li>
    <li>
     Apache NiFi (data ingestion/ETL)
    </li>
   </ul>
  </li>
  <li>
   Experience with
   <strong>
    Cloudera Data Platform (CDP)
   </strong>
   or similar big data platforms
  </li>
  <li>
   Proficiency in
   <strong>
    SQL
   </strong>
   and at least one programming language (Python, Scala, or Java)
  </li>
  <li>
   Solid understanding of
   <strong>
    distributed computing and parallel processing concepts
   </strong>
  </li>
  <li>
   Experience working with
   <strong>
    HDFS, Hive, and Impala
   </strong>
  </li>
  <li>
   Knowledge of
   <strong>
    data modeling, ETL design, and data warehousing concepts
   </strong>
  </li>
  <li>
   Familiarity with
   <strong>
    data governance, security, and compliance frameworks
   </strong>
  </li>
  <li>
   Strong problem-solving and performance tuning skills
  </li>
 </ul>
 <strong>
  Preferred Qualifications
 </strong>
 <ul>
  <li>
   Experience with
   <strong>
    cloud platforms
   </strong>
   (AWS, Azure, or GCP) in big data environments
  </li>
  <li>
   Knowledge of
   <strong>
    containerization (Docker/Kubernetes)
   </strong>
   is a plus
  </li>
  <li>
   Exposure to
   <strong>
    CI/CD pipelines
   </strong>
   for data engineering workflows
  </li>
  <li>
   Understanding of
   <strong>
    real-time analytics and event-driven architectures
   </strong>
  </li>
 </ul>
 <strong>
  Key Competencies
 </strong>
 <ul>
  <li>
   Analytical thinking and problem-solving
  </li>
  <li>
   Strong collaboration and communication skills
  </li>
  <li>
   Ability to work in fast-paced, data-driven environments
  </li>
  <li>
   Attention to detail and commitment to data quality
  </li>
 </ul>
 <strong>
  Education
 </strong>
 <ul>
  <li>
   Bachelor&rsquo;s or Master&rsquo;s degree in
   <strong>
    Computer Science, Information Technology, Data Engineering
   </strong>
   , or a related field
  </li>
 </ul>
</div>


Mashreq

<div>
 <p>
  Job Purpose
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Data &amp; Analytics Driven Organization:
  </strong>
  One Data and Finance Reporting Function drive the vision to transform the Bank into a Data Driven Organization (DDO) using latest tools and technologies in Data space. RBG Data team is a stream within One Data Organization driving this agenda for Retail Banking function.
 </p>
 <ul>
  <li>
   Principal Data Engineer/Lead Data Engineer will design and maintain data pipelines of real-time and batch, creates data strategy, data architecture, best practices and who can lead the organization in making strategical improvements in the data engineering solutions.
  </li>
  <li>
   This role requires to have a knowledge of core system, retail banking systems, digital journeys, marketing systems, risk and compliance systems which are very data intensive systems across UAE, Egypt, Pakistan etc where bank operates retail business.
  </li>
  <li>
   Our core function spans multiple platforms like Enterprise Data Lake, Azure Data Lake, Business Intelligence, Advanced Analytics and Realtime Streaming platforms.
  </li>
  <li>
   The work involves developing new requirements in both on-premises and cloud data lake&rsquo;s estimating the efforts, designing an effective solution, data architecture and management, change release management, resource management, handling the deliverables across the business groups in the Bank. Also, handling critical applications that influence bank&rsquo;s management decision making process, regulatory reporting (which can influence financial/non-financial penalties) and operational reporting.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  Key result Areas
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Develops and maintains scalable data pipelines of batch and real-time to support continuing increases in data demands of volume and complexity.
  </li>
  <li>
   Leading data engineering team and ensuring best practices and quality on the deliveries.
  </li>
  <li>
   Designs and Develops Data domains across banking products and laying foundation for Data Mesh architecture.
  </li>
  <li>
   Demonstrate deep knowledge and experience in databases, Datamart's, Data Modelling, Data Governance, Data Security, BI tools, ETL Solutions.
  </li>
  <li>
   Data Orchestration and Data-Ops practices enabler for the team
  </li>
  <li>
   Collaborates with analyst, data scientists and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
  </li>
  <li>
   Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
  </li>
  <li>
   Writes unit/integration tests, contributes to engineering wiki, and documents work.
  </li>
  <li>
   Experience in Automating Deployment, scheduling, monitoring, and management of datasets and pipelines
  </li>
  <li>
   Understand business requirements and identify key performance indicators (KPIs) in Data Engineering.
  </li>
  <li>
   Design data models to transform raw data into meaningful insights.
  </li>
  <li>
   Ability to Debug Data issues in data platforms and Provide L2, L3 Production support as per SLA.
  </li>
  <li>
   Recommend improvements to enhance existing ETL and data integration processes to enable performance and overall scalability.
  </li>
  <li>
   Evaluate company's present data infrastructure/governance/architecture, identify gaps, and develop plans to integrate the current systems with the desired future model.
  </li>
  <li>
   Identify, analyze various risks, and implement risk management controls, RCSA and contingency plans on Data Platform to mitigate future risk.
  </li>
  <li>
   Reviewing, executing, and documenting Audit activities and its corrective actions on Data Platform.
  </li>
  <li>
   Ensuring Data Platform security and compliance with data privacy regulations and company policies. Implementing access controls, data masking, and encryption where necessary to safeguard sensitive information.
  </li>
  <li>
   Understands industry trends and the practical application of existing, new, and emerging technologies.
  </li>
  <li>
   Forecasting future data storage and processing requirements and planning for scalability. Identifying potential bottlenecks and devising strategies to accommodate growing data volumes.
  </li>
  <li>
   Developing and maintaining disaster recovery plans and business continuity strategies to address potential risks and minimize downtime.
  </li>
  <li>
   Communicate and effectively articulate the DWH/DL solution/roadmaps to business and technical delivery teams.
  </li>
  <li>
   Coordinate with change management approval board to get all desired approvals and ensure production deployments on timely manner.
  </li>
  <li>
   Collaborate with Incident management team to track and report on incidents, their resolutions, and any necessary follow-up actions.
  </li>
 </ul>
 <p>
  Interacting with Data Platform software and hardware vendors to coordinate support, updates, and service-level agreements.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Knowledge, Skills and Experience
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Core Skills:
  </strong>
 </p>
 <ul>
  <li>
   Principal Data engineer with a solid technical background and experience in data-intensive systems (&gt; 15 years)
  </li>
  <li>
   Strong experience in Big Data, Hadoop Ecosystem, Spark Streaming, Kafka, Python, SQL, Hive, NIFI, Airflow
  </li>
  <li>
   Proficient with Azure Cloud services such as Azure Data Factory (ADF), Databricks, ADLS, Azure Synapse, Logic Apps, Azure Functions. Or similar data stack knowledge within Google/AWS cloud services
  </li>
  <li>
   Proficiency in relational SQL, Graph and NoSQL databases.
  </li>
  <li>
   Proficiency in Elastic Search and Couchbase databases
  </li>
  <li>
   In-depth skills in developing and maintaining ETL/ELT data pipelines.
  </li>
  <li>
   Experience in data modelling techniques such as Kimball star schema, 3NF, vault modelling etc.
  </li>
  <li>
   Experience in workflow management tools such as Airflow, Oozie and CI/CD tools
  </li>
  <li>
   Data streaming solution in Kafka or Confluent Kafka
  </li>
  <li>
   Hands on experience in Google Big Query, Google Analytics &amp; Clickstream Data Model
  </li>
  <li>
   Reporting knowledge in Power BI, Tableau, Qlik etc.
  </li>
  <li>
   Sound in Data Management Fundamentals and Data Architect, Modelling, Governance
  </li>
  <li>
   Strong Domain Knowledge in Banking/Finance area like understanding of the various processes, products, and services within the banking industry, core functions, regulations, and operational aspects of banking institutions
  </li>
  <li>
   Hands on knowledge in Hadoop and Azure/AWS cloud ecosystem and ETL jobs migration
  </li>
  <li>
   Knowledge of Advance Analytics and AI tools
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Management Skills:
  </strong>
 </p>
 <ul>
  <li>
   People management responsibilities encompass the tasks and activities involved in leading, guiding, and developing a team of individuals to achieve organizational goals effectively.
  </li>
  <li>
   Setting clear performance expectations, conducting regular performance reviews, providing feedback, and offering guidance on areas of improvement.
  </li>
  <li>
   Follow predefined processes and workflows to carry out specific tasks and activities accurately and in a timely manner.
  </li>
  <li>
   Identify opportunities for process improvement and efficiency enhancement and provide feedback or suggestions to optimize workflows.
  </li>
  <li>
   Analyze the needs, expectations, and concerns of each stakeholder. Assess their level of influence, interest, and potential power to affect the project's success.
  </li>
  <li>
   Developing a comprehensive project plan that outlines the project scope, objectives, deliverables, timelines, resource requirements, and budget.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Additional Skills Desired:
  </strong>
 </p>
 <ul>
  <li>
   Bachelors/Master&rsquo;s degree in computer science or equivalent
  </li>
  <li>
   Excellent verbal and written communication skills and good stake holder management skills
  </li>
  <li>
   Strong Analytical thinking and ability to handle stakeholders.
  </li>
  <li>
   Confident in decision making and the ability to explain processes or choices as needed.
  </li>
  <li>
   Ability to multitask on multiple projects in various phases.
  </li>
  <li>
   Agile and waterfall Project Methodology Knowledge
  </li>
  <li>
   Program Management &amp; Deliverable
  </li>
 </ul>
 <p>
 </p>
</div>


AVP - Technology - Data Engineer (Mashreq Global Network Pakistan)

Contour Software

<div><p><b>About Contour</b></p><p></p><p>
Contour Software has grown from a dozen people to over 2,000 staff across 3 cities, in less than 14 years.</p><p><br>
As a subsidiary of Constellation Software Inc., we are proud to be part of a global enterprise software conglomerate that has grown to become one of the top 10 software companies in the world, with employees and customers in 100+ countries. With a broad-based and ever-growing portfolio of market-leading, vertical-market enterprise solutions covering more than 100 industry domains in predominantly mature markets, CSI's recipe creates the perfect environment for professionals to build fulfilling, long-term careers.</p><p><br>
What started as an R&amp;D &amp; Accounting back-office, has progressed into a full-service Global Centre serving all functions and departments, at the divisional as well as operating group/corporate level. Today Contour employees, located in Karachi, Lahore &amp; Islamabad, are serving CSI divisions located in time zones spanning the globe, from Sydney to Vancouver. With the global growth of Constellation as the wind in our sails, we are only just getting started!</p><p></p><div><div><p><b>
The Division:</b><br>
Constellation Payments is a leading global gateway and merchant services provider with special expertise in software integration and recurring transactions representing a wide variety of verticals &ndash; including government entities, municipalities, moving and storage, club management, attractions, fitness, martial arts, event registration and hospitality management.</p></div><p></p><div><p><b>
The Position:</b><br>
We are looking for a Data Engineer to join our development team and participate in different projects. We are looking for proactive people, team players passionate about technology and big data. This is an excellent opportunity for those professionals looking to develop in one of the fastest growing areas of software development.</p></div><div><p>
The selected individuals will work out of the Contour Software Lahore/Karachi/Islamabad resource center office, as an extension of the division-based R&amp;D department.</p></div><p></p><div><p><b>
Role and Responsibilities:</b></p></div><div><ul><li><p>
Write efficient queries to extract and analyze large datasets while ensuring seamless systems integration by developing robust data workflows.</p></li></ul></div><div><ul><li><p>
Design, develop, and maintain scalable ETL solutions for data pipelines, enhancing and optimizing existing processes to meet evolving business needs.</p></li></ul></div><div><ul><li><p>
Develop and expand the organization&rsquo;s data technology stack to support advanced data processing and analytics needs, leveraging tools like AWS MapReduce and PySpark for big data handling.</p></li></ul></div><div><ul><li><p>
Apply machine learning techniques to clean and process data, supporting future initiatives to integrate machine learning into analytics workflows.</p></li></ul></div><div><ul><li><p>
Continuously evaluate and adopt the most efficient tools and technologies for data extraction, transformation, analysis, and integration.</p></li></ul></div><div><ul><li><p>
Build a strong understanding of customer business needs to deliver tailored and impactful data solutions, collaborating with stakeholders to translate business requirements into technical implementations.</p></li></ul></div><div><ul><li><p>
Utilize AWS services, including MapReduce and related tools, to enable scalable data processing and pipeline optimization while ensuring security, scalability, and cost-efficiency.</p></li></ul></div><div><ul><li><p>
Monitor and improve the performance of data systems and processes, staying updated on industry trends and emerging technologies in data engineering and analytics.</p></li></ul></div><p></p><div><p><b>
Required Skills:</b></p></div><div><ul><li><p>
Minimum 3 years of experience with AWS cloud data lake architectures including services like S3, Glue, Athena, and Redshift.</p></li></ul></div><div><ul><li><p>
Hands on experience with Apache Airflow for designing and managing complex data workflows.</p></li></ul></div><div><ul><li><p>
Deep understanding of data warehouse concepts, architectures, and structures.</p></li></ul></div><div><ul><li><p>
Expertise in cloud technologies, particularly AWS services, including AWS Glue, AWS Data Lake, and Amazon EMR for big data processing.</p></li></ul></div><div><ul><li><p>
Proven ability to design and build robust, scalable data pipelines for big data processing and transformation.</p></li></ul></div><div><ul><li><p>
Hands-on experience with big data tools and frameworks such as PySpark, Databricks, and related technologies.</p></li></ul></div><div><ul><li><p>
Proficiency in programming languages such as Python for data manipulation, transformation, and analysis. Advanced Python development skills, including experience with AWS SDKs (e.g. boto3) for interacting with cloud services.</p></li></ul></div></div><div><div><ul><li><p>
Proficiency in Apache Kafka for real-time data streaming and event-driven architectures.</p></li></ul></div><div><ul><li><p>
Strong SQL skills with a focus on complex query development and optimization. Familiarity with NoSQL databases such as DynamoDB or MongoDB</p></li></ul></div><div><ul><li><p>
Experience integrating Python applications with RESTful APIs and external services</p></li></ul></div><div><ul><li><p>
Deep understanding of data security best practices, including encryption at rest and in transit. Hands-on experience in implementing AWS KMS (Key Management Services) for managing encryption keys.</p></li></ul></div><div><ul><li><p>
Familiarity with IAM policies, VPC configurations, and security groups for securing data pipelines.</p></li></ul></div><div><ul><li><p>
Familiarity with machine learning concepts and their application to data cleaning and integration tasks.</p></li></ul></div><div><ul><li><p>
Advanced English proficiency, with excellent communication skills for collaborating with stakeholders</p></li></ul></div></div><p></p><p><b>
Exciting Benefits we offer:</b></p><ul><li><p>
Market-leading Salary</p></li><li><p>
Medical Coverage &ndash; Self &amp; Dependents</p></li><li><p>
Parents Medical Coverage</p></li><li><p>
Provident Fund</p></li><li><p>
Employee Performance-based bonuses</p></li><li><p>
Home Internet Subsidy</p></li><li><p>
Conveyance Allowance</p></li><li><p>
Profit Sharing Plan [Tenured Employees Only]</p></li><li><p>
Life Benefit</p></li><li><p>
Child Care Facility</p></li><li><p>
Company Provided Lunch/Dinner</p></li><li><p>
Professional Development Budget</p></li><li><p>
Recreational area for in-house games</p></li><li><p>
Sporadic On-shore training opportunities</p></li><li><p>
Friendly work environment</p></li><li><p>
Leave Encashment</p></li></ul><p></p><p><b><i>
Disclaimer:</i></b><i> At Contour, we attribute our success to the unique contributions of our diverse staff. We&rsquo;re committed to fostering a culture of respect that thrives on the varied perspectives and experiences of all individuals we recruit, employ, promote, and compensate. Since day one, we&rsquo;ve adhered to a policy that champions a work environment honoring the worth and dignity of each person while being free from all forms of employment discrimination.</i></p><p></p><p><i>
In our continuous effort to promote inclusivity, we extend our commitment to individuals with special needs by providing reasonable accommodations. We actively encourage qualified individuals with special needs to apply for the various openings within our company. Should you require assistance in completing the application process or have any inquiries regarding special facilities, please do not hesitate to contact our HR team. Your unique talents and abilities are welcomed and valued here.</i></p></div><p></p>

Data Engineer

<div><h2 class="jobSectionHeader"><b>Job Title: Data Engineer</b></h2><p><b>
Experience:</b> 3&ndash;5 Years<br>
<b>Location:</b> Remote<br>
<br>
<b>Only CV matching with JD will be Shortlisted</b></p><p></p><h3 class="jobSectionHeader"><b>
Role Purpose</b></h3><p>
We are looking for a skilled <b>Data Engineer</b> to design, build, and maintain scalable data pipelines within the Azure ecosystem. You will play a key role in enabling data-driven insights by developing reliable data solutions that support analytics, reporting, and business intelligence initiatives.</p><p></p><h3 class="jobSectionHeader"><b>
Key Responsibilities</b></h3><ul><li>
Develop and maintain <b>ETL/ELT pipelines</b> using <b>Azure Data Factory (ADF)</b></li><li>
Work with <b>Azure Data Lake Storage (ADLS)</b> for data ingestion, storage, and processing</li><li>
Build and optimize data transformations using <b>PySpark</b> and <b>SQL</b></li><li>
Integrate data from multiple structured and unstructured sources</li><li>
Ensure <b>data quality, integrity, and consistency</b> across pipelines</li><li>
Support implementation of <b>Lakehouse architecture</b> and <b>Medallion (Bronze, Silver, Gold) layers</b></li><li>
Collaborate with analysts and BI teams to enable reporting and data models</li><li>
Monitor, troubleshoot, and resolve data pipeline issues</li><li>
Document data processes, workflows, and pipeline logic</li></ul><p></p><h3 class="jobSectionHeader"><b>
Required Skills &amp; Experience (3&ndash;5 Years)</b></h3><ul><li>
Hands-on experience with <b>Azure Data Factory (ADF)</b> and <b>ADLS</b></li><li>
Strong programming skills in <b>PySpark</b> and <b>SQL</b></li><li>
Experience in building and maintaining <b>ETL pipelines</b></li><li>
Working knowledge of <b>structured and unstructured data processing</b></li><li>
Basic understanding of <b>Lakehouse architecture</b> and <b>Medallion framework</b></li><li>
Familiarity with <b>Delta Lake concepts</b></li><li>
Strong <b>problem-solving and debugging</b> skills</li></ul><p></p><h3 class="jobSectionHeader"><b>
Preferred Qualifications</b></h3><ul><li>
Experience with <b>Azure Databricks</b></li><li>
Understanding of <b>data modeling and data warehousing concepts</b></li><li>
Exposure to <b>data governance and data quality frameworks</b></li><li>
Experience working in <b>Agile/Scrum environments</b></li></ul><p></p><h3 class="jobSectionHeader"><b>
Soft Skills</b></h3><ul><li>
Strong communication and stakeholder collaboration skills</li><li>
Analytical mindset with attention to detail</li><li>
Ability to work independently in a <b>remote setup</b></li><li>
Team player with a proactive approach to problem-solving</li></ul><p></p><h3 class="jobSectionHeader"><b>
Career Progression Opportunity</b></h3><p>
This role provides a pathway to grow into a <b>Senior Data Engineer (5&ndash;10 Years)</b> position, where responsibilities include:</p><ul><li>
Designing end-to-end data architectures</li><li>
Working extensively with <b>Microsoft Fabric</b> and advanced Azure services</li><li>
Leading data engineering initiatives and mentoring team members</li><li>
Optimizing large-scale distributed data systems</li></ul><p>
</p><p>OkBtJaBo56</p></div>

<div><h2 class="jobSectionHeader"><b>Note: Only CV which are as per JD will be contacted.</b><br>
<br>
<b>Job Title: Data Engineer / Senior Data Engineer</b><br>
<b>Location : UAE - Onsite</b><br>
</h2><h3 class="jobSectionHeader"><b>
Role Purpose</b></h3><p>
Design, develop, and maintain scalable data pipelines and modern data platforms using Microsoft Fabric and Azure ecosystem. The role involves building efficient data solutions that support analytics, reporting, and advanced data use cases across the organization.</p><p></p><h3 class="jobSectionHeader"><b>
Key Responsibilities</b></h3><ul><li>
Design, build, and maintain robust ETL/ELT pipelines using <b>Azure Data Factory (ADF)</b> and <b>Microsoft Fabric</b></li><li>
Develop and optimize data workflows using <b>PySpark</b> and <b>SQL</b></li><li>
Implement and manage <b>Lakehouse architecture</b> using <b>Medallion (Bronze, Silver, Gold) layers</b></li><li>
Work with <b>Azure Data Lake Storage (ADLS)</b> and <b>Delta Lake</b> for efficient data storage and processing</li><li>
Integrate data from multiple sources ensuring data quality, consistency, and reliability</li><li>
Collaborate with BI developers and analysts to enable data models and reporting solutions</li><li>
Monitor, troubleshoot, and optimize data pipelines and performance issues</li><li>
Ensure data governance, security, and compliance best practices</li></ul><p></p><h3 class="jobSectionHeader"><b>
Additional Responsibilities (Senior Data Engineer)</b></h3><ul><li>
Lead the design and architecture of scalable data platforms and solutions</li><li>
Define data engineering standards, best practices, and frameworks</li><li>
Mentor junior data engineers and review code for quality and performance</li><li>
Optimize large-scale data processing and improve system efficiency</li><li>
Collaborate with stakeholders to translate business requirements into technical solutions</li><li>
Drive adoption of <b>Microsoft Fabric</b> and modern data engineering practices across teams</li></ul><p></p><h3 class="jobSectionHeader"><b>
Required Skills &amp; Experience</b></h3><h4 class="jobSectionHeader"><b>
For Data Engineer (3&ndash;5 Years)</b></h4><ul><li>
Hands-on experience with <b>Azure Data Factory (ADF)</b> and <b>ADLS</b></li><li>
Strong programming skills in <b>PySpark</b> and <b>SQL</b></li><li>
Experience in building ETL pipelines and working with structured/unstructured data</li><li>
Basic understanding of <b>Lakehouse</b> and <b>Medallion architecture</b></li><li>
Familiarity with <b>Delta Lake</b> concepts</li><li>
Good problem-solving and debugging skills</li></ul><h4 class="jobSectionHeader"><b>
For Senior Data Engineer (5&ndash;10 Years)</b></h4><ul><li>
Extensive experience in <b>Azure data ecosystem</b> and <b>Microsoft Fabric</b></li><li>
Strong expertise in designing <b>end-to-end data architectures</b></li><li>
Deep understanding of <b>Lakehouse, Medallion architecture</b>, and <b>Delta Lake</b></li><li>
Proven experience in handling large-scale distributed data processing</li><li>
Strong performance tuning and optimization skills</li><li>
Experience leading projects and mentoring teams</li></ul><p></p><h3 class="jobSectionHeader"><b>
Preferred Qualifications</b></h3><ul><li>
Experience in <b>Azure Databricks</b></li><li>
Knowledge of data modeling and data warehousing concepts</li><li>
Exposure to data governance and data quality frameworks</li><li>
Experience working in Agile environments</li></ul><p></p><h3 class="jobSectionHeader"><b>
Soft Skills</b></h3><ul><li>
Strong communication and stakeholder management skills</li><li>
Analytical thinking and problem-solving mindset</li><li>
Ability to work independently and in a collaborative team environment</li></ul><p>
</p><p>Pi3WGqPOnG</p></div>

Data Engineer / Senior Data Engineer

<div><h2 class="jobSectionHeader"><b>Job Title: Data Architect</b></h2><p><b>
Experience:</b> 9+ Years<br>
<b>Industry:</b> Banking / Financial Services<br>
<b>Location:Pakistan</b><br>
<b>Employment Type:</b> Full-Time</p><p></p><h2 class="jobSectionHeader"><b>
Job Summary</b></h2><p>
We are seeking an experienced <b>Data Architect</b> with a strong background in <b>AI/ML and Big Data architectures</b> to design, implement, and govern enterprise-wide data solutions. The ideal candidate will play a critical role in enabling data-driven decision-making, advanced analytics, and AI capabilities within a banking environment while ensuring compliance with regulatory and security standards.</p><p></p><h2 class="jobSectionHeader"><b>
Key Responsibilities</b></h2><ul><li>
Design and implement <b>enterprise data architecture</b> across traditional systems, Big Data platforms, and cloud ecosystems.</li><li>
Architect scalable <b>data lakes, data warehouses, and lakehouse solutions</b> supporting structured and unstructured data.</li><li>
Define and manage <b>data models, metadata frameworks, and data integration patterns</b> for enterprise-wide use.</li><li>
Build and optimize <b>data pipelines</b> for batch and real-time processing using technologies like Hadoop, Spark, and Kafka.</li><li>
Enable <b>AI/ML use cases</b> by designing data platforms compatible with Python-based frameworks such as TensorFlow, PyTorch, and MLflow.</li><li>
Lead cloud data architecture initiatives across <b>AWS, Azure, and GCP</b>, ensuring high availability, scalability, and cost efficiency.</li><li>
Implement and enforce <b>data governance, data quality, and data security frameworks</b> using tools such as Collibra, Alation, and Apache Atlas.</li><li>
Collaborate with cross-functional teams including <b>data engineers, data scientists, business analysts, and IT teams</b>.</li><li>
Design and oversee <b>ETL/ELT processes</b> using tools like Informatica, Talend, and dbt.</li><li>
Utilize orchestration frameworks such as <b>Apache Airflow</b> to automate and monitor workflows.</li><li>
Ensure compliance with <b>banking regulations, data privacy laws, and security standards</b>.</li><li>
Evaluate and recommend emerging technologies to enhance the organization&rsquo;s data capabilities.</li></ul><p></p><h2 class="jobSectionHeader"><b>
Required Skills &amp; Qualifications</b></h2><ul><li>
Bachelor&rsquo;s or Master&rsquo;s degree in <b>Computer Science, Information Systems, Data Science, or related field</b>.</li><li>
9+ years of experience in <b>data architecture, data engineering, or related roles</b>, preferably in the banking or financial services industry.</li><li>
Strong expertise in <b>Big Data technologies</b>: Hadoop, Spark, Kafka.</li><li>
Hands-on experience with <b>cloud platforms</b>: AWS, Microsoft Azure, or Google Cloud Platform.</li><li>
Proficiency in <b>data modeling (conceptual, logical, physical)</b> and database design.</li><li>
Experience with <b>data warehousing and lakehouse architectures</b> (Snowflake, Databricks).</li><li>
Strong understanding of <b>AI/ML data pipelines and frameworks</b> (Python, TensorFlow, PyTorch).</li><li>
Expertise in <b>ETL/ELT tools</b> and data pipeline orchestration.</li><li>
Knowledge of <b>data governance, metadata management, and data quality frameworks</b>.</li><li>
Familiarity with <b>banking data domains</b> (risk, compliance, fraud, customer analytics).</li><li>
Excellent problem-solving, communication, and stakeholder management skills.</li></ul><p></p><h2 class="jobSectionHeader"><b>
Preferred Qualifications</b></h2><ul><li>
Certifications in <b>Cloud Platforms (AWS/Azure/GCP)</b> or <b>Data Architecture</b>.</li><li>
Experience with <b>real-time streaming architectures</b>.</li><li>
Knowledge of <b>regulatory frameworks</b> such as Basel III, GDPR, or local banking compliance standards.</li><li>
Exposure to <b>Data Mesh or Data Fabric architectures</b>.</li><li>
Experience with <b>API-based data integration and microservices architecture</b>.</li></ul><p></p><h2 class="jobSectionHeader"><b>
Key Competencies</b></h2><ul><li>
Strategic Thinking</li><li>
Data Governance &amp; Compliance</li><li>
Solution Architecture</li><li>
Stakeholder Management</li><li>
Innovation &amp; Continuous Improvement</li></ul><p>
</p><p>Vxk31DGthf</p></div>

Data Architect

Explore 862+ Big data engineer in Karachi this May. Find roles across top companies and apply now to boost your career.

862 big data engineer jobs In Karachi

Big Data Engineer

Big Data Engineer

AVP - Technology - Data Engineer (Mashreq Global Network Pakistan)

Data Engineer

Data Engineer

Data Engineer / Senior Data Engineer

Data Architect