civil engineer

planning engineer

electrical engineer

business analyst

project engineer

data pipeline engineer

NETbuilder

<div>
 
 
 Data Pipeline Engineer
 
 
 
 
 Location: Dubai
 
 
 
 
 Travel to Saudi
 
 
 
 
 About us
 
 
 
 We&rsquo;re a global tech consultancy with over 20 years of experience delivering digital transformation across financial services, government, and commercial sectors. We offer a supportive environment where your voice is heard, your growth is supported, and your career path is tailored to you.
 
 
 
 Role Overview
 
 
 
 As a Data Pipeline Engineer at NETbuilder, you will work on projects to help clients operate successfully. You will collaborate with diverse stakeholders, including end users, business analysts, designers, and operations teams, to solve complex problems and execute hands-on engineering tasks.
 
 
 
 Key Responsibilities
 
 
 <ul>
 <li>
 Solution Design &amp; Implementation: Design, implement, and maintain solutions.
 </li>
 <li>
 Data Onboarding: Onboard complex data sources.
 </li>
 <li>
 Client Engagement: Manage client relationships and work directly with customers to understand their data and technology challenges.
 </li>
 <li>
 Consultation &amp; Support: Provide pre-sales support and assist with customer training and adoption.
 </li>
 <li>
 Best Practices: Stay up to date on Cribl best practices to ensure optimal solution delivery.
 </li>
 </ul>
 
 
 Key Skills &amp; Qualifications
 
 
 
 
 Required:
 
 
 <ul>
 <li>
 Able to obtain a Saudi Visa (and UAE visa if Dubai based)
 </li>
 <li>
 Proven experience in data logging/pipeline tools such as Splunk, Cribl or Elastic.
 </li>
 <li>
 Proven experience working with clients to manage demands, expectations, and business requirements.
 </li>
 <li>
 Proficiency in data onboarding activities, including developing custom parsing functions and transformations.
 </li>
 <li>
 Experience in writing complex queries, parsers and handling data streams
 </li>
 <li>
 Ability to solve complex problems with hands-on engineering tasks.
 </li>
 <li>
 2+ years of experience with relevant data tool (i.e., Splunk, Elastic, Cribl)
 </li>
 </ul>
 
 
 Preferred:
 
 
 <ul>
 <li>
 Experience configuring and maintaining large data pipelining environments.
 </li>
 <li>
 Proficiency in scripting languages (e.g., Python, Bash) and writing regular expressions.
 </li>
 <li>
 Familiarity with containerized solutions (Kubernetes, Docker, OpenShift).
 </li>
 <li>
 Experience with cloud computing platforms (AWS, Azure, or GCP).
 </li>
 <li>
 Previous experience using PMO and ITSM tooling (ServiceNow, JIRA, Confluence).
 </li>
 </ul>
 
 
 Certifications:
 
 
 <ul>
 <li>
 Certified in relevant data logging/pipeline tool such as Cribl, Splunk or Elastic.
 </li>
 </ul>
 
 
 Personal Attributes
 
 
 <ul>
 <li>
 Passionate about technology and technical development.
 </li>
 <li>
 Proactive approach to problem-solving with excellent analytical skills.
 </li>
 <li>
 Self-sufficient with strong written and verbal communication skills.
 </li>
 <li>
 Ability to engage with non-technical staff and collaborate effectively with peers.
 </li>
 <li>
 Strong team-playing mentality and ability to work to tight deadlines.
 </li>
 </ul>
 
 
</div>

Data Pipeline Engineer

Dubai Holding

<div>
 
 Established in 2004, Dubai Holding is a global investment company with investments in more than 34 countries and a combined workforce of nearly 45,000 individuals. In line with the vision of Dubai&rsquo;s leadership and economic diversification strategy, Dubai Holding companies have nurtured sectors, irrevocably transforming Dubai&rsquo;s socio-economic landscape and positioning Dubai as a diversified, globally integrated economy.
 
 
 
 
 
 Dubai Holding is committed to the diversification of Dubai&rsquo;s non-oil economy. Our portfolio, valued at over AED 280+ billion, spans 10 sectors, including real estate, hospitality, leisure &amp; entertainment, ICT, design, education, media, retail, manufacturing &amp; logistics, and science.
 
 
 
 
 
 
 For the Good of Tomorrow
 
 
 
 Dubai Holding is looking to hire a
 
 Data Engineer
 
 . The role is responsible for leading the design, development, and maintenance of data solutions that support product teams in leveraging data for their specific needs. This role involves building and managing data pipelines, data lakes, and data warehouses, ensuring high-quality data delivery, and fostering a culture of process and data quality within development teams while being compliant with data protection/ privacy regulations and policies.
 
 
 
 
 
 If you are ready to embark on a dynamic journey where your talents are valued, and your contributions make a real impact, we would like to hear from you.
 
 
 
 
 
 
 Key Accountabilities:
 
 
 
 
 Data Infrastructure &amp; Pipeline Development
 
 
 <ul>
 <li>
 Design, build, and maintain data pipelines, lakes, and warehouses.
 </li>
 <li>
 Develop ETL jobs and stored procedures/functions/packages.
 </li>
 <li>
 Ensure robust data storage and high-quality data delivery.
 </li>
 </ul>
 
 
 Technical Guidance &amp; Integration
 
 
 <ul>
 <li>
 Own and implement ETL operating standards.
 </li>
 <li>
 Provide guidance on infrastructure for analytics and AI use cases.
 </li>
 <li>
 Collaborate with backend developers and IT architecture teams for seamless integration.
 </li>
 </ul>
 
 
 Product &amp; Stakeholder Collaboration
 
 
 <ul>
 <li>
 Work with Product Owners to understand and meet data needs.
 </li>
 <li>
 Translate product requirements into engineering plans and roadmaps.
 </li>
 <li>
 Gather stakeholder requirements and build architectures aligned with business goals.
 </li>
 </ul>
 
 
 Quality &amp; Process Excellence
 
 
 <ul>
 <li>
 Promote a culture of process and data quality.
 </li>
 <li>
 Implement best practices for data management and quality assurance.
 </li>
 <li>
 Support bug fixing and performance optimization.
 </li>
 </ul>
 
 
 Agile Delivery &amp; Team Collaboration
 
 
 <ul>
 <li>
 Advocate for agile methodologies and iterative development
 </li>
 <li>
 Collaborate cross-functionally to deliver project outcomes.
 </li>
 </ul>
 
 
 
 
 
 Who we are looking for:
 
 
 <ul>
 <li>
 At least 3-6 years of experience in Data Engineering roles
 </li>
 <li>
 Bachelor&rsquo;s Degree in a quantitative field (Mathematics, Engineering, Statistics, Science, Data Science/ AI); Advanced degrees preferred.
 </li>
 <li>
 Experience in Big Data platform like Databricks, Spark, Hive, Palantir Foundry etc.
 </li>
 <li>
 Experience in implementing AI solutions including OCR, Large Language Models, etc.
 </li>
 <li>
 Experienced with data modelling, design patterns, building highly scalable and secured analytical solutions.
 </li>
 <li>
 Proficiency in Python, SQL, PL/SQL, Spark and similar languages
 </li>
 <li>
 Strong analytical and problem-solving skills
 </li>
 <li>
 Experience working in a tech/ product environment is a plus
 </li>
 </ul>
 
 
 
 
 
 Behavioural Competencies
 
 
 <ul>
 <li>
 High-energy, ownership-driven mindset
 </li>
 <li>
 Strong problem-solving and analytical skills
 </li>
 <li>
 Excellent communication and collaboration abilities
 </li>
 <li>
 Comfortable navigating ambiguity and driving clarity
 </li>
 <li>
 Experience in agile/start-up environments preferred
 </li>
 <li>
 Successful track record of leading complex projects is a plus
 </li>
 </ul>
 
 
 
 
 
 As much as we would be delighted to entertain all applicants, due to the high volumes of applications, only successful applicants will be contacted within 14 business days.
 
 
 
 
 
 
 
 This job description is not all inclusive. Dubai Holding reserves the right to amend this job description at any time. Dubai Holding is an Equal Opportunity Employer, committed to a diverse and inclusive work environment.
 
 
</div>

Data Engineer

DICETEK LLC

<div><ul><li>Design, build, and maintain robust, scalable, and secure ETL/ELT pipelines to ingest structured and unstructured data from internal, external, and third‑party sources.
</li><li>Support the integration, population, and optimization of the organization Data Lakehouse and data platforms in alignment with the approved enterprise data architecture.
</li><li>Ensure data pipelines support both batch and real‑time processing requirements, and are optimized for performance, reliability, and high availability.
</li><li>Collaborate closely with the Data Architect to ensure pipeline designs comply with architectural standards, integration patterns, APIs, and interoperability blueprints.
</li><li>Implement and embed data quality checks, validation rules, metadata capture, lineage tracking, and data classification workflows to support governance and trusted analytics.
</li><li>Monitor the performance, progress, and health of data pipelines and platforms, proactively identifying bottlenecks, failures, and optimization opportunities to improve efficiency and productivity.
</li><li>Enable reliable data provisioning for dashboards, AI/ML models, reporting solutions, and self‑service analytics tools used across the organization.</li><li>Coordinate with business units, analysts, and data scientists to understand requirements and translate them into actionable data engineering tasks and delivery plans.
</li><li>Act as a liaison between the organization's teams and vendors for data platform&ndash;related activities, ensuring alignment on priorities, timelines, and technical deliverables.
</li><li>Document technical designs, configurations, workflows, and building procedures, and support agile project delivery, onboarding of new data sources, and continuous platform improvements.</li><li>Undertake all duties and responsibilities reasonably required and aligned with the data management &amp; governance.</li></ul></div>

D4 Insight

<div>Location: Dubai 
Experience: 8+ Years 
Work Mode: Hybrid (3 Days Onsite)
<h3 class="jobSectionHeader">
Role Overview:</h3>

We are seeking a highly experienced Senior Data Engineer with expertise in PySpark, Python, Hadoop, and large-scale data engineering pipelines.

The role involves building secure and scalable data platforms, enabling advanced analytics, and supporting machine learning workflows.
<h3 class="jobSectionHeader">
Key Responsibilities:</h3>
<ul><li>Acquire business requirements and perform exploratory data analysis (EDA).</li>
<li>Build scalable and high-performance data pipelines using Python, Spark, and Hadoop.</li>
<li>Perform feature engineering and support machine learning data workflows.</li>
<li>Collaborate with Data Scientists, Analytics teams, and stakeholders in Agile environments.</li>
<li>Optimize distributed data processing and ensure data quality and governance.</li>
</ul><h3 class="jobSectionHeader">Required Skills:</h3>
<ul><li>Strong expertise in Python, PySpark, Spark optimization, Hadoop, and SQL</li>
<li>Experience in enterprise data engineering and ML pipelines</li>
<li>Familiarity with Git, Agile methodologies, and cloud-native data environments</li>
<li>Strong analytical and communication skills</li>
</ul>
 Apply Now: [email protected]</div>

Senior Data Engineer – PySpark, Python

<div>
 
 Location:
 
 Dubai
 
 
 
 Experience:
 
 8+ Years
 
 
 
 Work Mode:
 
 Hybrid (3 Days Onsite)
 
 
 
 Role Overview
 
 
 
 We are seeking a highly experienced
 
 Senior Data Engineer
 
 with expertise in
 
 PySpark, Python, Hadoop, and large-scale data engineering pipelines
 
 .
 
 
 The role involves building secure and scalable data platforms, enabling advanced analytics, and supporting machine learning workflows.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Acquire business requirements and perform exploratory data analysis (EDA).
 </li>
 <li>
 Build scalable and high-performance data pipelines using Python, Spark, and Hadoop.
 </li>
 <li>
 Perform feature engineering and support machine learning data workflows.
 </li>
 <li>
 Collaborate with Data Scientists, Analytics teams, and stakeholders in Agile environments.
 </li>
 <li>
 Optimize distributed data processing and ensure data quality and governance.
 
 
 </li>
 </ul>
 
 Required Skills
 
 
 
 <ul>
 <li>
 Strong expertise in Python, PySpark, Spark optimization, Hadoop, and SQL
 </li>
 <li>
 Experience in enterprise data engineering and ML pipelines
 </li>
 <li>
 Familiarity with Git, Agile methodologies, and cloud-native data environments
 </li>
 <li>
 Strong analytical and communication skills
 
 
 </li>
 </ul>
 📩
 
 Apply Now: careers@d4insight.com
 
</div>

Teamware Solutions

<div>
 
 
 Responsibilities:
 
 
 
 &middot; Design, develop, and maintain big data solutions using technologies like Hadoop, HBase, Kafka, Hive, Spark, Scala, Python, R, TensorFlow, etc.
 
 
 &middot; Develop and manage data pipelines, migrations, and analytics pipelines in on-premise and cloud environments (Cloudera, AWS, Azure, Google Cloud).
 
 
 &middot; Utilize open-source kernels and understand distributed compute, distributed storage, serverless, and extremely scalable architectures.
 
 
 &middot; Collaborate with cross-functional teams to design and implement scalable and efficient data solutions.
 
 
 &middot; Stay updated with the latest trends and advancements in big data technologies and integrate them into existing systems where applicable.
 
 
 &middot; Conduct data modeling and analysis to optimize data storage and retrieval processes.
 
 
 &middot; Provide leadership and mentorship to junior team members.
 
 
 &middot; Communicate effectively with stakeholders to understand requirements and present solutions.
 
 
 
 Requirements:
 
 
 
 &middot; Bachelor's degree in Computer Science, Information Systems, Business, or related field.
 
 
 &middot; 8-10 years of experience in data engineering with a focus on big data projects.
 
 
 &middot; Proficiency in programming languages like Python, Scala, or Java.
 
 
 &middot; Strong hands-on experience with big data technologies such as Hadoop, HBase, Kafka, Hive, Spark, etc.
 
 
 &middot; Experience working with open-source kernels and understanding of distributed compute, distributed storage, serverless, and extremely scalable architectures.
 
 
 &middot; Experience in managing industry-standard programs in on-premise and cloud environments for building data pipelines, migrations, and analytics pipelines.
 
 
 &middot; Exposure to cloud platforms such as AWS, Azure, or Google Cloud.
 
 
 &middot; Knowledge and exposure to artificial intelligence, natural language processing, machine learning, statistical analysis, predictive modeling, and time series analysis.
 
 
 &middot; Familiarity with CI/CD practices.
 
 
 &middot; Excellent leadership, communication, and presentation skills.
 
</div>

Cloudera Data Engineer

GSSTech Group

<div>We are looking for a highly skilled Senior Data Engineer with strong expertise in PySpark, Python, and Big Data technologies to design, build, and optimize scalable data platforms and pipelines. The ideal candidate will work closely with Data Scientists, Business Analysts, and Analytics Delivery teams to develop high-performance analytics solutions and support advanced data science initiatives. 
Requirements 
 
Key Responsibilities<ul><li>
Collaborate with Analytics Delivery Leads and Lead Data Engineers to understand business requirements and deliver impactful data solutions.</li><li>
Work closely with Data Scientists and cross-functional teams to solve complex business problems through data engineering solutions.</li><li>
Manage data onboarding, data access, and stakeholder coordination for analytics initiatives.</li><li>
Design, develop, and maintain scalable, secure, and high-performance data pipelines.</li><li>
Acquire, ingest, process, and transform large-scale structured and unstructured datasets.</li><li>
Implement data engineering best practices for building reliable and production-ready data platforms.</li><li>
Perform data wrangling, cleansing, transformation, and feature engineering for machine learning and analytics use cases.</li><li>
Design and develop modular data pipelines to generate reusable features and modeling datasets.</li><li>
Build and optimize data architectures supporting advanced analytics and machine learning workloads.</li><li>
Contribute to data platform design by selecting appropriate technologies across Big Data, SQL, and NoSQL ecosystems.</li><li>
Ensure data quality, integrity, governance, security, and scalability across the data lifecycle.</li><li>
Participate in Agile squads and collaborate effectively with stakeholders across business and technology teams.</li><li>
Contribute to enterprise data architecture strategy and roadmap aligned with business objectives.</li></ul>
Required Technical SkillsCore Data Engineering<ul><li>
Strong experience in Data Engineering and Big Data solutions.</li><li>
Expert-level proficiency in PySpark.</li><li>
Strong programming experience in Python.</li><li>
Experience building large-scale distributed data processing pipelines.</li></ul>
Data Processing &amp; ETL<ul><li>
Data Ingestion</li><li>
Data Transformation</li><li>
Data Wrangling</li><li>
Data Preparation</li><li>
Data Modeling</li><li>
Feature Engineering</li><li>
ETL/ELT Development</li><li>
Batch Processing</li><li>
Data Pipeline Development</li></ul>
Big Data Technologies<ul><li>
Apache Spark / PySpark</li><li>
Distributed Data Processing Frameworks</li><li>
Big Data Ecosystems</li></ul>
Database Technologies<ul><li>
Strong SQL expertise</li><li>
Experience with Relational Databases</li><li>
Experience with NoSQL Databases</li><li>
Data Warehousing Concepts</li></ul>
Cloud &amp; Analytics Platforms (Preferred)<ul><li>
Azure Data Platform</li><li>
AWS Data Services</li><li>
Google Cloud Data Services</li><li>
Databricks</li><li>
Hadoop Ecosystem</li></ul>
Machine Learning Data Support<ul><li>
Feature Engineering for ML Models</li><li>
Data Preparation for Analytics and AI Use Cases</li><li>
Building Modeling and Feature Tables</li><li>
Supporting Data Science Workloads</li></ul>
Engineering Best Practices<ul><li>
Software Engineering Principles</li><li>
Data Pipeline Optimization</li><li>
Data Quality Management</li><li>
Performance Tuning</li><li>
Scalability &amp; Security</li><li>
Version Control (Git)</li><li>
CI/CD Concepts</li><li>
Documentation Standards</li></ul>
Required Soft Skills<ul><li>
Strong stakeholder management and communication skills.</li><li>
Experience working with Business Analysts, Data Scientists, and Product Teams.</li><li>
Ability to translate business requirements into scalable data solutions.</li><li>
Strong analytical and problem-solving skills.</li><li>
Experience working in Agile/Scrum environments.</li><li>
Ability to work independently and within cross-functional teams.</li></ul>
Preferred Qualifications<ul><li>
Experience working in enterprise-scale data platforms.</li><li>
Experience supporting machine learning and advanced analytics initiatives.</li><li>
Exposure to cloud-native data engineering solutions.</li><li>
Experience designing modern data architectures and data lake environments.</li></ul></div>

Senior Data Engineer

Explore 1400+ Data pipeline engineer in Dubai this June. Find roles across top companies and apply now to boost your career.

1400 data pipeline engineer jobs In Dubai

Data Pipeline Engineer

Data Engineer

Data Engineer

Senior Data Engineer – PySpark, Python

Senior Data Engineer – PySpark, Python

Cloudera Data Engineer

Senior Data Engineer