big data engineer

Maaloomatiia Academy

<div>
 
 Job Title
 
 
 
 
 Cloudera Data Engineer
 
 
 
 
 Job Scope
 
 
 
 We are seeking an experienced
 
 Cloudera Data Engineer
 
 with strong hands-on expertise in
 
 Cloudera CDP, Hadoop, Spark, Hive, and HDFS
 
 . The ideal candidate will be responsible for building and maintaining big data pipelines, optimizing data workflows, and supporting production environments to ensure reliability and performance.
 
 
 
 Main Duties And Responsibilities
 
 
 
 <ul>
 <li>
 Design, build, and maintain big data pipelines using Cloudera CDP components.
 </li>
 <li>
 Develop and optimize ETL/ELT workflows using Spark, Hive, and Hadoop ecosystems.
 </li>
 <li>
 Manage and maintain HDFS storage, ensuring high availability and performance.
 </li>
 <li>
 Perform production support activities, including issue resolution, monitoring, and performance tuning.
 </li>
 <li>
 Work with data scientists, analysts, and other engineering teams to support data-driven initiatives.
 </li>
 <li>
 Ensure data governance, security, and compliance across big data environments.
 </li>
 <li>
 Troubleshoot cluster-level issues related to resource utilization, scheduling, and configuration.
 </li>
 <li>
 Participate in solution design, architecture discussions, and technical documentation.
 
 
 
 </li>
 </ul>
 
 Position Requirements
 
 
 
 <ul>
 <li>
 Strong hands-on experience with Cloudera CDP.
 </li>
 <li>
 Proficiency in Hadoop ecosystem: HDFS, YARN, MapReduce, Hive, Impala.
 </li>
 <li>
 Strong experience working with Apache Spark (PySpark or Scala preferred).
 </li>
 <li>
 Solid understanding of distributed systems and big data architecture.
 </li>
 <li>
 Experience with production support and troubleshooting in big data environments.
 </li>
 <li>
 Strong SQL skills and experience optimizing large-scale queries.
 </li>
 <li>
 Familiarity with Linux, shell scripting, and automation tools.
 </li>
 <li>
 Experience with version control (Git) and CI/CD workflows is a plus.
 
 
 
 </li>
 </ul>
 
 Education
 
 
 
 Bachelor's degree in Computer Science or any other related field
 
 
 
 Experience
 
 
 
 <ul>
 <li>
 Experience with cloud platforms (AWS, Azure, GCP) for big data workloads.
 </li>
 <li>
 Exposure to Kafka, NiFi, Oozie, or similar data orchestration tools.
 </li>
 <li>
 Knowledge of Docker, Kubernetes, or containerized environments.
 </li>
 <li>
 Understanding of security, encryption, and data governance concepts.
 </li>
 </ul>
</div>

Cloudera Data Engineer

TALENTMATE

<div>
 
 Job Description
 
 
 
 
 Job Description
 
 
 
 
 Overview
 
 
 
 
 About Presight
 
 
 
 Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region&rsquo;s leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to create business and positive societal impact. Presight excels at all-source data interpretation to support insight-driven decision-making that shapes policy and creates safer, healthier, happier, and more sustainable societies. Today, through its range of GenAI-driven products and solutions, Presight is bringing Applied AI to the private and public sector, enabling them to realize their AI strategy and ambitions faster.
 
 
 
 The Opportunity
 
 
 
 Presight is looking for an astute, proficient and qualified Senior Data Engineer to assess, analyze and work with data concepts, use-cases &amp; complex new data sources to provide business insights to customers and support the implementation &amp; integration of the data sources into the Presight platform.
 
 
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Solve challenging problems, using python coding skills.
 </li>
 <li>
 Design, build and launch new data extraction, transformation &amp; loading processes in production.
 </li>
 <li>
 Web crawling, data cleaning, data annotation, data ingestion and data processing.
 </li>
 <li>
 Reading and collating complex data sets.
 </li>
 <li>
 Creating and maintaining data pipelines.
 </li>
 <li>
 Continual focus on process improvement to drive efficiency and productivity within the team.
 </li>
 <li>
 Use of Python, SQL, ES, Shell etc. to build the infrastructure required for optimal extraction, transformation, and loading of data.
 </li>
 <li>
 Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline.
 </li>
 <li>
 Support the wider business with their data needs on an ad hoc basis.
 </li>
 <li>
 Comply with QHSE (Quality Health Safety and Environment), Business Continuity, Information Security, Privacy, Risk, Compliance Management and Governance of Organizations policies, procedures, plans and related risk assessments.
 
 
 </li>
 </ul>
 
 Qualifications:
 
 
 
 <ul>
 <li>
 Bachelor's degree in computer engineering, Computer Science, or Electrical Engineering and Computer Sciences.
 </li>
 <li>
 6+ years of programming experience, solid coding skills in Python, Shell, and Java
 </li>
 <li>
 Good corporate capacity, good communication skills.
 </li>
 <li>
 Experience with Web crawling, cleaning.
 </li>
 <li>
 Experience with solution architecture, data ingestion, query optimization, data segregation, ETL, ELT, AWS, EC2, S3, SQS, lambda, Elastic Search, Redshift, CI/CD frameworks and workflows.
 </li>
 <li>
 Working knowledge of data platform concepts - data lake, data warehouse, ETL, big data processing (designing and supporting variety/velocity/volume), real time processing architecture for data platforms, scheduling and monitoring of ETL/ELT jobs
 </li>
 <li>
 PostgreSQL and programming (preferably Java, Python), proficiency in understanding data, entity relationships, structured &amp; unstructured data, SQL and NoSQL databases
 </li>
 <li>
 Knowledge of best practice in optimizing columnar and distributed data processing system and infrastructure
 </li>
 <li>
 Experienced in designing and implementing dimensional modelling
 </li>
 <li>
 Knowledge of machine learning and data mining techniques in one or more areas of statistical modelling, text mining and information retrieval.
 
 
 </li>
 </ul>
 Job Details
 
 
 Role Level: Not Applicable Work Type: Full-Time Country: United Arab Emirates City: Dubai Company Website: https://www.presight.ai Job Function: Data Science &amp; AI Company Industry/
 
 
 Sector: Other
 
 
 What We Offer
 
 
 
 About The Company
 
 
 
 Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.
 
 
 Report
 
 
 Disclaimer: talentmate.com is only a platform to bring jobseekers &amp; employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.
</div>

Senior Data Engineer

Dubai Holding

<div>
 
 Established in 2004, Dubai Holding is a global investment company with investments in more than 34 countries and a combined workforce of nearly 45,000 individuals. In line with the vision of Dubai&rsquo;s leadership and economic diversification strategy, Dubai Holding companies have nurtured sectors, irrevocably transforming Dubai&rsquo;s socio-economic landscape and positioning Dubai as a diversified, globally integrated economy.
 
 
 
 
 
 Dubai Holding is committed to the diversification of Dubai&rsquo;s non-oil economy. Our portfolio, valued at over AED 280+ billion, spans 10 sectors, including real estate, hospitality, leisure &amp; entertainment, ICT, design, education, media, retail, manufacturing &amp; logistics, and science.
 
 
 
 
 
 
 For the Good of Tomorrow
 
 
 
 Dubai Holding is looking to hire a
 
 Data Engineer
 
 . The role is responsible for leading the design, development, and maintenance of data solutions that support product teams in leveraging data for their specific needs. This role involves building and managing data pipelines, data lakes, and data warehouses, ensuring high-quality data delivery, and fostering a culture of process and data quality within development teams while being compliant with data protection/ privacy regulations and policies.
 
 
 
 
 
 If you are ready to embark on a dynamic journey where your talents are valued, and your contributions make a real impact, we would like to hear from you.
 
 
 
 
 
 
 Key Accountabilities:
 
 
 
 
 Data Infrastructure &amp; Pipeline Development
 
 
 <ul>
 <li>
 Design, build, and maintain data pipelines, lakes, and warehouses.
 </li>
 <li>
 Develop ETL jobs and stored procedures/functions/packages.
 </li>
 <li>
 Ensure robust data storage and high-quality data delivery.
 </li>
 </ul>
 
 
 Technical Guidance &amp; Integration
 
 
 <ul>
 <li>
 Own and implement ETL operating standards.
 </li>
 <li>
 Provide guidance on infrastructure for analytics and AI use cases.
 </li>
 <li>
 Collaborate with backend developers and IT architecture teams for seamless integration.
 </li>
 </ul>
 
 
 Product &amp; Stakeholder Collaboration
 
 
 <ul>
 <li>
 Work with Product Owners to understand and meet data needs.
 </li>
 <li>
 Translate product requirements into engineering plans and roadmaps.
 </li>
 <li>
 Gather stakeholder requirements and build architectures aligned with business goals.
 </li>
 </ul>
 
 
 Quality &amp; Process Excellence
 
 
 <ul>
 <li>
 Promote a culture of process and data quality.
 </li>
 <li>
 Implement best practices for data management and quality assurance.
 </li>
 <li>
 Support bug fixing and performance optimization.
 </li>
 </ul>
 
 
 Agile Delivery &amp; Team Collaboration
 
 
 <ul>
 <li>
 Advocate for agile methodologies and iterative development
 </li>
 <li>
 Collaborate cross-functionally to deliver project outcomes.
 </li>
 </ul>
 
 
 
 
 
 Who we are looking for:
 
 
 <ul>
 <li>
 At least 3-6 years of experience in Data Engineering roles
 </li>
 <li>
 Bachelor&rsquo;s Degree in a quantitative field (Mathematics, Engineering, Statistics, Science, Data Science/ AI); Advanced degrees preferred.
 </li>
 <li>
 Experience in Big Data platform like Databricks, Spark, Hive, Palantir Foundry etc.
 </li>
 <li>
 Experience in implementing AI solutions including OCR, Large Language Models, etc.
 </li>
 <li>
 Experienced with data modelling, design patterns, building highly scalable and secured analytical solutions.
 </li>
 <li>
 Proficiency in Python, SQL, PL/SQL, Spark and similar languages
 </li>
 <li>
 Strong analytical and problem-solving skills
 </li>
 <li>
 Experience working in a tech/ product environment is a plus
 </li>
 </ul>
 
 
 
 
 
 Behavioural Competencies
 
 
 <ul>
 <li>
 High-energy, ownership-driven mindset
 </li>
 <li>
 Strong problem-solving and analytical skills
 </li>
 <li>
 Excellent communication and collaboration abilities
 </li>
 <li>
 Comfortable navigating ambiguity and driving clarity
 </li>
 <li>
 Experience in agile/start-up environments preferred
 </li>
 <li>
 Successful track record of leading complex projects is a plus
 </li>
 </ul>
 
 
 
 
 
 As much as we would be delighted to entertain all applicants, due to the high volumes of applications, only successful applicants will be contacted within 14 business days.
 
 
 
 
 
 
 
 This job description is not all inclusive. Dubai Holding reserves the right to amend this job description at any time. Dubai Holding is an Equal Opportunity Employer, committed to a diverse and inclusive work environment.
 
 
</div>

Data Engineer

Global Software Solutions Group

<div>
 We are seeking an experienced Data Engineer with strong expertise in Python, Microservices Architecture, Data Transformation, and Backend Engineering to join our Data Engineering team. The ideal candidate will be responsible for designing and developing scalable backend services, data processing frameworks, RESTful APIs, and data transformation pipelines that support enterprise data-driven applications.
 
 
 This role requires strong hands-on experience with Python-based web frameworks, database technologies, ETL pipelines, microservices, API security, and modern software engineering practices. Candidates should have experience building production-grade applications with a focus on scalability, reliability, security, and performance.
 
 
 
 Requirements
 
 
 
 Key Responsibilities
 
 
 <ul>
 <li>
 Design, develop, and maintain scalable backend applications and web frameworks using Python
 </li>
 <li>
 Build robust RESTful APIs and microservices to serve enterprise datasets and business applications
 </li>
 <li>
 Develop and optimize data transformation pipelines to process, clean, enrich, and prepare data for analytics and business consumption
 </li>
 <li>
 Design and implement scalable data access layers integrating multiple relational and NoSQL databases
 </li>
 <li>
 Collaborate with frontend developers to integrate user-facing components with backend services
 </li>
 <li>
 Ensure applications are secure, highly available, performant, and maintainable
 </li>
 <li>
 Design and maintain database schemas and data models aligned with business requirements
 </li>
 <li>
 Implement ETL processes for extracting, transforming, and loading large-scale datasets
 </li>
 <li>
 Optimize database performance, query execution, and data retrieval mechanisms
 </li>
 <li>
 Troubleshoot production issues and implement scalable solutions for long-term platform stability
 </li>
 <li>
 Participate in code reviews, testing activities, technical design discussions, and engineering best practices
 </li>
 <li>
 Work closely with business stakeholders, architects, and engineering teams within Agile delivery environments
 
 
 </li>
 </ul>
 
 Required Technical Skills
 
 
 
 Python Development
 
 
 <ul>
 <li>
 Strong hands-on experience in Core Python development
 </li>
 <li>
 Expertise in building backend services and APIs using Python
 </li>
 <li>
 Strong understanding of object-oriented programming principles and software design patterns
 </li>
 <li>
 Experience writing clean, reusable, maintainable, and production-quality code
 
 
 </li>
 </ul>
 Web Frameworks &amp; API Development
 
 
 Strong experience with one or more Python frameworks including:
 
 
 <ul>
 <li>
 FastAPI
 </li>
 <li>
 Flask
 </li>
 <li>
 Django
 </li>
 <li>
 Pyramid
 
 
 </li>
 </ul>
 Experience with:
 
 
 <ul>
 <li>
 RESTful API design and development
 </li>
 <li>
 API versioning and documentation
 </li>
 <li>
 Routing and middleware implementation
 </li>
 <li>
 Authentication and authorization
 </li>
 <li>
 Framework testing and debugging
 
 
 </li>
 </ul>
 Microservices Architecture
 
 
 <ul>
 <li>
 Strong experience designing and developing microservices-based applications
 </li>
 <li>
 Deep understanding of distributed systems architecture
 </li>
 <li>
 Experience building scalable and resilient service-oriented platforms
 </li>
 <li>
 Knowledge of service communication patterns and API orchestration
 </li>
 <li>
 Experience handling concurrent requests and high-volume transaction processing
 
 
 </li>
 </ul>
 Asynchronous Programming
 
 
 <ul>
 <li>
 Strong understanding of asyncio and asynchronous programming concepts
 </li>
 <li>
 Experience handling concurrent connections and non-blocking operations
 </li>
 <li>
 Knowledge of performance optimization for I/O-intensive applications
 
 
 </li>
 </ul>
 Security &amp; API Protection
 
 
 <ul>
 <li>
 Strong understanding of API and microservices security best practices
 </li>
 <li>
 Experience implementing:
 </li>
 <li>
 OAuth 2.0
 </li>
 <li>
 JWT Authentication
 </li>
 <li>
 API Gateway integrations
 </li>
 <li>
 Encryption and secure communication protocols
 </li>
 <li>
 Experience implementing authentication, authorization, and access control mechanisms
 
 
 </li>
 </ul>
 Database &amp; ORM Expertise
 
 
 <ul>
 <li>
 Strong experience with relational and NoSQL databases
 </li>
 <li>
 Experience designing database schemas and optimizing database performance
 </li>
 <li>
 Strong proficiency with:
 </li>
 <li>
 SQL
 </li>
 <li>
 PostgreSQL
 </li>
 <li>
 MySQL
 </li>
 <li>
 MongoDB
 </li>
 <li>
 Redis
 
 
 </li>
 </ul>
 Hands-on experience with ORMs including:
 
 
 <ul>
 <li>
 SQLAlchemy
 </li>
 <li>
 Django ORM
 
 
 </li>
 </ul>
 Ability to:
 
 
 <ul>
 <li>
 Define models
 </li>
 <li>
 Perform CRUD operations
 </li>
 <li>
 Write optimized queries
 </li>
 <li>
 Handle transactions
 </li>
 <li>
 Manage database migrations
 
 
 </li>
 </ul>
 Data Engineering &amp; Transformation
 
 
 <ul>
 <li>
 Experience building and maintaining ETL pipelines
 </li>
 <li>
 Strong understanding of data transformation, enrichment, aggregation, and cleansing techniques
 </li>
 <li>
 Experience ensuring data quality, consistency, and integrity
 </li>
 <li>
 Ability to support analytical and data-driven applications through scalable processing frameworks
 
 
 </li>
 </ul>
 DevOps &amp; CI/CD
 
 
 <ul>
 <li>
 Experience building and maintaining CI/CD pipelines
 </li>
 <li>
 Experience deploying and supporting production-grade applications
 </li>
 <li>
 Understanding of infrastructure automation and modern software delivery practices
 </li>
 <li>
 Experience with release management and deployment workflows
 
 
 </li>
 </ul>
 Big Data &amp; Data Technologies
 
 
 Exposure to technologies such as:
 
 
 <ul>
 <li>
 Hadoop
 </li>
 <li>
 Apache Spark
 </li>
 <li>
 Apache Kafka
 
 
 </li>
 </ul>
 Understanding of:
 
 
 <ul>
 <li>
 Data Warehousing concepts
 </li>
 <li>
 Distributed data processing
 </li>
 <li>
 Enterprise data architectures
 
 
 </li>
 </ul>
 Version Control &amp; Development Practices
 
 
 <ul>
 <li>
 Strong experience with Git version control
 </li>
 <li>
 Experience with:
 </li>
 <li>
 Branching strategies
 </li>
 <li>
 Code reviews
 </li>
 <li>
 Pull Requests
 </li>
 <li>
 Merge conflict resolution
 </li>
 <li>
 Collaborative development workflows
 
 
 </li>
 </ul>
 Testing &amp; Debugging
 
 
 <ul>
 <li>
 Experience with:
 </li>
 <li>
 Unit Testing
 </li>
 <li>
 Integration Testing
 </li>
 <li>
 Logging
 </li>
 <li>
 Monitoring
 </li>
 <li>
 Performance Troubleshooting
 </li>
 <li>
 Production Support
 
 
 </li>
 </ul>
 Nice to Have
 
 
 <ul>
 <li>
 Experience with AWS, Azure, or GCP
 </li>
 <li>
 Experience with Docker and Kubernetes
 </li>
 <li>
 Exposure to cloud-native architectures
 </li>
 <li>
 Knowledge of data governance, compliance, privacy, and security standards
 </li>
 <li>
 Experience supporting large-scale enterprise data platforms
 
 
 </li>
 </ul>
 Required Competencies
 
 
 <ul>
 <li>
 Strong analytical and problem-solving skills
 </li>
 <li>
 Excellent communication and stakeholder management capabilities
 </li>
 <li>
 Strong collaboration and teamwork skills
 </li>
 <li>
 Ability to work effectively in Agile/Scrum environments
 </li>
 <li>
 Strong ownership mindset with attention to detail
 </li>
 <li>
 Ability to document solutions and communicate technical concepts clearly
 
 
 </li>
 </ul>
 Education
 
 
 Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Engineering, or a related field.
</div>

Data Engineer - Python & Microservices

GSSTech Group

<div>We are seeking an experienced Data Engineer with strong expertise in Python, Microservices Architecture, Data Transformation, and Backend Engineering to join our Data Engineering team. The ideal candidate will be responsible for designing and developing scalable backend services, data processing frameworks, RESTful APIs, and data transformation pipelines that support enterprise data-driven applications.
This role requires strong hands-on experience with Python-based web frameworks, database technologies, ETL pipelines, microservices, API security, and modern software engineering practices. Candidates should have experience building production-grade applications with a focus on scalability, reliability, security, and performance. 
Requirements 
Key Responsibilities<ul><li>Design, develop, and maintain scalable backend applications and web frameworks using Python.</li><li>Build robust RESTful APIs and microservices to serve enterprise datasets and business applications.</li><li>Develop and optimize data transformation pipelines to process, clean, enrich, and prepare data for analytics and business consumption.</li><li>Design and implement scalable data access layers integrating multiple relational and NoSQL databases.</li><li>Collaborate with frontend developers to integrate user-facing components with backend services.</li><li>Ensure applications are secure, highly available, performant, and maintainable.</li><li>Design and maintain database schemas and data models aligned with business requirements.</li><li>Implement ETL processes for extracting, transforming, and loading large-scale datasets.</li><li>Optimize database performance, query execution, and data retrieval mechanisms.</li><li>Troubleshoot production issues and implement scalable solutions for long-term platform stability.</li><li>Participate in code reviews, testing activities, technical design discussions, and engineering best practices.</li><li>Work closely with business stakeholders, architects, and engineering teams within Agile delivery environments.</li></ul>
Required Technical Skills
Python Development<ul><li>Strong hands-on experience in Core Python development.</li><li>Expertise in building backend services and APIs using Python.</li><li>Strong understanding of object-oriented programming principles and software design patterns.</li><li>Experience writing clean, reusable, maintainable, and production-quality code.</li></ul>
Web Frameworks &amp; API Development
Strong experience with one or more Python frameworks including:<ul><li>FastAPI</li><li>Flask</li><li>Django</li><li>Pyramid</li></ul>
Experience with:<ul><li>RESTful API design and development</li><li>API versioning and documentation</li><li>Routing and middleware implementation</li><li>Authentication and authorization</li><li>Framework testing and debugging</li></ul>
Microservices Architecture<ul><li>Strong experience designing and developing microservices-based applications.</li><li>Deep understanding of distributed systems architecture.</li><li>Experience building scalable and resilient service-oriented platforms.</li><li>Knowledge of service communication patterns and API orchestration.</li><li>Experience handling concurrent requests and high-volume transaction processing.</li></ul>
Asynchronous Programming<ul><li>Strong understanding of asyncio and asynchronous programming concepts.</li><li>Experience handling concurrent connections and non-blocking operations.</li><li>Knowledge of performance optimization for I/O-intensive applications.</li></ul>
Security &amp; API Protection<ul><li>Strong understanding of API and microservices security best practices.</li><li>Experience implementing:</li></ul><ul><li>
OAuth 2.0</li><li>
JWT Authentication</li><li>
API Gateway integrations</li><li>
Encryption and secure communication protocols 
<ul><li>Experience implementing authentication, authorization, and access control mechanisms.</li></ul></li></ul>
Database &amp; ORM Expertise<ul><li>Strong experience with relational and NoSQL databases.</li><li>Experience designing database schemas and optimizing database performance.</li><li>Strong proficiency with:</li></ul><ul><li>
SQL</li><li>
PostgreSQL</li><li>
MySQL</li><li>
MongoDB</li><li>
Redis</li></ul>
Hands-on experience with ORMs including:<ul><li>SQLAlchemy</li><li>Django ORM</li></ul>
Ability to:<ul><li>Define models</li><li>Perform CRUD operations</li><li>Write optimized queries</li><li>Handle transactions</li><li>Manage database migrations</li></ul>
Data Engineering &amp; Transformation<ul><li>Experience building and maintaining ETL pipelines.</li><li>Strong understanding of data transformation, enrichment, aggregation, and cleansing techniques.</li><li>Experience ensuring data quality, consistency, and integrity.</li><li>Ability to support analytical and data-driven applications through scalable processing frameworks.</li></ul>
DevOps &amp; CI/CD<ul><li>Experience building and maintaining CI/CD pipelines.</li><li>Experience deploying and supporting production-grade applications.</li><li>Understanding of infrastructure automation and modern software delivery practices.</li><li>Experience with release management and deployment workflows.</li></ul>
Big Data &amp; Data Technologies
Exposure to technologies such as:<ul><li>Hadoop</li><li>Apache Spark</li><li>Apache Kafka</li></ul>
Understanding of:<ul><li>Data Warehousing concepts</li><li>Distributed data processing</li><li>Enterprise data architectures</li></ul>
Version Control &amp; Development Practices<ul><li>Strong experience with Git version control.</li><li>Experience with:</li></ul><ul><li>
Branching strategies</li><li>
Code reviews</li><li>
Pull Requests</li><li>
Merge conflict resolution</li><li>
Collaborative development workflows</li></ul>
Testing &amp; Debugging<ul><li>Experience with:</li></ul><ul><li>
Unit Testing</li><li>
Integration Testing</li><li>
Logging</li><li>
Monitoring</li><li>
Performance Troubleshooting</li><li>
Production Support</li></ul>
Nice to Have<ul><li>Experience with AWS, Azure, or GCP.</li><li>Experience with Docker and Kubernetes.</li><li>Exposure to cloud-native architectures.</li><li>Knowledge of data governance, compliance, privacy, and security standards.</li><li>Experience supporting large-scale enterprise data platforms.</li></ul>
Required Competencies<ul><li>Strong analytical and problem-solving skills.</li><li>Excellent communication and stakeholder management capabilities.</li><li>Strong collaboration and teamwork skills.</li><li>Ability to work effectively in Agile/Scrum environments.</li><li>Strong ownership mindset with attention to detail.</li><li>Ability to document solutions and communicate technical concepts clearly.</li></ul>
Education
Bachelor&rsquo;s Degree in Computer Science, Information Technology, Engineering, Data Engineering, or a related field.</div>

DATAMAZE . AI

<div>
 Hyderabad, India / Dubai, UAE
 
 
 Full-time
 
 
 Apply to Job
 
 
 
 About The Role
 
 
 
 We are looking for a highly motivated Machine Learning Engineer / Data Scientist to join our dynamic team. In this mid-level role, you will leverage your expertise in data science and machine learning to design, build, and deploy innovative models and solutions that address real-world challenges.
 
 
 You will collaborate with cross-functional teams, including data engineers, product managers, and software developers, to turn complex datasets into actionable insights and build machine learning solutions that drive business value. This is a fantastic opportunity to work on impactful projects, expand your skill set, and contribute to cutting-edge advancements in AI and data science.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Model Development: Design, train, and evaluate machine learning models to solve business problems such as classification, regression, clustering, and recommendation.
 </li>
 <li>
 Data Preparation: Work with large and complex datasets, performing data cleaning, preprocessing, and feature engineering to optimize model performance.
 </li>
 <li>
 Model Deployment: Deploy machine learning models into production environments, ensuring scalability and robustness.
 </li>
 <li>
 Algorithm Selection: Research and implement state-of-the-art algorithms and methodologies to enhance model accuracy and efficiency.
 </li>
 <li>
 Collaboration: Collaborate with data engineering teams to build data pipelines and ensure efficient data flow for machine learning workflows.
 </li>
 <li>
 Visualization and Reporting: Create clear and actionable visualizations and reports to communicate findings and results to stakeholders.
 </li>
 <li>
 Monitoring and Maintenance: Monitor model performance in production, address drift or bias issues, and optimize models as needed.
 </li>
 <li>
 Tool Development: Build tools and frameworks to enable rapid experimentation and iteration of machine learning models.
 </li>
 <li>
 Documentation: Maintain comprehensive documentation for models, experiments, and processes.
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 
 Education:
 
 
 
 Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Data Science, Machine Learning, Statistics, or a related field (or equivalent experience).
 
 
 
 Technical Skills
 
 
 
 <ul>
 <li>
 Strong programming skills in Python, R, or similar languages.
 </li>
 <li>
 Experience with machine learning libraries and frameworks such as TensorFlow, PyTorch, Scikit-learn, or Keras.
 </li>
 <li>
 Proficiency in data manipulation and analysis using tools like Pandas, NumPy, and SQL.
 </li>
 <li>
 Experience with big data technologies such as Spark, Hadoop, or similar.
 </li>
 <li>
 Knowledge of cloud platforms and services (e.g., AWS SageMaker, Google AI Platform, Azure ML).
 </li>
 <li>
 Familiarity with MLOps practices and tools for CI/CD in machine learning workflows.
 </li>
 <li>
 Understanding of data visualization tools like Matplotlib, Seaborn, or Tableau.
 </li>
 <li>
 Strong grasp of statistical methods, probability, and optimization techniques.
 
 
 </li>
 </ul>
 
 Experience
 
 
 
 <ul>
 <li>
 3&ndash;5 years of experience in machine learning, data science, or a related field.
 </li>
 <li>
 Proven experience building and deploying machine learning models in production.
 </li>
 <li>
 Experience with natural language processing (NLP), computer vision, or time-series analysis is a plus.
 
 
 </li>
 </ul>
 
 Soft Skills
 
 
 
 <ul>
 <li>
 Strong problem-solving and analytical thinking abilities.
 </li>
 <li>
 Excellent communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.
 </li>
 <li>
 Ability to work independently and collaboratively within a team.
 </li>
 <li>
 Curiosity and eagerness to stay updated on the latest advancements in machine learning and AI.
 
 
 </li>
 </ul>
 
 About The Company
 
 
 
 Datamaze is a dynamic company specializing in AI, Data, and Analytics consulting services. We are dedicated to transforming businesses by leveraging the power of data and artificial intelligence. With a team of industry experts in technology, business strategy, and data science, Datamaze offers a range of services including data strategy development, AI model creation, advanced analytics, and data visualization. Our approach is client-centric, focusing on creating customized solutions that address unique business challenges and objectives. The team, comprising data scientists, AI experts, strategists, and engineers, is committed to continuous learning and innovation.
 
 
 Datamaze positions itself as a trusted partner for businesses looking to navigate the complex data and AI landscape, aiming to optimize operations, inform decision-making, and maintain a competitive edge.
 
 
 Apply Now
</div>

Machine Learning Engineer / Data Scientist (Mid-Level)

Heidelberg Materials Trading

<div>
 
 Heidelberg Materials Trading is the international trading arm of Heidelberg Materials, one of the world&rsquo;s largest building materials companies, handling overseas drybulk product exports and imports across global markets. We are looking for a talented individual to join our IT team in our Dubai Office as:
 
 
 
 
 
 Data Engineer
 
 
 
 
 
 
 
 About the Role:
 
 
 
 This role sits at the centre of a greenfield transformation initiative, where we are replacing legacy reporting workflows with a modern, Microsoft first cloud data platform. You will work directly with IT and business stakeholders to connect our front office (Salesforce) and back office (JD Edwards ERP) systems into a unified analytics layer powering business critical Power BI dashboards. The role requires a hands on technical developer who builds, and owns data pipelines end-to-end, and can operate pragmatically within a Microsoft Fabric&ndash;oriented environment while proposing justified alternatives when needed.
 
 
 
 
 
 
 Key Responsibilities:
 
 
 <ul>
 <li>
 Lead the migration of reporting from QlikSense to Power BI, ensuring accurate replication of existing logic, KPIs, and reporting workflows.
 </li>
 <li>
 Design, build, and maintain scalable Azure SQL&ndash;based data pipelines to support analytics, reporting, and operational decision making.
 </li>
 <li>
 Build and optimise Power BI data models, reusable datasets, and semantic layers following best practice modelling principles.
 </li>
 <li>
 Integrate data from JD Edwards (ERP), Salesforce (CRM), and other business systems, ensuring accuracy, consistency, and reliability across the reporting lifecycle.
 </li>
 <li>
 Reverse engineer manual Excel-based workflows and translate them into automated SQL or Python based pipelines to improve efficiency and reliability.
 </li>
 <li>
 Implement data validation, quality checks, monitoring, and performance optimisation across the data platform and reporting layers.
 </li>
 <li>
 Deliver Power BI training for business users and create documentation, dashboards, and best practice materials.
 </li>
 <li>
 Work closely with cross-functional teams to understand business requirements and translate them into scalable, maintainable data and reporting solutions.
 </li>
 <li>
 Contribute to data governance, security standards, and consistent documentation practices.
 </li>
 <li>
 Support UAT cycles, phased go lives, and iterative enhancements to reporting processes.
 </li>
 </ul>
 
 
 
 
 Qualifications:
 
 
 <ul>
 <li>
 Bachelor&rsquo;s degree in Computer Science, Data Engineering, Information Systems, or a related field.
 </li>
 <li>
 Minimum 3 years of hands‑on experience in data engineering or data platform development. - Minimum 6 years for senior consideration.
 </li>
 <li>
 Strong SQL skills with experience working on relational databases and transformation logic.
 </li>
 <li>
 Hands‑on experience with Power BI (DAX, data modelling, row‑level security, performance optimisation).
 </li>
 <li>
 Experience developing ETL/ELT pipelines using Azure Data Factory, Azure Synapse, or Microsoft Fabric (experience with at least one is required).
 </li>
 <li>
 Experience integrating ERP or CRM systems such as JD Edwards, SAP, or Salesforce, with a strong advantage for candidates familiar with these architectures.
 </li>
 <li>
 Solid understanding of transactional vs analytical modelling and modern data warehousing approaches.
 </li>
 <li>
 Comfortable operating as a hands‑on builder, capable of developing, testing, and shipping data pipelines independently.
 </li>
 <li>
 Strong communication skills with the ability to translate technical detail into clear business language.
 </li>
 <li>
 Able to work within a Microsoft‑first environment while recommending alternative tools when supported by a clear business case.
 </li>
 <li>
 Exposure to Microsoft Power Platform (Power Automate, Power Apps) is an advantage.
 </li>
 <li>
 Experience in trading, logistics, or supply chain environments is beneficial.
 </li>
 <li>
 Familiarity with Azure‑based cloud data architectures is preferred.
 </li>
 </ul>
 
 
 
 
 
 
 We thank all applicants for their interest, but only shortlisted candidates will be contacted.
 
 
 
 
 All applications will be kept strictly confidential.
 
 
</div>

Explore 657+ Big data engineer in Dubai this July. Find roles across top companies and apply now to boost your career.

657 big data engineer jobs In Dubai

Cloudera Data Engineer

Senior Data Engineer

Data Engineer

Data Engineer - Python & Microservices

Data Engineer - Python & Microservices

Machine Learning Engineer / Data Scientist (Mid-Level)

Data Engineer