technical engineer

ai engineer

backend developer

bi developer

data engineer

etl developer

Virtusa

<div>Responsibilities: 
<ul>
<li>Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.</li>
<li>Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.</li>
<li>Data Transformation and Processing: Use PySpark to process, cleanse, and transform large datasets into meaningful formats that support analytical needs and business requirements.</li>
<li>Performance Optimization: Conduct performance tuning of PySpark code and Cloudera components, optimizing resource utilization and reducing runtime of ETL processes.</li>
<li>Data Quality and Validation: Implement data quality checks, monitoring, and validation routines to ensure data accuracy and reliability throughout the pipeline.</li>
<li>Automation and Orchestration: Automate data workflows using tools like Apache Oozie, Airflow, or similar orchestration tools within the Cloudera ecosystem.</li>
<li>Monitoring and Maintenance: Monitor pipeline performance, troubleshoot issues, and perform routine maintenance on the Cloudera Data Platform and associated data processes.</li>
<li>Collaboration: Work closely with other data engineers, analysts, product managers, and other stakeholders to understand data requirements and support various data-driven initiatives.</li>
<li>Documentation: Maintain thorough documentation of data engineering processes, code, and pipeline configurations. 
Technical Skills:</li>
<li>PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.</li>
<li>Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase.</li>
<li>Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala).</li>
<li>Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools.</li>
<li>Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks.</li>
<li>Scripting and Automation: Strong scripting skills in Linux.</li>
</ul><div>
About Virtusa
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth &mdash; one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.</div></div>

Pyspark - Data Engineer

<div><ul><li>Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.</li>
<li>Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.</li>
<li>Data Transformation and Processing: Use PySpark to process, cleanse, and transform large datasets into meaningful formats that support analytical needs and business requirements.</li>
<li>Performance Optimization: Conduct performance tuning of PySpark code and Cloudera components, optimizing resource utilization and reducing runtime of ETL processes.</li>
<li>Data Quality and Validation: Implement data quality checks, monitoring, and validation routines to ensure data accuracy and reliability throughout the pipeline.</li>
<li>Automation and Orchestration: Automate data workflows using tools like Apache Oozie, Airflow, or similar orchestration tools within the Cloudera ecosystem.</li>
<li>Monitoring and Maintenance: Monitor pipeline performance, troubleshoot issues, and perform routine maintenance on the Cloudera Data Platform and associated data processes.</li>
<li>Collaboration: Work closely with other data engineers, analysts, product managers, and other stakeholders to understand data requirements and support various data-driven initiatives.</li>
<li>Documentation: Maintain thorough documentation of data engineering processes, code, and pipeline configurations.</li>
</ul>
Technical Skills
<ul>
<li>PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.</li>
<li>Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase.</li>
<li>Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala).</li>
<li>Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools.</li>
<li>Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks.</li>
<li>Scripting and Automation: Strong scripting skills in Linux.</li>
</ul><div>
About Virtusa
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth &mdash; one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.</div></div>

Pyspark Data Engineer

dubizzle

<div>
 
 Bayut &amp; dubizzle have the unique distinction of being iconic, homegrown brands with a strong presence across the seven emirates in the UAE. Connecting millions of users across the country, we are committed to delivering the best online search experience.
 
 
 As part of Dubizzle Group, we are alongside some of the strongest classified brands in the market. With a collective strength of 5 brands, we have more than 123 million monthly users that trust in our dedication to providing them with the best platform for their needs.
 
 
 The Data Engineer intern will be participating in exciting projects covering the end-to-end data lifecycle - from raw data integrations with primary and third-party systems, through advanced data modelling, to state-of-the-art data visualisation and development of innovative data products.
 
 
 You will have the opportunity to learn how to build and work with both batch and real-time data processing pipelines. You will work in a modern cloud-based data warehousing environment alongside a team of diverse, intense and interesting co-workers. You will liaise with other departments - such as product &amp; tech, the core business verticals, trust &amp; safety, finance and others - to enable them to be successful.
 
 
 
 
 In this role, you will handle:
 
 
 <ul>
 <li>
 Raw data integrations with primary and third-party systems
 </li>
 <li>
 Data warehouse modelling for operational and application data layers
 </li>
 <li>
 Development in Amazon Redshift cluster
 </li>
 <li>
 SQL development as part of agile team workflow
 </li>
 <li>
 ETL design and implementation in Matillion ETL
 </li>
 <li>
 Design and implementation of data products enabling data-driven features or business solutions
 </li>
 <li>
 Data quality, system stability and security
 </li>
 <li>
 Coding standards in SQL, Python, ETL design
 </li>
 <li>
 Data dashboards and advanced visualisations in Periscope Data with a focus on UX, simplicity and usability
 </li>
 <li>
 Working with other departments on data products - i.e. product &amp; technology, marketing &amp; growth, finance, core business, advertising and others
 </li>
 <li>
 Being part and contributing towards a strong team culture and ambition to be on the cutting edge of big data
 
 
 </li>
 </ul>
 
 Requirements
 
 
 
 
 <ul>
 <li>
 Bachelor's degree in computer science, engineering, math, physics or any related quantitative field
 </li>
 </ul>
 <ul>
 <li>
 Knowledge of relational and dimensional data models
 </li>
 <li>
 Knowledge of terminal operations and Linux workflows
 </li>
 <li>
 Ability to communicate insights and findings to a non-technical audience
 </li>
 <li>
 Good SQL skills across a variety of relational data warehousing technologies especially in cloud data warehousing (e.g. Amazon Redshift, Google BigQuery, Snowflake, Vertica, etc.)
 </li>
 <li>
 Attention to details and analytical thinking
 </li>
 <li>
 Entrepreneurial spirit and ability to think creatively; highly-driven and self-motivated; strong curiosity and strive for continuous learning
 </li>
 
 
 </ul>
 
 Benefits
 
 
 
 <ul>
 <li>
 Ability to contribute to a platform used by more than 5M users in UAE and other platforms in the region
 </li>
 <li>
 Strengthen your resume and build your network
 </li>
 <li>
 Opportunity to find a full time career with the region's leading organization
 </li>
 <li>
 Working in a multicultural environment with over 60 different nationalities
 </li>
 <li>
 Access to the Learning &amp; Development tools and courses provided by the company
 </li>
 </ul>
 
 Bayut &amp; dubizzle is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
 
 
 #UAEdubizzle
 
</div>

Data Engineer - Intern

Dubai Holding

<div>
 
 Established in 2004, Dubai Holding is a global investment company with investments in more than 34 countries and a combined workforce of nearly 45,000 individuals. In line with the vision of Dubai&rsquo;s leadership and economic diversification strategy, Dubai Holding companies have nurtured sectors, irrevocably transforming Dubai&rsquo;s socio-economic landscape and positioning Dubai as a diversified, globally integrated economy.
 
 
 
 
 
 Dubai Holding is committed to the diversification of Dubai&rsquo;s non-oil economy. Our portfolio, valued at over AED 280+ billion, spans 10 sectors, including real estate, hospitality, leisure &amp; entertainment, ICT, design, education, media, retail, manufacturing &amp; logistics, and science.
 
 
 
 
 
 
 For the Good of Tomorrow
 
 
 
 Dubai Holding is looking to hire a
 
 Data Engineer
 
 . The role is responsible for leading the design, development, and maintenance of data solutions that support product teams in leveraging data for their specific needs. This role involves building and managing data pipelines, data lakes, and data warehouses, ensuring high-quality data delivery, and fostering a culture of process and data quality within development teams while being compliant with data protection/ privacy regulations and policies.
 
 
 
 
 
 If you are ready to embark on a dynamic journey where your talents are valued, and your contributions make a real impact, we would like to hear from you.
 
 
 
 
 
 
 Key Accountabilities:
 
 
 
 
 Data Infrastructure &amp; Pipeline Development
 
 
 <ul>
 <li>
 Design, build, and maintain data pipelines, lakes, and warehouses.
 </li>
 <li>
 Develop ETL jobs and stored procedures/functions/packages.
 </li>
 <li>
 Ensure robust data storage and high-quality data delivery.
 </li>
 </ul>
 
 
 Technical Guidance &amp; Integration
 
 
 <ul>
 <li>
 Own and implement ETL operating standards.
 </li>
 <li>
 Provide guidance on infrastructure for analytics and AI use cases.
 </li>
 <li>
 Collaborate with backend developers and IT architecture teams for seamless integration.
 </li>
 </ul>
 
 
 Product &amp; Stakeholder Collaboration
 
 
 <ul>
 <li>
 Work with Product Owners to understand and meet data needs.
 </li>
 <li>
 Translate product requirements into engineering plans and roadmaps.
 </li>
 <li>
 Gather stakeholder requirements and build architectures aligned with business goals.
 </li>
 </ul>
 
 
 Quality &amp; Process Excellence
 
 
 <ul>
 <li>
 Promote a culture of process and data quality.
 </li>
 <li>
 Implement best practices for data management and quality assurance.
 </li>
 <li>
 Support bug fixing and performance optimization.
 </li>
 </ul>
 
 
 Agile Delivery &amp; Team Collaboration
 
 
 <ul>
 <li>
 Advocate for agile methodologies and iterative development
 </li>
 <li>
 Collaborate cross-functionally to deliver project outcomes.
 </li>
 </ul>
 
 
 
 
 
 Who we are looking for:
 
 
 <ul>
 <li>
 At least 3-6 years of experience in Data Engineering roles
 </li>
 <li>
 Bachelor&rsquo;s Degree in a quantitative field (Mathematics, Engineering, Statistics, Science, Data Science/ AI); Advanced degrees preferred.
 </li>
 <li>
 Experience in Big Data platform like Databricks, Spark, Hive, Palantir Foundry etc.
 </li>
 <li>
 Experience in implementing AI solutions including OCR, Large Language Models, etc.
 </li>
 <li>
 Experienced with data modelling, design patterns, building highly scalable and secured analytical solutions.
 </li>
 <li>
 Proficiency in Python, SQL, PL/SQL, Spark and similar languages
 </li>
 <li>
 Strong analytical and problem-solving skills
 </li>
 <li>
 Experience working in a tech/ product environment is a plus
 </li>
 </ul>
 
 
 
 
 
 Behavioural Competencies
 
 
 <ul>
 <li>
 High-energy, ownership-driven mindset
 </li>
 <li>
 Strong problem-solving and analytical skills
 </li>
 <li>
 Excellent communication and collaboration abilities
 </li>
 <li>
 Comfortable navigating ambiguity and driving clarity
 </li>
 <li>
 Experience in agile/start-up environments preferred
 </li>
 <li>
 Successful track record of leading complex projects is a plus
 </li>
 </ul>
 
 
 
 
 
 As much as we would be delighted to entertain all applicants, due to the high volumes of applications, only successful applicants will be contacted within 14 business days.
 
 
 
 
 
 
 
 This job description is not all inclusive. Dubai Holding reserves the right to amend this job description at any time. Dubai Holding is an Equal Opportunity Employer, committed to a diverse and inclusive work environment.
 
 
</div>

Data Engineer

flydubai

<div>MAIN OBJECTIVE OF ROLE: To design, build, and maintain scalable data architectures and pipelines using AWS services, focusing on efficiently ingesting, processing, and transforming data to ensure high quality and accessibility for analytics and reporting. KEY RESPONSIBILITIES:
<ul><li>Designs, builds and maintains scalable data pipelines to ingest and process data from various sources.</li><li>
Leverages Amazon Web Services (AWS) tools like AWS Glue, Amazon S3, Amazon Redshift, and Amazon RDS to manage data pipeline, storage, transformation, and analytics.</li><li>
Builds and maintains Cloud framework for orchestrating data-pipelines, continuously optimizing and enhancing it to integrate new data sources effectively.</li><li>
Develops Extract, Transform, Load (ETL) processes to ensure data is cleaned, transformed, and loaded into data warehouses. Use appropriate scripting such as PySpark, Python, Scala to perform data transformations.</li><li>
Automates data integration and processing tasks to enhance efficiency and reduce manual intervention.</li><li>
Sets up monitoring tools to track data pipeline performance and troubleshoot issues as they arise.</li><li>
Maintains comprehensive documentation of data architectures, processes, and workflows, ensuring updates are made consistently with every release.</li><li>
Follows defined Data Governance policies and guidelines and enforces team to align with standard procedures.</li><li>
Ensures data security and compliance with relevant regulations, including GDPR or industry-specific guidelines.</li><li>
Leads the junior data engineers, provide technical guidance, manage work allocation and delivery.</li><li>
Leads and mentors junior data analysts, collaborate with cross-functional teams to meet data needs, implements data governance practices, and optimizes performance to support informed decision-making within the organization.</li></ul>
QUALIFICATIONS:
<ul><li>Bachelor's Degree (3+ years)</li><li>
Bachelor&rsquo;s degree in Computer Science, Information Systems, Engineering, or a related field</li><li>
Fluent in English</li><li>
Must have 8+ years of industry experience, with 5 years working with design and development of data pipelines at enterprise scale. Hands on experience in building streaming, batch pipelines for structured, semi-structured data Must have, solid experience in handling large volume of data and performing transformation using scripts such as PySpark, Scala, Python. Must have experience working with AWS cloud services including EMR, Lambda, MKS, Redshift, GLue, Preference for working experience in airline industry</li><li>
AWS EMR, MKS, Glue, PySpark, Python, Scala, OpenSearch, Redshift, Dynamo DB, RDS</li><li>
Years with qualifications: 8 - 10 years</li></ul>
COMPETENCIES:
<ul><li>Customer Focus</li><li>
Teamwork</li><li>
Effective Communication</li><li>
Personal Accountability &amp; Commitment to achieve</li><li>
Resilience &amp; Flexibility (Can do attitude)</li></ul>
ISR Requirements: Reads and complies with the ISR policies of the Company and diligently reports any weakness or incidents to the respective Line Manager or the Information Security team. Completes all required ISR awareness sessions and follows associated guidelines in the day-to-day business operations.</div>

Senior Data Engineer - IT

Align Staffing Solutions

We are seeking an experienced Salesforce Administrator &amp; Developer to join our team. The ideal candidate has deep technical expertise across the Salesforce platform, can work independently, and is capable of designing scalable solutions that integrate seamlessly with enterprise systems. You will play a key role in enhancing our Salesforce environment, building custom functionality, and supporting critical business processes.Key Responsibilities:<ul><li>Design, develop, and optimize solutions across Sales Cloud, Service Cloud, and Experience/Community Cloud.</li><li>Build custom functionality using Apex, LWC, Aura, Visualforce, and JavaScript.</li><li>Lead and maintain integrations using REST APIs and ERP systems (e.g., MS Dynamics).</li><li>Manage data migration activities using Data Loader, Import Wizard, or ETL tools.</li><li>Ensure high-quality deployments through test class creation, code coverage, and CI/CD processes.</li><li>Work independently with stakeholders to gather requirements and deliver scalable, secure solutions.</li></ul>Requirements:<ul><li>Minimum 5 years of hands-on Salesforce Admin and Developer experience.</li><li>Strong understanding of Salesforce data model, security model, and platform architecture.</li><li>Advanced proficiency in Apex, LWC, Aura, Visualforce, JavaScript, SOQL/SOSL.</li><li>Proven experience withs REST API integrations, DocuSign, and Nintex DocGen.</li><li>Proficiency with Salesforce tools including VS Code, Salesforce CLI, Ant Migration Tool, and DevOps Center.</li></ul>Submit your CV to lisa@alignmanpower.com or directly share on to 0582030330Job Type: Full-time

Salesfore Consultant

Best Choice Recruitment Consultancy

Looking for a Data Engineer who will build and manage ETL Pipelines on-prem to cloud ( bronze-silver-gold). Who will monitor DAGs ( workflow scheduling systems, ETL, ETC) automates backups , and validates transformations . Must have skills in Azure Data Factory , Fabric Pipelines, GIit, Airflow, Oracle , SQL , Python, Automation , onelake, Delta parquets , key-vaults and encryptionSalary will depend on years of experience, qualifications and exposure in the UAE marketJob Type: Full-timePay: AED15,000.00 - AED30,000.00 per monthEducation:<ul><li>Bachelor's (Preferred)</li></ul>Experience:<ul><li>data engineer : 6 years (Preferred)</li><li>building and managing ETL pipeline : 6 years (Preferred)</li><li>Azure Data Factory : 6 years (Preferred)</li><li>Fabric pipelines : 6 years (Preferred)</li><li>Git: 6 years (Preferred)</li><li>Oracle : 6 years (Preferred)</li><li>Delta parquets : 6 years (Preferred)</li><li>key-vaults : 6 years (Preferred)</li></ul>Language:<ul><li>English (Preferred)</li><li>Arabic (Preferred)</li></ul>

Data Engineer - Bilingual

Explore 444+ Etl developer in Dubai this December. Find roles across top companies and apply now to boost your career.