data analyst

data scientist

ai engineer

full stack engineer

senior data analyst

big data engineer

Deeplight

<div>DeepLight AI is a specialist AI and data consultancy with extensive experience implementing intelligent enterprise systems across multiple industries, with particular depth in financial services and banking. Our team combines deep expertise in data science, statistical modeling, AI/ML technologies, workflow automation, and systems integration with a practical understanding of complex business operations.
The Data Engineer is responsible for designing, implementing, and optimising data pipelines and infrastructure to support our cutting-edge AI systems. The Data Engineer collaborates closely with our multidisciplinary team to ensure the efficient collection, storage, processing, and analysis of large-scale data, enabling us to unlock valuable insights and drive innovation across various domains.
Responsibilities of the role: 
<ul><li>
Design, build, and optimise scalable data solutions, primarily utilising the Lakehouse architecture to unify data warehousing and data lake capabilities. Advise stakeholders on the strategic choice between Data Warehouse, Data Lake, and Lakehouse architectures based on specific business needs, cost, and latency requirements.</li><li>
Design, develop, and maintain scalable and reliable data pipelines to ingest, transform, and load diverse datasets from various sources, including structured and unstructured data, streaming data, and real-time feeds.</li><li>
Implement standards and tooling to ensure ACID properties, schema evolution, and high data quality within the Lakehouse environment. Implement robust data governance frameworks (security, privacy, integrity, compliance, auditing).</li><li>
Continuously optimize data storage, compute resources, and query performance across the data platform to reduce costs and improve latency for both BI and ML workloads, leveraging techniques such as indexing, partitioning, and parallel processing.</li><li>
Develop and maintain CI/CD pipelines to automate the entire machine learning lifecycle, from data validation and model training to deployment and infrastructure provisioning.</li><li>
Deploy, manage, and scale machine learning models into production environments, utilizing MLOps principles for reliable and repeatable operations.</li><li>
Establish and manage monitoring systems to track model performance metrics, detect data drift (changes in input data), and model decay (degradation in prediction accuracy).</li><li>
Ensure rigorous version control and tracking for all components: code, datasets, and trained model artifacts (using tools like MLflow or similar).</li><li>
Create comprehensive documentation, including technical specifications, data flow diagrams, and operational procedures, to facilitate understanding, collaboration, and knowledge sharing.</li></ul>
Requirements<ul>
<li>
 Proven practical experience in designing, building, and optimising solutions using Data Lakehouse architectures (e.g., Databricks, Delta Lake).
</li><li>Strong hands-on experience with managing data ingestion, schema enforcement, ACID properties, and utilizing big data technologies/frameworks like Spark and Kafka.</li>
<li>Expertise in data modeling, ETL/ELT processes, and data warehousing concepts. Proficiency in SQL and scripting languages (e.g., Python, Scala).</li>
<li>Demonstrated practical experience implementing MLOps pipelines for production systems. This includes a solid understanding and implementation experience with MLOps principles: automation, governance, and monitoring of ML models throughout the entire lifecycle.</li>
<li>Experience with CI/CD tools, containerization/orchestration technologies (e.g., Docker, Kubernetes), model serving frameworks (e.g., TensorFlow Serving, Sagemaker), and experiment tracking (e.g., MLflow).</li>
<li>Experience with production monitoring tools to detect data drift or model decay.</li>
<li>Strong hands-on experience with major cloud platforms (e.g., AWS, Azure, GCP) and familiarity with DevOps practices.</li>
<li>Excellent analytical, problem-solving, and communication skills, with the ability to translate complex technical concepts into clear and actionable insights.</li>
<li>Proven ability to work effectively in a fast-paced, collaborative environment, with a passion for innovation and continuous learning</li>
</ul>
Benefits
Benefits &amp; Growth Opportunities:<ul><li>Competitive salary and performance bonuses</li><li>Comprehensive health insurance</li><li>Professional development and certification support</li><li>Opportunity to work on cutting-edge AI projects</li><li>Flexible working arrangements</li><li>Career advancement opportunities in a rapidly growing AI company</li></ul>
This position offers a unique opportunity to shape the future of AI implementation while working with a talented team of professionals at the forefront of technological innovation. The successful candidate will play a crucial role in driving our company's success in delivering transformative AI solutions to our clients.</div>

Data Engineer

Best Choice Recruitment Consultancy

Looking for a Data Engineer who will build and manage ETL Pipelines on-prem to cloud ( bronze-silver-gold). Who will monitor DAGs ( workflow scheduling systems, ETL, ETC) automates backups , and validates transformations . Must have skills in Azure Data Factory , Fabric Pipelines, GIit, Airflow, Oracle , SQL , Python, Automation , onelake, Delta parquets , key-vaults and encryptionSalary will depend on years of experience, qualifications and exposure in the UAE marketJob Type: Full-timePay: AED15,000.00 - AED30,000.00 per monthEducation:<ul><li>Bachelor's (Preferred)</li></ul>Experience:<ul><li>data engineer : 6 years (Preferred)</li><li>building and managing ETL pipeline : 6 years (Preferred)</li><li>Azure Data Factory : 6 years (Preferred)</li><li>Fabric pipelines : 6 years (Preferred)</li><li>Git: 6 years (Preferred)</li><li>Oracle : 6 years (Preferred)</li><li>Delta parquets : 6 years (Preferred)</li><li>key-vaults : 6 years (Preferred)</li></ul>Language:<ul><li>English (Preferred)</li><li>Arabic (Preferred)</li></ul>

Data Engineer - Bilingual

Virtusa

<div>Responsibilities: 
<ul>
<li>Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.</li>
<li>Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.</li>
<li>Data Transformation and Processing: Use PySpark to process, cleanse, and transform large datasets into meaningful formats that support analytical needs and business requirements.</li>
<li>Performance Optimization: Conduct performance tuning of PySpark code and Cloudera components, optimizing resource utilization and reducing runtime of ETL processes.</li>
<li>Data Quality and Validation: Implement data quality checks, monitoring, and validation routines to ensure data accuracy and reliability throughout the pipeline.</li>
<li>Automation and Orchestration: Automate data workflows using tools like Apache Oozie, Airflow, or similar orchestration tools within the Cloudera ecosystem.</li>
<li>Monitoring and Maintenance: Monitor pipeline performance, troubleshoot issues, and perform routine maintenance on the Cloudera Data Platform and associated data processes.</li>
<li>Collaboration: Work closely with other data engineers, analysts, product managers, and other stakeholders to understand data requirements and support various data-driven initiatives.</li>
<li>Documentation: Maintain thorough documentation of data engineering processes, code, and pipeline configurations. 
Technical Skills:</li>
<li>PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.</li>
<li>Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase.</li>
<li>Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala).</li>
<li>Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools.</li>
<li>Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks.</li>
<li>Scripting and Automation: Strong scripting skills in Linux.</li>
</ul><div>
About Virtusa
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth &mdash; one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.</div></div>

Pyspark - Data Engineer

<div><ul><li>Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.</li>
<li>Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.</li>
<li>Data Transformation and Processing: Use PySpark to process, cleanse, and transform large datasets into meaningful formats that support analytical needs and business requirements.</li>
<li>Performance Optimization: Conduct performance tuning of PySpark code and Cloudera components, optimizing resource utilization and reducing runtime of ETL processes.</li>
<li>Data Quality and Validation: Implement data quality checks, monitoring, and validation routines to ensure data accuracy and reliability throughout the pipeline.</li>
<li>Automation and Orchestration: Automate data workflows using tools like Apache Oozie, Airflow, or similar orchestration tools within the Cloudera ecosystem.</li>
<li>Monitoring and Maintenance: Monitor pipeline performance, troubleshoot issues, and perform routine maintenance on the Cloudera Data Platform and associated data processes.</li>
<li>Collaboration: Work closely with other data engineers, analysts, product managers, and other stakeholders to understand data requirements and support various data-driven initiatives.</li>
<li>Documentation: Maintain thorough documentation of data engineering processes, code, and pipeline configurations.</li>
</ul>
Technical Skills
<ul>
<li>PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.</li>
<li>Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase.</li>
<li>Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala).</li>
<li>Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools.</li>
<li>Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks.</li>
<li>Scripting and Automation: Strong scripting skills in Linux.</li>
</ul><div>
About Virtusa
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth &mdash; one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.</div></div>

Pyspark Data Engineer

Revolut

<div>About Revolut
People deserve more from their money. More visibility, more control, and more freedom. Since 2015, Revolut has been on a mission to deliver just that. Our powerhouse of products &mdash; including spending, saving, investing, exchanging, travelling, and more &mdash; help our 65+ million customers get more from their money every day.
As we continue our lightning-fast growth,&zwnj; 2 things are essential to our success: our people and our culture. In recognition of our outstanding employee experience, we've been certified as a Great Place to Work&trade;. So far, we have 10,000+ people working around the world, from our offices and remotely, to help us achieve our mission. And we're looking for more brilliant people. People who love building great products, redefining success, and turning the complexity of a chaotic world into the simplicity of a beautiful solution.
About the role
Our Data Science team solves complex problems with smart, practical solutions and improves how customers experience Revolut. Our Deep Learning Engineers are at the forefront of GenAI and LLM integration, building transformative products that range from user-facing tools to advanced process optimisation.
We're looking for a Deep Learning Engineer to work with the most advanced LLMs available, developing solutions that have a tangible impact on millions of customers worldwide.
You'll collaborate cross-functionally with Product Owners, Software Engineers, Data Analysts, and Operations Managers to deliver automated, scalable solutions that elevate and revolutionise customer interaction.
Up to break barriers and shape what's next for the future of Revolut&rsquo;s AI-driven capabilities? Let's get in touch.
What you&rsquo;ll be doing<ul><li>
Building AI-driven features from scratch, like personal assistants, chatbots, copilots, and more</li><li>
Developing user-focused and backend features using deep learning</li><li>
Delivering impactful, scalable, data-driven AI solutions</li><li>
Collaborating with Product, Engineering, and Data teams to solve deep learning challenges</li><li>
Integrating cutting-edge AI technologies to drive innovation at Revolut</li></ul>
What you'll need<ul><li>
Experience in deep learning within natural language processing area and large language models</li><li>
A bachelor's degree in a STEM major (mathematics, computer science, engineering)</li><li>
Excellent knowledge of data science (Python, SQL) and production tools</li><li>
A deep understanding of probability and statistics fundamentals</li><li>
Big-picture thinking to correctly diagnose problems and productionise research</li><li>
Excellent communication and collaboration skills to partner with Product Owners and business heads</li></ul>
Nice to have<ul><li>
A master's or PhD in a quantitative discipline</li><li>
Solid experience with additional programming languages, such as Java, Scala, C++</li><li>
Experience at a large tech company worth &gt;$15B</li><li>
School/university Olympic medal competitions in physics, maths, economics, or programming</li></ul>
Compensation range<ul><li>
Vilnius: &euro;5,100 - &euro;11,200 gross monthly*</li><li>
Other locations: Compensation will be discussed during the interview process</li><li>Final compensation will be determined based on the candidate's qualifications, skills, and previous experience</li></ul>
Building a global financial super app isn&rsquo;t enough. Our Revoluters are a priority, and that&rsquo;s why in 2021 we launched our inaugural D&amp;I Framework, designed to help us thrive and grow everyday. We're not just doing this because it's the right thing to do. We&rsquo;re doing it because we know that seeking out diverse talent and creating an inclusive workplace is the way to create exceptional, innovative products and services for our customers. That&rsquo;s why we encourage applications from people with diverse backgrounds and experiences to join this multicultural, hard-working team.
Important notice for candidates:
Job scams are on the rise. Please keep these guidelines in mind when applying for any open roles.<ul><li>Only apply through official Revolut channels. We don&rsquo;t use any third-party services or platforms for our recruitment.</li><li>Always double-check the emails you receive. Make sure all communications are being done through official Revolut emails, with an @revolut.com domain.</li></ul>
We won't ask for payment or personal financial information during the hiring process. If anyone does ask you for this, it&rsquo;s a scam. Report it immediately.
By submitting this application, I confirm that all the information given by me in this application for employment and any additional documents attached hereto are true to the best of my knowledge and that I have not wilfully suppressed any material fact. I confirm I have disclosed if applicable any previous employment with Revolut. I accept that if any of the information given by me in this application is in any way false or incorrect, my application may be rejected, any offer of employment may be withdrawn or my employment with Revolut may be terminated summarily or I may be dismissed. By submitting this application, I agree that my personal data will be processed in accordance with Revolut's Candidate Privacy Notice
Notice: This is a remote position based in United Arab Emirates.</div>

Data Scientist (NLP Deep Learning Engineer)

Etihad Credit Bureau

<div>
 
 
 JOB DESCRIPTION SUMMARY
 
 
 
 
 
 
 This role will be responsible for designing, developing, and maintaining scalable data pipelines, ensuring data flow across systems, and optimizing data infrastructure. You will collaborate with cross-functional teams, assist with production support, and drive process optimizations to ensure a seamless data ecosystem for business operations. Strong Databricks experience is a must.
 
 
 
 
 
 
 KEY DUTIES &amp; RESPONSIBILITIES
 
 
 <ul>
 <li>
 
 Data Pipeline Development:
 
 Design, build, and maintain robust data pipelines using Azure Data Factory (ADF), Azure Databricks, ADLS Gen 2 and PySpark, ensuring efficient data collection, processing, and storage from various sources.
 </li>
 <li>
 
 DataBricks Expertise:
 
 Have extensive experience working with DataBricks; including resource provisioning, understanding tools and modules available, and being able to share knowledge and expertise in DataBricks to contribute to optimization of this platform.
 </li>
 <li>
 
 Data Integration:
 
 Integrate data from multiple structured and unstructured sources, including APIs, third-party systems, and databases (SQL, Oracle), ensuring smooth data flow across the ecosystem.
 </li>
 <li>
 
 Data Warehousing:
 
 Design, develop, and optimize data lakes and warehouses on platforms like Databricks, Azure Synapse and ADLS, supporting analytics and reporting needs.
 </li>
 <li>
 
 ETL/ELT Development:
 
 Develop and optimize ETL processes for efficient data extraction, transformation, and loading, using tools like ADF and custom pipelines.
 </li>
 <li>
 
 Process Optimization:
 
 Automate and streamline data workflows (incremental loads, email notifications, pipeline runs) to enhance system performance and reduce costs.
 </li>
 <li>
 
 Production Support &amp; Resolution
 
 : Troubleshoot and resolve production failures within SLAs, ensuring minimal downtime and high data availability. Provide support during business hours and extended hours, (and if critical P1 failures on weekends in rotation with others), as required.
 </li>
 <li>
 
 Go-Live &amp; Project Support
 
 : Support the successful migration and implementation of new code and solutions. Utilizing Azure DevOps CI/CD.
 </li>
 <li>
 
 Team Management
 
 : Lead and manage vendor staff, ensuring smooth execution of projects or operations support as assigned. Ensuring SLAs or project milestones are met on time, and providing mentorship to junior team members.
 </li>
 <li>
 
 Innovation &amp; Optimization
 
 : Design scalable, high-performance data architectures and promote innovation, cost-efficiency, and operational excellence.
 </li>
 <li>
 
 Documentation &amp; Knowledge Transfer
 
 : Create and maintain clear documentation for processes, operations, and technical solutions, including knowledge transfer documents and data catalogue updates.
 </li>
 <li>
 
 Monitoring &amp; System Oversight
 
 : Monitor system performance, identify opportunities for optimization, and ensure platform scalability to meet future needs.
 </li>
 </ul>
 
 
 
 
 
 EDUCATION &amp; SKILLS
 
 
 <ul>
 <li>
 Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field
 </li>
 <li>
 Proven experience working with cloud-based infrastructure, particularly Azure
 </li>
 <li>
 Proven experience working with DataBricks.
 </li>
 <li>
 Experience with containerization tools (Docker, Kubernetes) and CI/CD pipelines
 </li>
 <li>
 Proficient in English
 </li>
 <li>
 Preferred proficiency in Arabic
 </li>
 <li>
 Preferred knowledge of machine learning workflows and model deployment
 </li>
 <li>
 Proficiency in Russian, Turkish and Central Asian languages is a plus.
 </li>
 </ul>
 
 
 
 
 
 EXPERIENCE &amp; KNOWLEDGE
 
 
 <ul>
 <li>
 6+ years of experience in data engineering, production support, and pipeline management
 </li>
 <li>
 Cloud Platforms: ADLS Gen 2, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and DevOps, Azure Key Vault
 </li>
 <li>
 Programming/Querying: Python, PySpark, SQL
 </li>
 <li>
 Automation &amp; Monitoring: Custom automation tools, failure email triggers, performance monitoring solutions
 </li>
 <li>
 Preferred experience in project management
 </li>
 <li>
 Excellent leadership, communication, and problem-solving skills is a plus
 </li>
 </ul>
 
 
 
 
 
 ABILITIES &amp; SPECIFIC REQUIREMENTS
 
 
 <ul>
 <li>
 Handles diverse tasks and meets deadlines under pressure
 </li>
 <li>
 Works independently and responsibly
 </li>
 <li>
 Skilled negotiator with vendors
 </li>
 <li>
 Executes clear strategies aligned with corporate goals
 </li>
 <li>
 Communicates effectively with technical and non-technical audiences
 </li>
 <li>
 Leads professionally and fosters teamwork
 </li>
 <li>
 Manages change and adapts quickly with critical thinking
 </li>
 <li>
 Applies systematic problem-solving and agile decision-making
 </li>
 <li>
 Promotes collaboration, innovation, transparency, and accountability
 </li>
 </ul>
</div>

Senior Specialist - Data Engineering

Ceenex Global LLC

We're Hiring: Senior Network Security Engineer! We are seeking an experienced and skilled Senior Network Security Engineer to join our team in Dubai. The ideal candidate will have a robust background in network security, risk assessment, and incident response, with a proven track record of safeguarding complex network infrastructures.Location: Dubai, United Arab Emirates Work Mode: Work From Office Role: Senior Network Security EngineerSalary - 21000 AED + BenefitsExperience - 12+ yearsWhat You'll Do:<ul><li>Cisco ACI deep production experience</li><li>F5 BIG-IP LTM/ASM/GTM (iRules, ASM, GSLB)</li><li>Citrix ADC/NetScaler (GSLB, Content Switching)</li><li>Palo Alto Firewalls + Panorama (PAN-OS 10/11, Prisma)</li><li>Fortinet FortiGate + FortiManager</li><li>Cisco ASA / Firepower VPN</li><li>Advanced Routing &amp; Switching (BGP, OSPF, QoS) on Nexus 9K/Catalyst</li></ul>Preference<ul><li>Automation: Ansible/Python/Terraform</li><li>Banking/financial sector background</li><li>CCIE (DC or Security or ENT) - Mandatory</li></ul>Ready to secure our networks? Apply now and let&rsquo;s build a safer digital environment together!Job Type: Full-timePay: AED20,000.00 - AED21,000.00 per month

Senior Network Security Engineer

Explore 3126+ Big data engineer in Dubai this December. Find roles across top companies and apply now to boost your career.