4929 Data Engineer Data Platform Integrations jobs near me

Location: Abu Dhabi

CTC: Up to 20000 AED/month

Role Overview

We are seeking an experienced Product Lead & Senior Python Engineer to lead the design, development, and delivery of CKAN-based data platforms. The role combines product ownership, backend engineering, and AI-enabled data solutions, working closely with stakeholders to build scalable, secure, and high-performance data systems.

You will own the CKAN roadmap, customize platform capabilities, and integrate modern APIs, pipelines, and AI/ML features to deliver business value.

Key Responsibilities

Product & Platform Leadership

• Own CKAN platform roadmap, backlog, and prioritization aligned with business KPIs
• Conduct stakeholder discovery to define dataset publishing workflows and governance rules
• Define requirements, acceptance criteria, and delivery milestones

Engineering & Development

• Develop, customize, and extend CKAN using Python and CKAN’s plugin architecture
• Build extensions for custom schemas, validators, actions, and workflow automation
• Design and maintain scalable backend services using FastAPI, Django, or Flask
• Implement CKAN Action API and REST integrations with internal/external systems
• Build and integrate REST & GraphQL APIs

Data & AI Integration

• Design and manage ETL/ELT pipelines
• Integrate AI/ML/NLP models for classification, tagging, summarization, and recommendations
• Optimize performance and reliability of data workflows

Security & Governance

• Implement authentication, authorization, and secure service-to-service integrations
• Ensure compliance with governance and data management standards

Required Qualifications

• 5+ years of professional Python development experience
• Strong hands-on experience with CKAN (plugins, actions, schema customization)
• Backend development expertise using FastAPI/Django/Flask
• Solid experience with PostgreSQL and Elasticsearch
• Experience designing and operating ETL/ELT pipelines
• Experience integrating AI/ML or NLP capabilities into production systems

Preferred Skills

• Product ownership or technical leadership experience
• Knowledge of cloud platforms (AWS/Azure/GCP)
• Containerization (Docker/Kubernetes)
• CI/CD and DevOps practices
• Strong problem-solving and stakeholder communication skills

Job Type: Full-time

Application Question(s):

• Do you have experience in Product Lead & Senior Python Engineer (CKAN & AI-Enabled Data Platforms)
• Salary expectations
• Notice period

Work Location: In person