Senior Software Engineer II - AI Platform

About the team:

The AI Acceleration Office builds the intelligence layer that powers Careem s ecosystem, and we are looking for a Senior Software Engineer to drive architecture and development of it. Our mission is to drive competitive value through an Agentic AI Platform, a system that can design, orchestrate, and manage autonomous AI agents across customer and operational journeys.

About the role:

As a Senior Software Engineer, you ll lead the architecture and development of the AI Agent Creation and Management Platform, an intelligent layer that enables scalable agent creation, orchestration, lifecycle management, and performance monitoring. You ll work acrossbackend systems, AI infrastructure, and data orchestration, designing abstractions that connect LLMs, context, memory, and state into real-time adaptive agents. This is a hands-on leadership role, you ll design systems, ship code, mentor engineers, and influence Careem s long-term AI platform strategy./p>

What you ll do:

• Architect and implement the foundational services for Careem s Agentic AI Platform, covering agent creation APIs, orchestration pipelines, state machines, and monitoring layers./p>

• Design abstractions for multi-agent collaboration, memory persistence, and reasoning cycles integrated./p>

• Build scalable orchestration frameworks (LangGraph, or custom) that coordinate model calls, context injection, and multi-turn workflows across internal and external agents./p>

• Develop observability and governance systems for AI agents: tracing, metrics, auditing, and self-healing./p>

• Integrate LLM-based and retrieval-augmented components into backend services with strict latency, reliability, and compliance requirements./p>

• Work with data scientists and ML engineers to operationalize models (embedding stores, vector databases, evaluation pipelines, model versioning)./p>

• Establish standards for agent safety, lifecycle management, and deployment reliability across Careem s product ecosystem./p>

• Mentor engineers and shape platform-wide engineering practices around AI integration and distributed systems design./p>

What you ll need:

• 6+ years of backend or distributed systems engineering experience, with 2 3 years in AI/ML infrastructure or LLM-based systems./p>

• Deep hands-on experience in Python and Go, with production experience in building scalable, event-driven architectures./p>

• Expertise in orchestration and distributed compute (Kubernetes)./p>

• Experience in building end-to-end event-drive architecture and data pipelines (Kafka, Airflow and Flink)/p>

• Familiarity with agentic frameworks (LangGraph, LangChain, AutoGen) and design of multi-agent or RAG systems./p>

• Experience in integrating LLMs and vector stores (FAISS, Pinecone, Weaviate, Milvus) into backend applications./p>

• Solid understanding of model and agent observability, monitoring, and continuous evaluation./p>

• Strong architectural skills, capable of designing systems that balance scalability, cost, and experimentation velocity./p>

• Experience working with data streaming, metrics, and real-time feedback loops./p>

• Growth mindset and bias for ownership, you thrive in high-autonomy, fast-paced, and purpose-driven environments./p>