Senior Data Engineer

About Emeritus

Emeritus is committed to teaching the skills of the future by making high-quality education accessible and affordable to individuals, companies, and governments around the world. It does this by collaborating with more than 80 top-tier universities across the United States, Europe, Latin America, Southeast Asia, India and China.

Emeritus’ short courses, degree programs, professional certificates, and senior executive programs help individuals learn new skills and transform their lives, companies and organizations. Its unique model of state-of-the-art technology, curriculum innovation, and hands-on instruction from senior faculty, mentors and coaches has educated more than 300,000 individuals across 80+ countries.

Founded in 2015, Emeritus, part of Eruditus Group, has more than 1,800 employees globally and offices in Mumbai, New Delhi, Shanghai, Singapore, Palo Alto, Mexico City, New York, Boston, London, and Dubai. The company is backed by prominent investors including Accel, SoftBank Vision Fund 2, the Chan Zuckerberg Initiative, Leeds Illuminate, Prosus Ventures, Sequoia Capital India, and Bertelsmann.

Job Description

Role Overview

• Design, build, and maintain scalable data pipelines (batch and streaming) to support analytics, personalization, and AI/ML use cases.

• Develop, deploy, and maintain microservices and data APIs using Python frameworks such as FastAPI or Flask.

• Build and optimize distributed data processing jobs using technologies such as Apache Spark, Flink, or Beam (with a strong focus on streaming workloads).

• Design and manage data models, warehouses, and data marts; write efficient SQL for analytics and production workloads.

• Implement and maintain event-driven architectures using pub/sub or messaging systems.

• Set up and maintain CI/CD pipelines for data and application deployments.
• Containerize services using Docker and manage deployments on Kubernetes-based infrastructure.

• Orchestrate complex data workflows using tools such as Apache Airflow or Argo Workflows.

• Collaborate with ML and product teams to build and productionize LLM-powered applications (Agents, RAG-based systems, etc.).

• Work with vector databases and retrieval systems for RAG and semantic search use cases.

• Ensure data quality, reliability, observability, and documentation across all pipelines and services.

Emeritus provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.