Find The RightJob.

Working Student (m/f/x) - LLM Infrastructure & MLOps Platform Engineering

Über uns

The appliedAI Initiative elevates Europe’s industry to become shapers in the age of AI, creating a future that we desire to live in. Through our ecosystem of strong partners, comprehensive programs, services and solutions we advance companies holistically on their AI journey. With our uniquely diverse, interdisciplinary, and driven team, we build on deep technical expertise while specializing on applicability of the solutions. We share a mindset of collaboration and openness with our ecosystem of leading companies and tech players. Our common goal is to strengthen the European landscape, jointly creating unique knowledge for applying trustworthy AI. We believe that AI Agents will be the dominant topic for AI in the near future and that appliedAI with its partner ecosystem will impact how this technology is being used in industry and beyond in Europe.

Deine Aufgaben

appliedAI’s Internal AI team sits at the heart of how we bring AI into the real world — keeping the infrastructure that powers our internal tools and partner-facing AI products running reliably and at scale. As a working student (m/f/x), you’ll join a small team of experienced engineers who care deeply about operational quality and are happy to share what they know. This is a hands-on role where you’ll build practical intuition for production AI systems while contributing meaningfully from day one.

Your tasks will include:

Support the operation of containerized model-serving systems (Docker Compose) across staging and GPU clusters (H100 and V100)
Monitor system health, inspect logs, and help troubleshoot issues in collaboration with platform engineers
Assist with deployment workflows using GitLab CI/CD, including staging validation and controlled rollouts
Support the LiteLLM routing layer and help maintain model endpoints (chat, reasoning, embedding, speech APIs)
Run API and integration tests to ensure OpenAI-compatible behavior across services
Contribute to monitoring and observability by maintaining Grafana dashboards and Prometheus alerting rules

Dein Profil

Currently enrolled in a Bachelor’s or Master’s program in Computer Science, Data Engineering, Software Engineering, or a related field
Solid Python skills and practical experience with software development or infrastructure projects
Hands-on experience with Linux, Docker, and Docker Compose
Familiarity with Git, CI/CD pipelines, and GitLab CI
Strong curiosity about LLM systems, AI infrastructure, or MLOps; interest in observability tools such as Prometheus and Grafana
Careful and responsible mindset when working with production systems; strong communication skills in English, German is a plus

Deine Vorteile

A highly qualified and motivated team of ~90 people is on a journey to change the rapidly evolving European AI Landscape
Experience the best of both worlds with our hybrid work model: You can choose to work from our vibrant offices - either at the IPAI in Heilbronn or the House of Communication in Munich - while also enjoying the flexibility to work remotely a few days each week
Opportunity to shape a variety of projects and the development of new, original content based on the latest developments in AI and its adoption in businesses
An atmosphere that encourages to think and experiment in new ways with software, hardware, and processes
A highly visible initiative that helps you build a large and high-level network of start-ups, partners, and tech companies
Sports membership with Wellpass to access thousands of sports facilities all over Germany (and beyond), as well as online courses