ml infrastructure engineer

Optics11

<div>We are expanding our team with a Data &amp; ML Infrastructure Engineer who will take ownership of the platform that enables data ingestion, processing, storage, and machine learning workflows across multiple products. Operating at the intersection of data science, software engineering, and cloud infrastructure, you will build the foundations and ensure that our ML systems are scalable, reproducible, and production ready.
In this role, you will design, implement, and continuously improve a cloud-agnostic data and ML platform that supports multiple products and teams. You will be responsible for platform reliability, scalability, and cost-efficiency, while providing data scientists and ML engineers with the tools and infrastructure to efficiently develop, train, validate, and deploy machine learning models. You will serve as a technical bridge between the data science and IT/infrastructure teams, translating requirements into robust and maintainable systems.
This role includes ownership of an existing vendor-delivered platform and its evolution into a fully automated, reproducible, and multi-product ML platform.<h4 class="jobSectionHeader">
Key Responsibilities:</h4><ul><li>
Design, implement, and maintain the data and ML platform infrastructure, including systems for data ingestion, storage, processing, and training.</li><li>
Ensure high availability, reliability, and uptime of the platform, as it is critical to the business value proposition.</li><li>
Maintain and evolve vendor-delivered platform components and ensure long-term maintainability and independence.</li><li>
Build and maintain data workflows, including tools for dataset versioning, experiment tracking, and model lifecycle management across multiple products.</li><li>
Enforce DevOps / MLOps practices, including CI/CD pipelines, Infrastructure-as-Code, and automated workflows.</li><li>
Develop cloud-agnostic and containerized solutions that can run across public and private cloud environments within EU constraints.</li><li>
Optimize data storage, lifecycle policies, and cost efficiency, including tiered storage and retention strategies.</li><li>
Implement and maintain monitoring and alerting systems (e.g., Prometheus, Grafana) for pipelines, infrastructure, and resource usage.</li><li>
Ensure data governance, security, and compliance, including access control, audit logging, and anonymization requirements.</li><li>
Collaborate closely with data scientists, ML engineers, and IT teams to deliver infrastructure that meets operational needs.</li><li>
Manage resource and cost controls, including budgets, approvals, and tracking.</li><li>
Contribute to documentation, operational runbooks, and onboarding materials for the platform.</li></ul><h4 class="jobSectionHeader">
Why Join Us?</h4><ul><li>
Join one of Europe&rsquo;s most promising deep-tech scale-ups.</li><li>
Shape the future of a rapidly growing multidisciplinary R&amp;D organization.</li><li>
Competitive salary and benefits package.</li><li>
Enjoy regular team activities and company events.</li><li>
Fresh team lunches provided3 times/ week.</li></ul><h4 class="jobSectionHeader"> 
Required Qualifications:</h4><ul><li>
MSc or equivalent with 5+ years&rsquo; industry experience in Computer Science, Data Engineering, Machine Learning, or a related field.</li><li>
Strong experience with data platforms, cloud infrastructure, and distributed systems (AWS, GCP, Azure).</li><li>
Proven experience with Infrastructure-as-Code (e.g., Terraform) and automated deployments.</li><li>
Experience with ML platforms and tools (MLflow, Feast, DVC, DataHub or equivalent).</li><li>
Experience with AWS Sagemaker or Google Vertex AI platforms.</li><li>
Experience with databases (MongoDB, PostgreSQL, InfluxDB or equivalent).</li><li>
Experience with message brokers and streaming systems (Kafka, RabbitMQ or equivalent).</li><li>
Hands-on experience with containerization (Docker/OCI) and orchestration (Kubernetes or similar).</li><li>
Experience with CI/CD systems (e.g., GitLab CI).</li><li>
Programming skills in Python.</li><li>
Experience with monitoring and observability tools (Prometheus, Grafana).</li><li>
Understanding of DevOps and MLOps practices.</li><li>
Ability to work across teams and translate requirements into scalable infrastructure solutions.</li></ul>
Nice to Have:<ul><li>
Knowledge of data governance, IAM, and security frameworks.</li><li>
Experience with cost optimization and resource management in cloud environments.</li><li>
Familiarity with multi-tenant or multi-product platform architectures.</li><li>
Experience working with EU data compliance constraints in energy, maritime or defense.</li></ul>
Security &amp; Compliance:
You'll be working with clients in the defense and security sectors, obtaining a Certificate of No Objection issued by the AIVD (Dutch General Intelligence and Security Service) is mandatory. This means you will need to undergo a security screening. For more information, please refer to details on security screening.</div>

Data & ML Infrastructure Engineer

<div>
 We are expanding our team with a
 
 Data &amp; ML Infrastructure Engineer
 
 who will take ownership of the platform that enables data ingestion, processing, storage, and machine learning workflows across multiple products. Operating at the intersection of data science, software engineering, and cloud infrastructure, you will build the foundations and ensure that our ML systems are scalable, reproducible, and production ready.
 
 
 In this role, you will design, implement, and continuously improve a cloud-agnostic data and ML platform that supports multiple products and teams. You will be responsible for platform reliability, scalability, and cost-efficiency, while providing data scientists and ML engineers with the tools and infrastructure to efficiently develop, train, validate, and deploy machine learning models. You will serve as a technical bridge between the data science and IT/infrastructure teams, translating requirements into robust and maintainable systems.
 
 
 This role includes ownership of an existing vendor-delivered platform and its evolution into a fully automated, reproducible, and multi-product ML platform.
 
 
 Key Responsibilities:
 
 
 <ul>
 <li>
 Design, implement, and maintain the data and ML platform infrastructure, including systems for data ingestion, storage, processing, and training.
 </li>
 <li>
 Ensure high availability, reliability, and uptime of the platform, as it is critical to the business value proposition.
 </li>
 <li>
 Maintain and evolve vendor-delivered platform components and ensure long-term maintainability and independence.
 </li>
 <li>
 Build and maintain data workflows, including tools for dataset versioning, experiment tracking, and model lifecycle management across multiple products.
 </li>
 <li>
 Enforce DevOps / MLOps practices, including CI/CD pipelines, Infrastructure-as-Code, and automated workflows.
 </li>
 <li>
 Develop cloud-agnostic and containerized solutions that can run across public and private cloud environments within EU constraints.
 </li>
 <li>
 Optimize data storage, lifecycle policies, and cost efficiency, including tiered storage and retention strategies.
 </li>
 <li>
 Implement and maintain monitoring and alerting systems (e.g., Prometheus, Grafana) for pipelines, infrastructure, and resource usage.
 </li>
 <li>
 Ensure data governance, security, and compliance, including access control, audit logging, and anonymization requirements.
 </li>
 <li>
 Collaborate closely with data scientists, ML engineers, and IT teams to deliver infrastructure that meets operational needs.
 </li>
 <li>
 Manage resource and cost controls, including budgets, approvals, and tracking.
 </li>
 <li>
 Contribute to documentation, operational runbooks, and onboarding materials for the platform.
 
 
 
 </li>
 </ul>
 
 Why Join Us?
 
 
 
 <ul>
 <li>
 Join one of Europe&rsquo;s most promising deep-tech scale-ups.
 </li>
 <li>
 Shape the future of a rapidly growing multidisciplinary R&amp;D organization.
 </li>
 <li>
 Competitive salary and benefits package.
 </li>
 <li>
 Enjoy regular team activities and company events.
 </li>
 <li>
 Fresh team lunches provided3 times/ week.
 
 
 
 </li>
 </ul>
 Required Qualifications:
 
 
 <ul>
 <li>
 MSc or equivalent with 5+ years&rsquo; industry experience in Computer Science, Data Engineering, Machine Learning, or a related field.
 </li>
 <li>
 Strong experience with data platforms, cloud infrastructure, and distributed systems (AWS, GCP, Azure).
 </li>
 <li>
 Proven experience with Infrastructure-as-Code (e.g., Terraform) and automated deployments.
 </li>
 <li>
 Experience with ML platforms and tools (MLflow, Feast, DVC, DataHub or equivalent).
 </li>
 <li>
 Experience with AWS Sagemaker or Google Vertex AI platforms.
 </li>
 <li>
 Experience with databases (MongoDB, PostgreSQL, InfluxDB or equivalent).
 </li>
 <li>
 Experience with message brokers and streaming systems (Kafka, RabbitMQ or equivalent).
 </li>
 <li>
 Hands-on experience with containerization (Docker/OCI) and orchestration (Kubernetes or similar).
 </li>
 <li>
 Experience with CI/CD systems (e.g., GitLab CI).
 </li>
 <li>
 Programming skills in Python.
 </li>
 <li>
 Experience with monitoring and observability tools (Prometheus, Grafana).
 </li>
 <li>
 Understanding of DevOps and MLOps practices.
 </li>
 <li>
 Ability to work across teams and translate requirements into scalable infrastructure solutions.
 
 
 
 </li>
 </ul>
 
 Nice to Have:
 
 
 
 <ul>
 <li>
 Knowledge of data governance, IAM, and security frameworks.
 </li>
 <li>
 Experience with cost optimization and resource management in cloud environments.
 </li>
 <li>
 Familiarity with multi-tenant or multi-product platform architectures.
 </li>
 <li>
 Experience working with EU data compliance constraints in energy, maritime or defense.
 
 
 
 </li>
 </ul>
 
 Security &amp; Compliance:
 
 
 
 You'll be working with clients in the defense and security sectors, obtaining a Certificate of No Objection issued by the AIVD (Dutch General Intelligence and Security Service) is mandatory. This means you will need to undergo a security screening. For more information, please refer to details on security screening.
</div>

Dautom

<div>
 
 The AI Infrastructure Engineer is a platform specialist responsible for architecting, building, and operating high-performance AI infrastructure to support advanced AI workloads, including LLMs, GenAI, Computer Vision, and MLOps. This role will focus on managing GPU clusters (NVIDIA A100/H100), deploying and maintaining Red Hat OpenShift AI (RHODS), and ensuring secure, scalable, and cost-efficient AI platforms across SDD&rsquo;s Sovereign Cloud and hybrid/multi-cloud environments. The engineer will enable enterprise-grade AI adoption for 200+ government entities.
 
 
 
 
 
 Key Responsibilities &amp; Deliverables
 
 
 
 
 
 GPU &amp; AI Platform Architecture
 
 
 Design and implement GPU-based compute clusters. Define reference architectures for LLM hosting, Vector Databases, MLOps, and high-performance storage/networking.
 
 
 Fully operational GPU-based AI infrastructure. GPU Cluster Uptime and Performance Utilization. Reduction in Cost per Training/Inference Workload.
 
 
 GPU Cluster Operations
 
 
 Install, configure, and optimize core components: CUDA, cuDNN, NCCL, NVIDIA Drivers, and GPU Operators. Implement GPU partitioning, scheduling, and performance tuning for high-end GPUs (e.g., A100/H100).
 
 
 High-availability architecture for all AI workloads. Complete documentation and runbooks.
 
 
 OpenShift AI (RHODS) Management
 
 
 Deploy, configure, and maintain the Red Hat OpenShift AI (RHODS) platform for multi-tenant use. Manage the integration of NVIDIA GPU Operator for efficient GPU scheduling and support Data Scientists with Notebooks, Training, and Inference Endpoints.
 
 
 Production-ready OpenShift AI (RHODS) platform. AI Project Onboarding Speed.
 
 
 LLM &amp; Model Serving
 
 
 Build and manage infrastructure for hosting and serving open-source LLM frameworks (Llama, Falcon, Mistral) and supporting RAG pipelines, LoRA adapters, and Vector Databases (Milvus, pgvector).
 
 
 Multi-model LLM serving environment for entities. MLOps Pipeline Success Rate and Deployment Frequency.
 
 
 MLOps &amp; Automation
 
 
 Implement IaC (Terraform, Ansible) and GitOps for the automated lifecycle management of the AI platform (node onboarding, scaling, model rollout/rollback). Build robust MLOps pipelines for data prep, training, evaluation, and monitoring (using tools like MLflow/Kubeflow).
 
 
 Infrastructure automation via Terraform &amp; Ansible. Automation Coverage for AI Infrastructure.
 
 
 
 
 
 Required Qualifications &amp; Experience
 
 <ul>
 <li>
 Experience: 7&ndash;12 years in Cloud Infrastructure, DevOps, ML Infrastructure, or Platform Engineering.
 </li>
 <li>
 Deep Hands-On Expertise:
 </li>
 <li>
 GPU Systems (NVIDIA A100/H100), Linux, Containers, and Kubernetes.
 </li>
 <li>
 OpenShift AI (RHODS) or equivalent Kubernetes GPU orchestration.
 </li>
 <li>
 LLM Hosting (Llama, Mistral, Falcon, etc.) and supporting Vector Databases/RAG systems.
 </li>
 <li>
 Strong Experience In: TensorFlow, PyTorch, Hugging Face, Distributed Training (DDP, Deep Speed), and ML Ops Stacks (ML flow, Kubeflow).
 </li>
 </ul>
 
 Essential Skills &amp; Competencies
 
 <ul>
 <li>
 Technical: Deep understanding of GPU compute, HPC architectures, and ML performance profiling. Strong skills in IaC (Terraform/Ansible), CI/CD, and OpenShift/Kubernetes operators.
 </li>
 <li>
 Soft Skills: Strong troubleshooting, optimization, and performance engineering mindset. Excellent cross-functional collaboration and documentation skills.
 </li>
 </ul>
 
 Preferred Certifications
 
 <ul>
 <li>
 NVIDIA Deep Learning / AI Infrastructure Certification
 </li>
 <li>
 Red Hat OpenShift AI specialization
 </li>
 <li>
 Kubernetes CKA/CKAD
 </li>
 <li>
 Azure AI or Oracle Cloud AI certifications
 </li>
 <li>
 Terraform &amp; Ansible certifications
 </li>
 </ul>
 
 
 
</div>

AI Infrastructure Engineer

Google

<div><h3 class="jobSectionHeader">Minimum qualifications:</h3><ul>
<li>Bachelor&rsquo;s degree or equivalent practical experience. 
</li>
<li>5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.</li>
<li>5 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field. 
</li>
<li>5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).</li></ul> 
<h3 class="jobSectionHeader">
Preferred qualifications:</h3><ul>
<li>Master&rsquo;s degree or PhD in Engineering, Computer Science, or a related technical field. 
</li>
<li>5 years of experience with data structures and algorithms.</li>
<li>3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.</li>
</ul><div><h2 class="jobSectionHeader">About the job</h2>
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google&rsquo;s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

In this role, you will be at the forefront of applying Google's Generative AI to solve real-world issues for our customers. You will act as a specialized software engineer embedded with key accounts, working to build, deploy, and optimize sophisticated AI agents on our Customer Engagement Suite (CES) platform. You will bridge the gap between our core product developing teams and customer needs, directly accelerating customer success and shaping the future of our AI products.
The Cloud Applied AI (AAI) powers business growth with Gemini Enterprise. Our portfolio includes Gemini Enterprise for Customer Experience (Shopping Agent, CX Agent Studio, Agent Assist, Vertex AI Search - Commerce, Customer Experience Insights), along with other vertical and domain packaged solutions. We enable high adoption and speed to value by building solutions that are quickly deployed, delivering new 0-to-1 capabilities with startup agility. Team members operate at the forefront of AI, collaborating directly with model builders with unprecedented speed. Join us to work on cutting-edge projects and shape the future of AI in a fast-paced, collaborative, and impactful environment.</div><div><h2 class="jobSectionHeader">
Responsibilities</h2><ul>
<li>Partner directly with customers to understand their business issues. Design, co-develop, debug, and deploy custom conversational AI agents and solutions to accelerate their time to value.</li>
<li>Systematize learnings from customer engagements by creating reusable tools, building documentation and accelerators, and establishing best practices across the organization.</li>
<li>Act as a high-level problem solver, empowered to write bespoke code, develop custom tooling, and even contribute directly to the core product codebase to resolve critical customer issues. 
</li>
<li>Lead the design and implementation of solutions in specialized ML areas, optimize ML infrastructure, and guide the development of model optimization and data processing strategies. 
</li>
</ul></div>Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.</div>

Software Engineer, Applied AI, Agent Building, Google Cloud Platform

Accenture

<div>YOU ARE
As a hands-on Infrastructure architect, you are an early-career engineer who learns and grows while contributing hands-on to the AI and machine learning infrastructure that powers real-world applications. Under the guidance of senior architects and engineers, you'll develop practical skills in coding, testing, configuring, deploying, monitoring, and troubleshooting AI systems and the infrastructure they run on. Day to day, you'll write and test code and deployment scripts, help configure cloud and on-premises compute resources such as GPU clusters and distributed training environments, deploy AI systems and models into production, and support data pipelines that feed AI and ML workflows. You'll learn to monitor AI systems and infrastructure health across both InfraOps and MLOps disciplines, perform AI monitoring to track model and system performance, and troubleshoot issues across the computational stack with mentorship and support. This is a hands-on, learning-focused where you build expertise across modern tools and platforms &mdash; including container orchestration, model serving, CI/CD pipelines, InfraOps, MLOps, and AI monitoring &mdash; while making meaningful contributions to infrastructure that enables AI-driven busin
ess outcomes.
THE WORK<ul><li>
Write, test, and debug code and scripts for AI infrastructure tasks, including automation and tooling, under the guidance of senior engineers.</li><li>
Develop and maintain infrastructure and software deployment scripts to support reliable, repeatable releases of AI systems and models.</li><li>
Configure and provision compute resources across cloud and on-premises environments, including GPU clusters and distributed training setups.</li><li>
Deploy AI systems and machine learning models into production infrastructure, following established processes and best practices.</li><li>
Deploy data pipelines that feed AI and ML workflows, ensuring data is available, clean, and reliable.</li><li>
Assist with container orchestration and model serving, learning tools such as Docker, Kubernetes, and model deployment frameworks.</li><li>
Support and maintain CI/CD pipelines for automating the build, test, and deployment of AI infrastructure and applications.</li><li>
Monitor AI systems and infrastructure health across InfraOps and MLOps disciplines, tracking performance, reliability, and resource utilization.</li><li>
Perform AI monitoring to track model performance, detect drift or degradation, and surface issues for review.</li><li>
Troubleshoot and help resolve issues across the computational stack &mdash; hardware, networking, software, and models &mdash; with mentorship and support.</li><li>
Document configurations, processes, and procedures to maintain clear, repeatable, and shareable knowledge across the team.</li><li>
Collaborate with senior architects and engineers, participating in code reviews, team discussions, and knowledge-sharing sessions to grow technical skills.</li><li>
Apply security, cost-efficiency, and scalability best practices as you learn them, contributing to well-managed and responsible infrastructure.</li></ul></div>
 
<div>EDUCATION<ul><li>
Bachelor's Degree in Computer Science, Computer Engineering, related Engineering field</li></ul>
BASIC (REQUIRED) QUALIFICATION<ul><li>
Work or coursework experience with AI/ML or Computer engineering or Computer science.</li><li>
Coding, building, monitoring, troubleshooting applications of AI/ML models; selecting, designing and infrastructure for deploying and running them on premise or on public cloud.</li><li>
Strong understanding of AI and machine learning as a subject.</li><li>
Strong understanding of computing infrastructure a subject, preferred knowledge of AI infrastructure.</li><li>
Proficiency in programming languages such as Python, Java, or C++.</li></ul></div>

AI Infrastructure Architecture Analyst

<div>YOU ARE
As a hands-on Infrastructure Architect, you are an experienced engineer with several years in infrastructure engineering who now takes on more complex, higher-impact work designing and optimizing the AI and machine learning infrastructure that powers real-world applications. Working alongside senior architects and engineers &mdash; and increasingly leading your own workstreams &mdash; you apply proven skills in coding, testing, configuring, deploying, monitoring, and troubleshooting AI systems and the infrastructure they run on. Day to day, you architect and optimize infrastructure components, write and review code and deployment scripts, design and tune cloud and on-premises compute resources such as GPU clusters and distributed training environments, deploy AI systems and models into production, and build and optimize data pipelines that feed AI and ML workflows. You optimize the computational stack for performance, cost, power, and scalability, monitor AI systems and infrastructure health across both InfraOps and MLOps disciplines, perform AI monitoring to track model and system performance, and independently troubleshoot and resolve complex issues across the stack. You also mentor junior engineers, contribute to architectural decisions, and help establish best practices. This is a hands-on, ownership-driven where you apply and deepen your expertise across modern tools and platforms &mdash; including container orchestration, model serving, CI/CD pipelines, InfraOps, MLOps, and AI monitoring &mdash; while making meaningful contributions to infrastructure that enables AI-driven business outcomes.
THE WORK<ul><li>
Write, review, and debug code, scripts, and infrastructure-as-code for AI infrastructure, automation, and tooling, setting standards for quality across the team.</li><li>
Architect, configure, and provision compute resources across cloud and on-premises environments, including GPU clusters and distributed training setups, optimizing for performance and utilization.</li><li>
Design and maintain deployment automation and CI/CD pipelines to support reliable, repeatable releases of AI systems, models, and applications.</li><li>
Deploy AI systems, models, and data pipelines into production, defining and improving the processes and best practices others follow.</li><li>
Lead container orchestration and model serving using tools such as Docker, Kubernetes, and model deployment frameworks.</li><li>
Architect and optimize the computational stack for performance, power, cost, and scalability, balancing trade-offs against business goals.</li><li>
Evaluate and select tools, frameworks, and platforms, making recommendations that shape the infrastructure roadmap.</li><li>
Integrate AI models and systems into existing enterprise systems, ensuring interoperability, security, and regulatory compliance.</li><li>
Own AI monitoring and infrastructure health across InfraOps and MLOps, tracking performance, reliability, and utilization, and driving remediation.</li><li>
Independently troubleshoot and resolve complex issues across the computational stack &mdash; hardware, networking, software, and models &mdash; and lead root-cause analysis.</li><li>
Mentor junior engineers and lead code reviews, providing technical direction and supporting their growth.</li><li>
Define and document architecture standards, processes, and procedures, and apply security, cost-efficiency, and scalability best practices across the infrastructure.</li></ul></div>
 
<div>EDUCATION<ul><li>
Bachelor's Degree in Computer Science, Computer Engineering, related Engineering field</li></ul>
BASIC (REQUIRED) QUALIFICATION<ul><li>
Experienced with coding, building, monitoring, troubleshooting applications of AI/ML models; selecting, designing and infrastructure for deploying and running them on premise or on public cloud.</li><li>
Strong understanding of AI and machine learning as a subject.</li><li>
Strong understanding of computing infrastructure a subject, preferred knowledge of AI infrastructure.</li><li>
Proficient in programming languages such as Python, Java, or C++.</li><li>
Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow).</li><li>
Strong problem-solving skills and ability to work in a fast-paced environment.</li><li>
Excellent communication and collaboration skills.</li><li>
Experience in AI/ML infrastructure engineering or related roles on a hyperscaler platform for deploying large scale solutions.</li></ul></div>

AI Infrastructure Architecture Specialist

CRUTZ LEELA ENTERPRISES

OVERVIEWWe are hiring an ML Systems Engineer to design and deliver cutting-edge AI solutions for enterpriseclients at the frontier of agentic AI, inference engineering, and ML systems architecture. You will gobeyond applied ML - dissecting how AI systems are built, optimized, and scaled - designing production-grade architectures spanning retrieval systems, inference pipelines, and agentic workflows. You willtranslate state-of-the-art capabilities into robust, performant solutions, operating at the intersection of MLresearch awareness and engineering discipline.KEY RESPONSIBILITIES<ul><li>Design and deliver production-grade AI systems for enterprise clients spanning agentic workflows,</li></ul>LLM inference pipelines, and retrieval-augmented architectures.<ul><li>Lead ML systems architecture decisions - model serving topology, inference backend selection, KV</li></ul>cache management, batching strategies, and memory optimization - alongside ML performanceengineering to profile bottlenecks, benchmark throughput/latency, and evaluate quantizationstrategies (GPTQ, AWQ, GGUF).<ul><li>Architect RAG pipelines and agentic AI systems - from chunking, embedding, hybrid retrieval, and re-</li></ul>ranking through to multi-agent orchestration, tool use, and memory architectures.<ul><li>Evaluate frontier model capabilities - reasoning models, multimodal systems, fine-tuned variants - and</li></ul>make principled architectural trade-off decisions for client contexts.<ul><li>Build reusable accelerators, reference implementations, and evaluation/observability frameworks</li></ul>encoding best practices across engagements.<ul><li>Contribute to technical solutioning - architecture designs, proof-of-concepts, and feasibility</li></ul>assessments - in client-facing contexts.TECHNICAL QUALIFICATIONSCore Requirements<ul><li>Python &amp;amp; ML ecosystem: Strong programming skills with production AI system experience; hands-</li></ul>on with the PyTorch ecosystem including Hugging Face Transformers, PEFT, Accelerate, andDatasets.<ul><li>LLM inference &amp;amp; serving: Deep knowledge of KV cache mechanics, quantization, and batching;</li></ul>hands-on with at least one inference runtime (vLLM, TGI, TensorRT-LLM, SGLang, or similar).<ul><li>Hands-on experience supporting AI/ML and LLM inference platforms at scale, including</li></ul>working with vLLM for high-performance LLM serving, optimization, and large-scale inference.<ul><li>RAG &amp;amp; Agentic Systems: Experience designing retrieval architectures and building agentic systems</li></ul>using LangGraph, LlamaIndex Workflows, AutoGen, or CrewAI - including tool use, memory, andmulti-agent coordination.<ul><li>LLM APIs &amp;amp; prompt engineering: Strong grasp of structured output generation, function calling, and</li></ul>provider SDK usage across OpenAI, Anthropic, Mistral, Hugging Face, and similar.<ul><li>Deployment fundamentals: Proficiency with Docker, containerization, and Linux environments for</li></ul>packaging, deploying, and debugging AI systems.<ul><li>Comfortable leveraging AI-assisted tools for collaborative development, code generation, refactoring,</li></ul>and productivity enhancement.Preferred<ul><li>Fine-tuning: Experience with LoRA/QLoRA, dataset curation, and instruction tuning; understanding</li></ul>of when fine-tuning is the right lever vs. prompting or RAG.<ul><li>Low-level AI systems: Familiarity with CUDA, Triton, or similar GPU programming models; working</li></ul>knowledge of C++ or Rust.<ul><li>Infrastructure &amp;amp; observability: Kubernetes for containerized AI workloads; experience with</li></ul>LangSmith, Arize, W&amp;amp;B, Phoenix, or Prometheus/Grafana for ML observability.WAYS TO STAND OUT FROM THE CROWD<ul><li>You have built and deployed a production agentic system and can speak to the failure modes and</li></ul>design decisions that only emerge at runtime.<ul><li>You have done inference optimization at a systems level - tuning serving infrastructure, implementing</li></ul>custom batching logic, or optimizing a quantization pipeline to hit real SLAs.<ul><li>You have open-source contributions to prominent ML systems repositories - vLLM, SGLang,</li></ul>llama.cpp, TGI, LangChain, LlamaIndex, or similar - demonstrating work that holds up to communityscrutiny.<ul><li>You have designed custom LLM evaluation frameworks with structured regression harnesses,</li></ul>domain-specific evals, or human-in-the-loop feedback loops - beyond off-the-shelf metrics.<ul><li>You bring a client-facing engineering mindset and can defend opinions on reasoning models, long-</li></ul>context retrieval, or inference hardware tradeoffs based on hands-on experimentation.Pay: ₹500,000.00 - ₹1,800,000.00 per yearBenefits:<ul><li>Provident Fund</li></ul>Work Location: In person

ML Systems Engineer (Agentic AI & Inference Engineering)

Search 4081+ Ml infrastructure engineer jobs near you this July. New roles added regularly across leading industries. Apply today.

4081 ml infrastructure engineer jobs Near Me

Data & ML Infrastructure Engineer

Data & ML Infrastructure Engineer

AI Infrastructure Engineer

Software Engineer, Applied AI, Agent Building, Google Cloud Platform

AI Infrastructure Architecture Analyst

AI Infrastructure Architecture Specialist

ML Systems Engineer (Agentic AI & Inference Engineering)