ai infrastructure engineer

Navikenz

<div>Job Summary:
We&rsquo;re looking for an experienced Senior DevOps Engineer who loves working with Kubernetes and AI-driven applications. In this role, you&rsquo;ll be responsible for designing, implementing, and maintaining scalable cloud infrastructure while supporting MLOps pipelines for AI workloads. 
What You&rsquo;ll Be Doing:
<div>
<ul><li>Building Scalable Infrastructure: You&rsquo;ll design, implement, and maintain cloud infrastructure using Kubernetes to handle AI and non-AI workloads efficiently.</li></ul>
<ul><li>Developing CI/CD &amp; MLOps Pipelines: Help us automate AI/ML workflows using tools like Kubeflow, MLflow, or Argo Workflows, ensuring seamless deployment and monitoring of AI models.</li></ul>
<ul><li>Optimizing AI Model Deployments: Work with ML engineers to fine-tune LLM models, AI-driven applications, and containerized environments for smooth operation.</li></ul>
<ul><li>Monitoring &amp; Performance Tuning: Keep an eye on Kubernetes clusters and AI workloads, using tools like Prometheus, Grafana, and Loki to ensure high availability and performance.</li></ul>
<ul><li>Automating Everything: Whether it&rsquo;s infrastructure provisioning (Terraform, Helm) or Kubernetes security best practices, you&rsquo;ll help enforce efficiency and compliance.</li></ul>
</div>
Staying Ahead of the Curve: You&rsquo;ll have the opportunity to explore and implement emerging AI infrastructure trends, including KServe, Ray, and Triton Inference Server.

What We&rsquo;re Looking For:
<div>
<ul><li>8+ years of experience in DevOps, SRE, or Platform Engineering role, with expertise in Kubernetes and cloud-native DevOps</li></ul>
<ul><li>Strong knowledge of Kubernetes fundamentals (deployments, services, ingress, storage, GPU scheduling, multi-cluster management).</li></ul>
<ul><li>Proficiency in scripting &amp; automation with Python, Bash, or Go, particularly for AI-related workflows.</li></ul>
<ul><li>Hands-on experience with AWS, Azure, or GCP, especially in Kubernetes-based AI/ML infrastructure (e.g., Amazon SageMaker, GKE with AI, Azure ML).</li></ul>
<ul><li>Hands-on experience with model deployment frameworks (NVIDIA Triton, vLLM. TGI etc.)</li></ul>
<ul><li>Experience with Distributed computing, multi-GPU training on kubernetes and on-prem GPU clusters.</li></ul>
<ul><li>Experience managing resource allocation and autoscaling for large training/inference workloads. (KEDA, HPA etc.)</li></ul>
<ul><li>Experience with CI/CD &amp; MLOps tools such as Jenkins, Argo CD, Kubeflow, MLflow, or Tekton.</li></ul>
<ul><li>Familiarity with GenAI model deployment, including fine-tuning, inference optimization, and A/B testing.</li></ul>
<ul><li>Hands-on experience with managed ML services (AWS bedrock, Vertext AI models etc.)</li></ul>
<ul><li>Strong problem-solving skills and a mindset of automating repetitive tasks.</li></ul>
<ul><li>Excellent communication skills to collaborate with ML engineers, data scientists, and software teams.</li></ul>
</div>
Bonus Points If You Have:
<div>
<ul><li>Experience with LLMOps (Large Language Model Operations) and deploying LLM-based applications at scale.</li></ul>
<ul><li>Knowledge of Vector Databases (FAISS, Weaviate, Qdrant) for AI-driven applications.</li></ul></div></div>

Senior DevOps Engineer (Kubernetes & AI Infra)

Argon Tech

We are seeking a senior level AWS AI Engineer to design and implement a scalable, production ready Retrieval Augmented Generation system fully native to Amazon AWS. This role is backend and infrastructure focused, with no frontend responsibilities.The ideal candidate has deep hands on experience with Amazon Bedrock and AWS managed services and has previously worked on RAG pipelines, LLM evaluation, and AI infrastructure at scale.Key Responsibilities<ul><li>Design and build RAG pipelines using Amazon Bedrock and Bedrock Knowledge Bases</li><li>Implement retrieval layers using Amazon OpenSearch or AWS RDS</li><li>Orchestrate inference, retrieval, and evaluation workflows using AWS Lambda</li><li>Enable switching and comparison between multiple LLMs within Bedrock, including native and external models such as GPT and Gemini</li><li>Build automated evaluation frameworks for prompt performance, output quality, and chain logic</li><li>Implement AI guardrails, governance, and scalability controls using AWS native tooling</li><li>Ensure the system is modular, testable, and ready for future expansion</li></ul>Required Skills and Experience<ul><li>Strong hands on experience with Amazon AWS services</li><li>Proven expertise in Amazon Bedrock and Bedrock Knowledge Bases</li><li>Experience with AWS Lambda, OpenSearch, and RDS</li><li>Solid understanding of Retrieval Augmented Generation architectures</li><li>Experience building evaluation or testing frameworks for LLM outputs</li><li>Ability to work without frontend or UI dependencies</li><li>Strong grasp of scalable and standardized cloud architecture</li></ul>Preferred Qualifications<ul><li>Experience comparing and benchmarking multiple LLMs in production</li><li>Familiarity with prompt engineering and chain of thought orchestration</li><li>Exposure to AWS guardrails, IAM, logging, and monitoring for AI systems</li><li>Background in MVP to production transitions for AI products</li></ul>Job Type: Full-timeAbility to commute/relocate:<ul><li>Lahore Johar Town: Reliably commute or willing to relocate with an employer-provided relocation package (Preferred)</li></ul>Application Question(s):<ul><li>Please share your current salary, expected and notice period.</li></ul>Experience:<ul><li>AWS AI Development: 4 years (Preferred)</li></ul>Work Location: In person

AWS AI Engineer

NVIDIA

<div>NVIDIA Dynamo is an innovative, open-source platform focused on efficient, scalable inference for large language and reasoning models in distributed GPU environments. By bringing to bear sophisticated techniques in serving architecture, GPU resource management, and intelligent request handling, Dynamo achieves high-performance AI inference for demanding applications. Our team is addressing the most challenging issues in distributed AI infrastructure, and we&rsquo;re searching for engineers enthusiastic about building the next generation of scalable AI systems. As a Principal Software Engineer on the Dynamo project, you will address some of the most sophisticated and high-impact challenges in distributed inference, including:<ul><li>
Dynamo k8s Serving Platform: Build the Kubernetes deployment and workload management stack for Dynamo to facilitate inference deployments at scale. Identify bottlenecks and apply optimization techniques to fully use hardware capacity.</li><li>
Scalability &amp; Reliability: Develop robust, production-grade inference workload management systems that scale from a handful to thousands of GPUs, supporting a variety of LLM frameworks (e.g., TensorRT-LLM, vLLM, SGLang).</li><li>
Disaggregated Serving: Architect and optimize the separation of prefill (context ingestion) and decode (token generation) phases across distinct GPU clusters to improve throughput and resource utilization. Contribute to embedding disaggregation for multi-modal models (Vision-Language models, Audio Language Models, Video Language Models).</li><li>
Dynamic GPU Scheduling: Develop and refine Planner algorithms for real-time allocation and rebalancing of GPU resources based on fluctuating workloads and system bottlenecks, ensuring peak performance at scale.</li><li>
Intelligent Routing: Enhance the smart routing system to efficiently direct inference requests to GPU worker replicas with relevant KV cache data, minimizing re-computation and latency for sophisticated, multi-step reasoning tasks.</li><li>
Distributed KV Cache Management: Innovate in the management and transfer of large KV caches across heterogeneous memory and storage hierarchies, using the NVIDIA Optimized Transfer Library (NIXL) for low-latency, cost-effective data movement.</li></ul>
What you'll be doing:<ul><li>
Collaborate on the design and development of the Dynamo Kubernetes stack.</li><li>
Introduce new features to the Dynamo Python SDK and Dynamo Rust Runtime Core Library.</li><li>
Design, implement, and optimize distributed inference components in Rust and Python.</li><li>
Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM, SGLang, TRT-LLM, llama.cpp, mistral.rs).</li><li>
Improve intelligent routing and KV-cache management subsystems.</li><li>
Contribute to open-source repositories, participate in code reviews, and assist with issue triage on GitHub.</li><li>
Work closely with the community to address issues, capture feedback, and evolve the framework&rsquo;s APIs and architecture.</li><li>
Write clear documentation and contribute to user and developer guides.</li></ul>
What we need to see:<ul><li>
BS/MS or higher in computer engineering, computer science or related engineering (or equivalent experience).</li><li>
15+ years of proven experience in related field.</li><li>
Strong proficiency in systems programming (Rust and/or C++), with experience in Python for workflow and API development. Experience with Go for Kubernetes controllers and operators development.</li><li>
Deep understanding of distributed systems, parallel computing, and GPU architectures.</li><li>
Experience with cloud-native deployment and container orchestration (Kubernetes, Docker).</li><li>
Experience with large-scale inference serving, LLMs, or similar high-performance AI workloads.</li><li>
Background with memory management, data transfer optimization, and multi-node orchestration.</li><li>
Familiarity with open-source development workflows (GitHub, continuous integration and continuous deployment).</li><li>
Excellent problem-solving and communication skills.</li></ul>
Ways to stand out from the crowd:<ul><li>
Prior contributions to open-source AI inference frameworks (e.g., vLLM, TensorRT-LLM, SGLang).</li><li>
Experience with GPU resource scheduling, cache management, or high-performance networking.</li><li>
Understanding of LLM-specific inference challenges, such as context window scaling and multi-model agentic workflows.</li></ul>
With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our special engineering teams are growing fast. If you're a creative and autonomous engineer with a genuine passion for technology, we want to hear from you!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 425,500 USD.<div><div><div><div><div><div><div>
You will also be eligible for equity and benefits.</div></div></div></div></div></div></div>
Applications for this job will be accepted at least until January 4, 2026.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.</div>

Principal Software Engineer - Dynamo

GCON Inc

<div>Project Engineer
Location: West Texas (Project-Based, Long-Term)
Primary Travel Hub: Midland&ndash;Odessa International Air &amp; Space Port (MAF)
Company: GCON
Build the Infrastructure Powering the AI Revolution
GCON is delivering a landmark hyperscale data center campus in West Texas, purpose-built to support next-generation AI, cloud computing, and high-performance workloads. We are seeking Project Engineers to support project execution on a multi-year program at the forefront of AI infrastructure development.
This campus-scale deployment represents a rare opportunity to help build the physical backbone of artificial intelligence in one of the fastest-growing hyperscale markets in the country.
Project Location &amp; Travel
<ul><li>The project is located in West Texas, within commuting distance of the Midland&ndash;Odessa region</li>
<li>Midland&ndash;Odessa International Air &amp; Space Port (MAF) serves as the primary airport hub for project travel</li>
<li>Relocation, per diem, housing, and travel support are available for qualifying candidates</li>
<li>This is a 2&ndash;5 year, project-based assignment with long-term stability and continuity</li>
</ul>
Why This Project Matters
<ul><li>Be part of the frontier of AI-driven construction, delivering infrastructure that supports global technology platforms</li>
<li>Work on hyperscale, mission-critical facilities with extreme power density, advanced cooling, and redundant systems</li>
<li>Join a long-term program with multiple phases and buildings&mdash;not a short-duration project</li>
<li>Lead execution on a project where precision, safety, and schedule directly impact AI deployment timelines</li>
</ul>
About the Role
GCON is delivering a landmark hyperscale data center campus supporting next-generation AI and cloud infrastructure. The Project Engineer supports technical documentation, coordination, and project controls on complex AI-driven infrastructure builds.
Qualifications
<ul><li>1&ndash;4 years of construction engineering experience</li>
<li>Bachelor&rsquo;s degree in Construction Management, Engineering, or similar</li>
<li>Strong organizational and communication skills</li>
<li>Long-term West Texas commitment</li>
</ul>
Long-Term Incentives &amp; Financial Upside
<ul><li>We recognize the commitment required for a project of this magnitude&mdash;and we reward it accordingly.</li>
<li>GCON offers a robust bonus and incentive package for candidates who commit to the full project lifecycle.</li>
<li>This role offers career-defining work paired with exceptional long-term earning potential.</li>
</ul>
Why GCON
<ul><li>Build at the frontier of AI and hyperscale infrastructure</li>
<li>Long-term project stability in a rapidly expanding market</li>
<li>High-visibility leadership role on a nationally significant campus</li>
<li>Collaborative teams and decisive, supportive leadership</li>
<li>A company that rewards commitment, performance, and delivery</li>
</ul>
Equal Opportunity Employer
GCON is an equal opportunity employer and is committed to creating a diverse and inclusive workplace. All employment decisions are based on merit, qualifications, and business needs without regard to any protected status.
Agency Notice
GCON does not accept unsolicited resumes from staffing agencies or recruiters without a signed agreement in place.</div>

Project Engineer

<div>Safety Engineer
Location: West Texas (Project-Based, Long-Term)
Primary Travel Hub: Midland&ndash;Odessa International Air &amp; Space Port (MAF)
Company: GCON
Build the Infrastructure Powering the AI Revolution
GCON is delivering a landmark hyperscale data center campus in West Texas, purpose-built to support next-generation AI, cloud computing, and high-performance workloads. We are seeking experienced Safety Engineers to support execution on a multi-year program at the forefront of AI infrastructure development.
This campus-scale deployment represents a rare opportunity to help build the physical backbone of artificial intelligence in one of the fastest-growing hyperscale markets in the country.
Project Location &amp; Travel
<ul><li>The project is located in West Texas, within commuting distance of the Midland&ndash;Odessa region</li>
<li>Midland&ndash;Odessa International Air &amp; Space Port (MAF) serves as the primary airport hub for project travel</li>
<li>Relocation, per diem, housing, and travel support are available for qualifying candidates</li>
<li>This is a 2&ndash;5 year, project-based assignment with long-term stability and continuity</li>
</ul>
Why This Project Matters
<ul><li>Be part of the frontier of AI-driven construction, delivering infrastructure that supports global technology platforms</li>
<li>Work on hyperscale, mission-critical facilities with extreme power density, advanced cooling, and redundant systems</li>
<li>Join a long-term program with multiple phases and buildings&mdash;not a short-duration project</li>
<li>Lead execution on a project where precision, safety, and schedule directly impact AI deployment timelines</li>
</ul>
About the Role
GCON is delivering a landmark hyperscale data center campus supporting next-generation AI and cloud infrastructure. The Safety Engineer supports site-wide safety strategy, driving a people-first culture while ensuring OSHA compliance, and performing inspections, training, and hazard mitigation on one of the largest AI infrastructure projects in the region.
Qualifications
<ul><li>3+ years construction safety</li>
<li>Bachelors degree in construction management, environmental health and safety or equivalent experience</li>
<li>OSHA 30 required</li>
<li>OSHA 510/500 preferred</li>
<li>Experience on large, complex mission critical, industrial, and commercial construction projects</li>
<li>Long-term West Texas commitment</li>
</ul>
Long-Term Incentives &amp; Financial Upside
<ul><li>We recognize the commitment required for a project of this magnitude&mdash;and we reward it accordingly.</li>
<li>GCON offers a robust bonus and incentive package for candidates who commit to the full project lifecycle.</li>
<li>This role offers career-defining work paired with exceptional long-term earning potential.</li>
</ul>
Why GCON
<ul><li>Build at the frontier of AI and hyperscale infrastructure</li>
<li>Long-term project stability in a rapidly expanding market</li>
<li>High-visibility leadership role on a nationally significant campus</li>
<li>Collaborative teams and decisive, supportive leadership</li>
<li>A company that rewards commitment, performance, and delivery</li>
</ul>
Equal Opportunity Employer
GCON is an equal opportunity employer and is committed to creating a diverse and inclusive workplace. All employment decisions are based on merit, qualifications, and business needs without regard to any protected status.
Agency Notice
GCON does not accept unsolicited resumes from staffing agencies or recruiters without a signed agreement in place.</div>

Safety Engineer

Accenture

Project Role : Technology Platform Engineer 
Project Role Description : Creates production and non-production cloud environments using the proper software tools such as a platform for a project or product. Deploys the automation pipeline and automates environment creation and configuration.
 
Must have skills : Oracle Financials 
Good to have skills : NA 
Minimum 5 year(s) of experience is required 
Educational Qualification : 15 years full time education 
 
&quot;Summary:Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation. As a Technology Platform Engineer, you will be responsible for creating both production and non-production cloud environments utilizing appropriate software tools tailored for specific projects or products. Your typical day will involve deploying automation pipelines and automating the processes of environment creation and configuration, ensuring efficiency and reliability in the cloud infrastructure. Roles &amp; Responsibilities:Lead AI-driven solution design and delivery by applying GenAI and Agentic AI to address complex business challenges, automate processes, and integrate intelligent insights into enterprise workflows for measurable impact. - Expected to perform independently and become an SME. - Required active participation/contribution in team discussions. - Contribute in providing solutions to work related problems. - Collaborate with cross-functional teams to ensure seamless integration of cloud environments. - Monitor and optimize cloud infrastructure performance to enhance operational efficiency. Professional &amp; Technical Skills:Strong grasp of Generative and Agentic AI, prompt engineering, and AI evaluation frameworks. Ability to align AI capabilities with business objectives while ensuring scalability, responsible use, and tangible value realization. - Must To Have Skills: Proficiency in Oracle Financials. - Strong understanding of cloud computing principles and practices. - Experience with automation tools and scripting languages. - Familiarity with infrastructure as code methodologies. - Knowledge of security best practices in cloud environments. Additional Information:- The candidate should have minimum 3 years of experience in Oracle Financials. - A 15 years full time education is required.&quot;
 
15 years full time education

Technology Platform Engineer

Project Role : Technology Platform Engineer 
Project Role Description : Creates production and non-production cloud environments using the proper software tools such as a platform for a project or product. Deploys the automation pipeline and automates environment creation and configuration.
 
Must have skills : Oracle Financials 
Good to have skills : NA 
Minimum 3 year(s) of experience is required 
Educational Qualification : 15 years full time education 
 
&quot;Summary:Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation. As a Technology Platform Engineer, you will be responsible for creating both production and non-production cloud environments utilizing appropriate software tools tailored for specific projects or products. Your typical day will involve deploying automation pipelines and automating the processes of environment creation and configuration, ensuring efficiency and reliability in the cloud infrastructure. Roles &amp; Responsibilities:Lead AI-driven solution design and delivery by applying GenAI and Agentic AI to address complex business challenges, automate processes, and integrate intelligent insights into enterprise workflows for measurable impact. - Expected to perform independently and become an SME. - Required active participation/contribution in team discussions. - Contribute in providing solutions to work related problems. - Collaborate with cross-functional teams to ensure seamless integration of cloud environments. - Monitor and optimize cloud infrastructure performance to enhance operational efficiency. Professional &amp; Technical Skills:Strong grasp of Generative and Agentic AI, prompt engineering, and AI evaluation frameworks. Ability to align AI capabilities with business objectives while ensuring scalability, responsible use, and tangible value realization. - Must To Have Skills: Proficiency in Oracle Financials. - Strong understanding of cloud computing principles and practices. - Experience with automation tools and scripting languages. - Familiarity with infrastructure as code methodologies. - Knowledge of security best practices in cloud environments. Additional Information:- The candidate should have minimum 3 years of experience in Oracle Financials. - A 15 years full time education is required.&quot;
 
15 years full time education

Search 10000+ Ai infrastructure engineer jobs near you this January. New roles added regularly across leading industries. Apply today.

10000 ai infrastructure engineer jobs NEAR_ME

Senior DevOps Engineer (Kubernetes & AI Infra)

AWS AI Engineer

Principal Software Engineer - Dynamo

Project Engineer

Safety Engineer

Technology Platform Engineer

Technology Platform Engineer