Infrastructure & Site Reliability Engineer – Datacentre AI Engineering - Riyadh, KSA

Company:

Job Area:

General Summary:

About Us

About the Role

We are looking for a Site Reliability Engineer or Senior Engineer – Datacentre AI Engineering at Qualcomm Technologies, Inc., located in Riyadh, Saudi Arabia.

The role focuses on the design, operation, and continuous improvement of large‑scale AI inference systems in a datacenter environment. The engineer will support critical AI use cases by ensuring Qualcomm’s AI infrastructure is reliable, scalable, and production‑ready for advanced machine‑learning workloads.

The role requires strong systems and software engineering fundamentals, hands‑on execution, and the ability to work independently on complex problem areas while collaborating closely with cross‑functional teams across hardware, software, and machine learning.

Ideal candidates will have 2-8 years of experience

Key Responsibilities will include

Key Responsibilities

1. AI Infrastructure

• Design, deploy, and operate large‑scale AI inference systems supporting critical AI workloads.
• Ensure reliability, availability, and scalability of Qualcomm datacenter AI clusters.
• Develop and maintain software tools and support infrastructure around AI software stacks.

2. AI & ML Engineering

• Analyze software requirements and collaborate with architecture and hardware engineers to support AI workloads.
• Build, deploy, and operate components supporting LLM inference, agentic AI workflows, and AI services.
• Work with models, systems, and software teams to improve model performance on AI100 deployments.
• Identify and implement optimizations for workloads running on multi‑SoC and multi‑card systems.

3. Site Reliability Engineering (SRE)

• Apply SRE fundamentals including monitoring, alerting, incident response, and performance optimization.
• Support production ML systems using MLOps tools and operational best practices.
• Contribute to incident reviews, operational documentation, and continuous reliability improvements.

4. Observability & Tooling

• Build and maintain observability tools, dashboards, and alerts to monitor system health and reliability.
• Monitor infrastructure and services using tools such as Prometheus, Grafana, CloudWatch, and custom telemetry.
• Create and maintain technical documentation, runbooks, and knowledge‑base articles.

5. Automation & CI/CD

• Develop automation to reduce manual operational tasks and improve system reliability.
• Support CI/CD pipelines for AI service and agent deployment.
• Apply Infrastructure‑as‑Code practices using tools such as Terraform and Ansible.

Required Skillset

1. AI & Deep Learning

• Experience working with AI/ML workloads such as LLMs, NLP, Vision, Audio, or Recommendation systems.
• Understand ML inference concepts including batching, token streaming, and performance considerations.
• Hands‑on experience with PyTorch and familiarity with modern ML frameworks.
• Familiarity with distributed inference, checkpointing, and accelerator‑based compute environments.

2. AI Operations

• Experience supporting AI or ML applications in production environments.
• Familiarity with LLM inference pipelines and AI service operations.

3. Programming & Software Design

• Strong programming skills in Python with experience building and supporting production systems.
• Experience with scripting and automation using Python and Bash.
• Familiarity with configuration management and orchestration tools.

4. Systems & Infrastructure

• Strong Linux fundamentals include shell, containers, system services, and networking basics (DNS, TLS, HTTP/gRPC).
• Experience working with cluster schedulers such as Slurm or equivalent systems.
• Experience operating distributed systems with high availability and fault tolerance.

5. Observability & Monitoring

• Hands‑on experience with monitoring and logging tools such as Prometheus, Grafana, ELK, or Loki.
• Understanding of incident management, service health metrics, and system reliability monitoring.

6. DevOps & SRE Practices

• Solid understanding of SDLC, release processes, and operational reliability practices.
• Familiarity with CI/CD pipelines and Infrastructure‑as‑Code tools.

Preferred Skillset

• Experience with GenAI, Agentic AI systems, or LLM orchestration frameworks.
• Exposure to LangChain, AutoGen, or RAG‑based systems.
• Experience with additional ML frameworks such as TensorFlow, JAX, or Ray.
• Knowledge of GPU/accelerator‑based systems and high‑performance networking (RDMA, InfiniBand, RoCE).
• Experience with advanced MLOps workflows or large‑scale AI platform operations.

Qualifications

• Bachelor’s or Master’s degree in engineering, Computer Science, AI/ML, or a related field.
• 2–8 years of software, systems, or infrastructure engineering experience, preferably in production or datacenter environments.

What's on Offer

Apart from working with great people, we offer the below:

• Salary including housing & transport allowance
• Stock (RSU's) and performance related bonus
• 16 weeks fully paid Maternity Leave
• 6 weeks fully paid Paternity Leave
• Employee stock purchase scheme
• Child Education Allowance
• Relocation and immigration support (if needed)
• Life and Medical Insurance
• Live+ Well Reimbursement for health and recreational membership fees

Minimum Qualifications:

• Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering or related work experience.

• 2+ years of work experience with Programming Language such as C, C++, Java, Python, etc.

*References to a particular number of years experience are for indicative purposes only. Applications from candidates with equivalent experience will be considered, provided that the candidate can demonstrate an ability to fulfill the principal duties of the role and possesses the required competencies.

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.

To all Staffing and Recruiting Agencies : Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.

If you would like more information about this role, please contact Qualcomm Careers .