Machine Learning Systems Engineer, Staff - XR Labs

Qualcomm XR Labs in San Diego is expanding our perception team focusing on Smartglass es and XR (AR/VR/MR) solutions and driv ing low-power SoCs for personal AI and XR devices. We develop integrated, multi-modal DL system s to deliver ultra-optimized, power-efficient software and hardware to enable the intelligent perception of the world around us.

Candidates bring a deep understanding of engineering pipelines and solutions of computer vision and machine learning algorithms and technologies that are necessary for interactive, real-time, and immersive systems, including state - of - the - art M ultimodal Deep-learning methods combining Audio, Video, User Interaction & Personalization . They preferably have experience in systems design and implementations for real-time embedded and mobile platforms .

Job description / responsibilities

As an individual contributor you will have the following responsibilities.

• Quickly understand latest academic and state-of-the-art algorithms on Multimodal LLMs, VLMs and related systems, prototyping on desktop and migrating to Qualcomm S o Cs.

• Technical leadership in d esign ing , prototyp ing , and optimiz ing systems for Smartglasses and XR devices .

• Understand Smartglasses and XR use-cases and concurrency constraints to drive multi-modal network architectures for combined processing to achieve minimal power consumption.

• Communication with use-case stakeholders, customers, tech teams, and HW design teams to ensure optimal architectures for low-power features.

Key Experience Areas

• Hands-on development of deep learning models ( PyTorch /TensorFlow) and practical ML pipelines .

• Hands-on experience with M ultimodal LLM s and VLM systems , including data curation, training , deployment, and optimization.

• Experience in Multimodal ML including Audio, Speech, Video, User Input, and Personalization.

• Strong coding skills in Python and C++ for production and on-device implementation.

• Experience with on-device optimization (quantization, acceleration, profiling) on mobile or embedded platforms.

Preferred Experience

• Experience with Smartglasses and Augmented/Virtual Reality devices and applications

• Experience in development, incl. testing and debugging on XR devices, mobile platforms or other embedded systems

• Strong C++ skills with solid object ‑ oriented design principles

• Real-time c omputer graphics

What we offer

• Be part of a world-class Smart Glasses & XR team researching and developing P ersonal AI and Augmented Reality devices.

• Understand and analyze requirements for perception systems for XR platforms

• See your contributions on industry-leading chips embedded in the next generation of Smart Glasses, AR and VR devices, smartphones, and robotics

• Salary, stock and performance related bonus

• Employee Stock Purchase Program

• Relocation and immigration support (if needed)

• Mentor program for intensive induction and further training opportunities