Machine Learning Systems Engineer, Staff - XR Labs

Qualcomm • San Diego, CA

3d

About The Position

Qualcomm XR Labs in San Diego is expanding our perception team focusing on Smartglasses and XR (AR/VR/MR) solutions and driving low-power SoCs for personal AI and XR devices. We develop integrated, multi-modal DL systems to deliver ultra-optimized, power-efficient software and hardware to enable the intelligent perception of the world around us.
Candidates bring a deep understanding of engineering pipelines and solutions of computer vision and machine learning algorithms and technologies that are necessary for interactive, real-time, and immersive systems, including state-of-the-art Multimodal Deep-learning methods combining Audio, Video, User Interaction & Personalization. They preferably have experience in systems design and implementations for real-time embedded and mobile platforms.
Job description / responsibilities
As an individual contributor you will have the following responsibilities.
Quickly understand latest academic and state-of-the-art algorithms on Multimodal LLMs, VLMs and related systems, prototyping on desktop and migrating to Qualcomm SoCs.
Technical leadership in designing, prototyping, and optimizing systems for Smartglasses and XR devices.
Understand Smartglasses and XR use-cases and concurrency constraints to drive multi-modal network architectures for combined processing to achieve minimal power consumption.
Communication with use-case stakeholders, customers, tech teams, and HW design teams to ensure optimal architectures for low-power features.

Requirements

• Hands-on development of deep learning models (PyTorch/TensorFlow) and practical ML pipelines.
• Hands-on experience with Multimodal LLMs and VLM systems, including data curation, training, deployment, and optimization.
• Experience in Multimodal ML including Audio, Speech, Video, User Input, and Personalization.
• Strong coding skills in Python and C++ for production and on-device implementation.
• Experience with on-device optimization (quantization, acceleration, profiling) on mobile or embedded platforms.

Nice To Haves

• Experience with Smartglasses and Augmented/Virtual Reality devices and applications
• Experience in development, incl. testing and debugging on XR devices, mobile platforms or other embedded systems
• Strong C++ skills with solid object‑oriented design principles
• Real-time computer graphics

Responsibilities

• Quickly understand latest academic and state-of-the-art algorithms on Multimodal LLMs, VLMs and related systems, prototyping on desktop and migrating to Qualcomm SoCs.
• Technical leadership in designing, prototyping, and optimizing systems for Smartglasses and XR devices.
• Understand Smartglasses and XR use-cases and concurrency constraints to drive multi-modal network architectures for combined processing to achieve minimal power consumption.
• Communication with use-case stakeholders, customers, tech teams, and HW design teams to ensure optimal architectures for low-power features.

Benefits

• Be part of a world-class Smart Glasses & XR team researching and developing Personal AI and Augmented Reality devices.
• Understand and analyze requirements for perception systems for XR platforms
• See your contributions on industry-leading chips embedded in the next generation of Smart Glasses, AR and VR devices, smartphones, and robotics
• Salary, stock and performance related bonus
• Employee Stock Purchase Program
• Relocation and immigration support (if needed)
• Mentor program for intensive induction and further training opportunities

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level