Machine Learning Engineer - 3D Vision Perception

Zoox•Foster City, CA

2d•$189,000 - $258,000

About The Position

The Perception team is responsible for fusing sensor data from multiple modalities and producing relevant representations for difficult and unstructured obstacles around the vehicle. Weâre looking for someone with deep machine learning experience that can help with all stages of the model development lifecycle, including training, evaluation, and deployment. Collaborate with Prediction/Planner team to deploy fully autonomous vehicles in environments with difficult and rare obstacles, extreme weather conditions, and complex driving scenarios

Requirements

5 years of industry experience or more
Proficiency in Python and some knowledge in C++
Deep Learning expertise, preferably with panoptic segmentation experience
Experience developing multi-sensor fusion algorithms for object detection, panoptic segmentation or object tracking
Familiar with Transformer architecture

Nice To Haves

Technical leadership experience with software or machine learning teams
TensorRT or CUDA experience
Experience of 3DGS for 3D reconstruction or novel view synthesis

Responsibilities

Design, develop, train and evaluate multi-sensor fusion based deep learning models to understand obstacles and environmental context
Understand and curate real and synthetic datasets to improve our models
Perform latency optimization and deploy models to our robot fleet
Build a deep understanding of Perception gaps and behavioral issues around difficult obstacle types in order to help plan and prioritize our work
Collaborate with Prediction/Planner team to deploy fully autonomous vehicles in environments with difficult and rare obstacles, extreme weather conditions, and complex driving scenarios