Software Engineer jobs

Senior Staff/Principal Software Engineer - GPU System Software, Onboard Execution

ZooxFoster City, CA +2 placesFull-timeHybridPosted 1 month ago

$339k–$455k/yr listed by the employer

Key facts

Where
Foster City, CA · Seattle, WA · Boston, MA · hybrid
Experience
10+ years
Degree
Bachelor's degree

Strong: looks real and checked open today.

On Zoox’s own careers site (Lever).

  • Checked: On the company's own careers siteLever board
  • Checked: Checked open todayLever board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundLever board
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Architect how perception, prediction, and planning workloads share onboard GPUs, including scheduling, isolation, and deterministic latency.
  • Set and deliver a multi-year roadmap to reduce onboard compute use while meeting latency and utilization budgets.
  • Guide GPU and SoC selection, workload modeling, memory budgets, and performance bring-up for new platforms.
  • Set direction for the inference stack and partner with ML teams to optimize models for deployed hardware.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 10+ years in systems or performance engineering
  • Experience leading GPU or accelerator architecture across teams, or building and leading a performance engineering team
  • Proven record setting technical direction and delivering large, measurable end-to-end gains in latency, utilization, or cost
  • Ability to align ML, systems, hardware, and leadership on a shared technical plan
  • Real-time or embedded GPU experience in autonomy, robotics, AR/VR, games, or HPC (preferred)
  • Production GPU multi-tenancy experience, including MPS, MIG, or priority streams (preferred)
  • New GPU architecture or platform bring-up experience (preferred)
  • Experience with benchmarking methodology, workload modeling, or performance projections (preferred)

Education

  • BS in computer science, computer engineering, or a related field

Skills

  • Deep CUDA platform expertise, including the programming model, runtime, and driver
  • NVIDIA GPU microarchitecture expertise, from Ampere through Blackwell, including Orin and Thor
  • Working knowledge of ML inference optimization, including TensorRT, XLA, Triton, quantization, and fusion
  • Expert C++ on Linux

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Zoox’s careers site

Zoox is building the world's most advanced self-driving hardware and software solution. The efficiency demands of such a system require an expert fine tuning of both the compute hardware architecture as well as the algorithms and middleware that runs on it to achieve maximum throughput at the most optimal power levels.

Show full descriptionShow less

The Software Performance team keeps the main onboard computer healthy and performant to ensure that our on-bot autonomy software meets its latency targets while also accommodating its safety goals. We are responsible for the efficient allocation of onboard compute resources (CPU/GPU/Memory/accelerators) ensuring contention is minimized and the autonomy stack executes harmoniously.

As the Onboard Execution team leader within the Performance team,  you will lead a highly specialized team of software performance engineers in aggressively optimizing on-bot software runtime. This is a high impact role that sits at the intersection of ML Platform, Core, and Autonomy Software - ensuring that efficient compute utilization is a central tenet emphasized across the organization.

In this role, you will:

  • Architect onboard GPU execution. Define how perception, prediction, and planning workloads share onboard GPUs, including scheduling, multi-tenancy, isolation, and deterministic latency under contention. - Drive compute reduction. Own the multi-year roadmap to cut onboard compute per vehicle by setting latency and utilization budgets and landing the biggest levers across models, runtimes, middleware, and hardware in real releases. - Shape hardware and platform direction. Guide next-generation compute decisions (GPU and SoC selection, topology, memory budgets) with workload models and performance projections that justify them, then lead performance bring-up of each new platform. - Lead inference performance at scale. Set direction for the inference stack (TensorRT, CUDA, custom kernels, quantization) and partner with ML teams so models are designed for the hardware they ship on. - Provide technical leadership. Lead and mentor senior engineers, align directors and VPs through design docs, and make the hard calls when performance, safety, and schedule conflict.

Qualifications

  • BS in computer science, computer engineering, or related field and 10+ years in systems or performance engineering, including leading GPU or accelerator architecture across teams, or building and leading a performance engineering team. - Deep CUDA platform (programming model, runtime, and driver) and NVIDIA GPU microarchitecture expertise (Ampere through Blackwell, Orin, Thor). - Proven record setting technical direction and delivering large, measurable end-to-end gains in latency, utilization, or cost. - Working knowledge of ML inference optimization (TensorRT, XLA, Triton, quantization, fusion) and expert C++ on Linux. - Ability to align ML, systems, hardware, and leadership on a shared technical plan.

Bonus Qualifications

  • Real-time or embedded GPU experience: autonomy, robotics, AR/VR, games, or HPC. Production GPU multi-tenancy (MPS, MIG, priority streams). New GPU architecture or platform bring-up, benchmarking methodology, or workload modeling and projections.

About Zoox Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.

Follow us on LinkedIn

Accommodations If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.

A Final Note: You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.

Something wrong with this job? Report it

Similar jobs nearby

Software Engineer

talentpluto · San Francisco, CA

$165k–$250k/yrFull-timeOn-site

StrongChecked open todayPosted yesterday

See more like this