California jobs

Research Scientist / Engineer – Training Infrastructure

LumaRedwood City, CA +7 placesFull-timeHybridPosted 1 month ago

$195k–$395k/yr US pay range, listed by the employer

Key facts

Schedule
Days
Where
Redwood City, CA · United States · EU · New York, NY · INT · Seattle, WA · London, United Kingdom · United Kingdom · hybrid

Looks real. 1 thing to check before you apply.

On Luma’s own careers site (Ashby), checked open today.

  • To check: Wide pay range: top of the range is 2.03× the bottomAsk what the job pays at your level before you interview.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Design, implement, and optimize distributed training systems for models running across thousands of GPUs.
  • Research and implement advanced parallelization strategies, including FSDP, Tensor Parallel, Pipeline Parallel, and Expert Parallel.
  • Build monitoring, visualization, and debugging tools for large-scale training runs.
  • Improve training stability, convergence, and resource utilization across large GPU clusters.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Extensive distributed PyTorch training and parallelisms in foundation-model training
  • Experience with FSDP and multi-node training
  • Experience managing training runs across 100+ GPUs (preferred)
  • Experience with containerization, orchestration, and cloud infrastructure (preferred)

Skills

  • Deep understanding of GPU clusters, networking, and storage systems
  • Familiarity with NCCL, MPI, and distributed-system optimization
  • Strong Linux systems administration and scripting (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Luma’s careers site

You'll build the distributed systems that train Luma's large-scale multimodal models across thousands of GPUs, so researchers can focus on innovation on top of reliable, efficient, scalable infrastructure.

This is hard PyTorch, CUDA, and distributed-systems work — advanced parallelism, training stability, and utilization across massive clusters. It fits an engineer who's solved real problems training foundation models at scale. If you haven't worked at the level of FSDP and multi-node training, this is the wrong depth.

What You'll Own

  • Design, implement, and optimize efficient distributed training systems for models across thousands of GPUs.
Show full descriptionShow less
  • Research and implement advanced parallelization (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel).
  • Build monitoring, visualization, and debugging tools for large-scale training runs.
  • Optimize training stability, convergence, and resource utilization across massive clusters.

First 90 Days

One way the first 90 could unfold.

  • Days 1–30 — Immerse & Diagnose: Learn the current training stack and where stability and utilization hurt at scale.
  • Days 30–60 — Ship & Validate: Land a parallelization or stability improvement that measurably helps a real training run.
  • Days 60–90 — Scale & Systemize: Build the monitoring and tooling that keeps large runs reliable and efficient.

What You Bring

  • Extensive distributed PyTorch training and parallelisms in foundation-model training.
  • Deep understanding of GPU clusters, networking, and storage systems.
  • Familiarity with communication libraries (NCCL, MPI) and distributed-system optimization.

Nice to Have

  • Strong Linux systems administration and scripting.
  • Experience managing training runs across 100+ GPUs.
  • Experience with containerization, orchestration, and cloud infrastructure.

About Luma: Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence — the next step beyond language models comes from vision. Luma is an equal opportunity employer.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Editor + Motion Graphics

Luma · Los Angeles, CA

$126k–$147k/yrFull-timeHybrid

StrongOpen 2 monthsChecked open todayPosted 2 months ago

See more like this