Machine Learning Engineer jobs

Research, RL Scaling

Thinking Machines LabSan Francisco, CAFull-timeOn-site

$350k–$475k/yr listed by the employer

Above the typical $242k a year for Machine Learning Engineer jobs in California (all levels)How we compare

How we compare. Typical is the median yearly pay of 670 Machine Learning Engineer jobs in California (all levels) that list pay, from the employers' own postings. About means within 5%.

Key facts

Degree
Bachelor's degree or equivalent
US visa
Sponsors US visas

Looks real. 1 thing to check before you apply.

On Thinking Machines Lab’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 3 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Co-design RL training recipes and systems, and validate them at frontier scale.
  • Advance asynchronous RL algorithms and improve rollout generation and its integration with training.
  • Bring up new models and training setups, and keep large RL runs stable and healthy.
  • Optimize accelerator utilization, memory, communication, and low-precision numerics for compute and training efficiency.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Strong theoretical and empirical grounding
  • Strong research judgment, including clean ablations, honest baselines, and clear technical writing
  • Strong grounding in reinforcement learning for large language models, including modern policy optimization methods and their behavior at scale (preferred)
  • Deep understanding of asynchronous RL algorithms, design choices, and trade-offs on both ML and systems sides (preferred)
  • Experience training large models across many accelerators and working with distributed parallelism strategies, memory, and communication (preferred)
  • Working knowledge of inference systems and quantitative reasoning about rollout generation throughput and cost (preferred)
  • Experience building or operating decoupled generation/training RL systems at scale (preferred)
  • Experience with RL on verifiable and agentic tasks, including multi-turn environments (preferred)
  • Experience with RL training stability techniques for large runs (preferred)
  • Hands-on work with LLM serving stacks such as SGLang, vLLM, TokenSpeed, or custom engines (preferred)
  • Experience with scaling studies for large models (preferred)
  • Contributions to open-source training or inference frameworks (preferred)

Education

  • Bachelor’s degree or equivalent experience in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline
  • PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline, or equivalent industry research experience (preferred)

Skills

  • Proficiency in Python
  • Familiarity with at least one deep learning framework (PyTorch, TensorFlow, or JAX)
  • Ability to debug distributed training and write code that scales
  • Familiarity with low-precision training and inference, numerics, and quantization (preferred)

Other requirements

  • Ability to explain complex technical concepts in writing

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Generous health benefits
Dental & vision
Generous dental and vision benefits
Paid time off
Unlimited PTO
Parental leave
Paid parental leave
Relocation help
Relocation support as needed

Full job description

From Thinking Machines Lab’s careers site

ABOUT THINKING MACHINES

The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.

ABOUT THE ROLE

Show full descriptionShow less

Our team scales reinforcement learning for frontier models. Progress in RL is increasingly set by how well it scales: more rollouts, larger models, and training loops that keep large fleets of accelerators doing useful work. We are particularly interested in people working on high-training-compute, long-horizon RL. We believe the biggest gains come from designing the training recipe and the infrastructure together rather than separately, and we are hiring a researcher who wants to own that boundary.

A center of gravity for this role is asynchronous RL. Decoupling generation from training changes both the systems design and the learning problem, and doing it well requires a deep understanding of async RL algorithms, design choices, and trade-offs on both the ML and the systems sides. We expect much of the headroom in RL scaling to come from here.

Because generation dominates the cost of RL at scale, good knowledge of inference systems, low-precision numerics, and quantization is recommended: you should be able to reason quantitatively about rollout throughput and cost (batching, KV cache, MoE serving, speculative decoding) and about how inference constraints shape training design.

This is a research role with full-stack ownership, from the algorithms to the parallelism plan to the health of the run.

WHAT YOU’LL DO

  • Co-design the RL recipe and the systems that run it: make recipe-level choices jointly with systems-level ones and validate them at frontier scale.
  • Advance asynchronous RL algorithms.
  • Improve the efficiency of rollout generation and its integration with training, treating inference as a first-class part of the RL loop.
  • Run frontier-scale RL end to end: bring up new models and training setups, keep large runs stable and healthy.
  • Jointly optimize the compute and training efficiency of RL: accelerator utilization, memory, communication, and low-precision numerics.
  • Do careful empirical science: ablations and scaling studies backed by instrumentation you can trust, written up clearly.

SKILLS AND QUALIFICATIONS

Minimum qualifications:

  • Proficiency in Python and familiarity with at least one deep learning framework (e.g., PyTorch, TensorFlow, or JAX). Comfortable with debugging distributed training and writing code that scales.
  • Bachelor’s degree or equivalent experience in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline with strong theoretical and empirical grounding.
  • Clarity in communication, an ability to explain complex technical concepts in writing.
  • Strong research judgment: clean ablations, honest baselines, and clear technical writing.

Preferred qualifications — we encourage you to apply if you meet some but not all of these:

  • PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline with strong theoretical and empirical grounding; or, equivalent industry research experience.
  • Strong grounding in RL for large language models, such as modern policy optimization methods and their behavior at scale.
  • Deep understanding of asynchronous RL: the algorithms, design choices, and trade-offs, on both the ML and the systems sides.
  • Experience training large models across many accelerators, with comfort inside the distributed stack (parallelism strategies, memory, communication).
  • Good working knowledge of inference systems: able to reason quantitatively about rollout generation throughput and cost.
  • Experience building or operating decoupled generation/training RL systems at scale.
  • Experience with RL on verifiable and agentic tasks, including multi-turn environments.
  • Experience with RL training stability techniques for large runs.
  • Familiarity with low-precision training and inference: numerics, quantization, and their implications for RL.
  • Hands-on work with LLM serving stacks (e.g., SGLang, vLLM, TokenSpeed, or custom engines).
  • Experience with scaling studies for large models.
  • Contributions to open-source training or inference frameworks.

LOGISTICS

  • Location: This role is based in San Francisco, California.
  • Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $350,000 - $475,000 USD.
  • Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
  • Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.

As set forth in Thinking Machines' Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

AI Research Engineer III

Agility Robotics · Fremont, CA +2 places

$166k–$260k/yrFull-timeHybrid

StrongChecked open todayPosted 11 days ago

See more like this