Staff Software Engineer, Platform
Peregrine Technologies · San Francisco, CA +2 places
$240k–$300k/yrOn-site
Preference ModelSan Francisco, CAFull-timeOn-sitePosted 11 days ago
$180k–$350k/yr listed by the employer
On Preference Model’s own careers site (Ashby).
Summarised from the posting by AI and can be wrong. The full description is the source.
Sign in and add your resume to see which of this job's requirements it shows.
Sign in to check your matchSaved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
From Preference Model’s careers site
ABOUT US
Preference Model is a superintelligence data research company. We build RL environments for training capable, better-aligned superintelligences.
Almost every aspect of how a model behaves is shaped by the reward signals it's trained on. The biggest problem with AIs today is that they don't always do what we intend. Sometimes that's because they aren't capable enough, and sometimes it's because they aren't aligned. Both problems come down to the training objectives.
We're trying to address both of these issues in the most direct, highest leverage way available to us, which today means researching how to build RL environments better, not just for the AIs of today but for the AIs as they will be when they outsmart us.
Over the past year, we've built RL environments for several frontier labs, and we're backed by $16M in seed funding led by a16z. Our founding team has previous experience on Anthropic’s data team building data infrastructure, and datasets behind Claude.
ABOUT THE ROLE
An RL environment is only useful once it runs reliably inside a lab's training stack. Every environment we build has to be packaged, sandboxed, run at scale, checked against each lab's requirements, and delivered in the format that lab's platform expects. Much of that work is still manual today, and it takes time away from the people designing environments.
As an MTS on our ML Platform team, you will own the systems that take an environment from a builder's repo to a lab's training run. That includes Karotte, our open-source framework for defining RL environments, the internal platform that builds, runs, and reviews environments on CPU, GPU, and TPU, and the integrations that deliver them to each lab we work with. This is a senior ML platform engineering role where you will ensure what our Capabilities team builds runs and ships cleanly.
You'll join a small Platform team and work directly with environment builders and post-training researchers. In your first six months, success looks like a delivery path to each partner lab that is mostly automated: tasks marked ready get built, validated against that lab's requirements, and packaged without hand work. Our needs change quickly, so you'll also pick up other platform and infrastructure work as priorities shift.
WHAT YOU WILL DO
WHAT WE ARE LOOKING FOR
NICE TO HAVE
YOU MAY BE A GOOD FIT IF ONE OF THE FOLLOWING APPLIES
WHAT WE OFFER:
We value diverse perspectives and experiences. If you're excited about this role but don't check every box, we still encourage you to apply.
Something wrong with this job? Report it · This flag looks wrong
Peregrine Technologies · San Francisco, CA +2 places
$240k–$300k/yrOn-site
StrongChecked open todayPosted 2 days ago

Zscaler · Santa Clara, CA +1 place
$152k–$190k/yrFull-timeHybrid
StrongChecked open todayPosted 2 days ago

Arta Finance · Bay Area, CA
$110k–$205k/yrFull-timeHybrid
StrongChecked open todayPosted 2 days ago

Verkada · San Mateo, CA
$185k–$265k/yrFull-time
StrongChecked open todayPosted 2 days ago
ID.me · Mountain View, CA
$194k–$253k/yrFull-timeOn-site
StrongChecked open todayPosted 3 days ago

talentpluto · San Francisco, CA
$165k–$250k/yrFull-timeOn-site
StrongChecked open todayPosted yesterday