RL Environment Software Engineer
talentpluto · San Francisco, CA
$180k–$220k/yrFull-time

AfterQuerySan Francisco, CAFull-timeOn-site
$260k–$290k/yr listed by the employer
How we compare. Typical is the median yearly pay of 3,393 Software Engineer jobs in California (all levels) that list pay, from the employers' own postings. About means within 5%.
On AfterQuery’s own careers site (Ashby), checked open today.
Summarised from the posting by AI and can be wrong. The full description is the source.
Sign in and add your resume to see which of this job's requirements it shows.
Sign in to check your matchSaved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
From AfterQuery’s careers site
ABOUT AFTERQUERY
AfterQuery https://www.afterquery.com/ is an applied research lab curating data solutions for foundation model development. We serve every frontier AI lab with the mission of delivering the best data to power the best models. In doing so, we can make expertise that once took a lifetime to build available to anyone who needs it.
Our customers are the ones building the foundation models themselves and our work sits directly in the loop of how those systems improve. This is a rare opportunity to join a company at a defining moment in AI. Forbes reported that we could be YC's fastest unicorn, reportedly raising at a $3.2 billion valuation. We're based in San Francisco and backed by leading investors including Altos Ventures, BoxGroup, and Y Combinator and angels from Google DeepMind, OpenAI, Anthropic, Meta Superintelligence Labs, and Microsoft AI.
WHY APPLY
Massive Opportunity: Forbes reported that we could be YC's fastest unicorn, reportedly raising at a $3.2 billion valuation, and we're not slowing down.
Founding Impact: You will own and architect core infrastructure systems that power our platform from the ground up.
Equity & Growth: Competitive salary and meaningful equity, giving you a real stake in the company's success. Join at an early stage, grow alongside the business, and participate directly in the upside you help create. As we scale, so will your opportunities, responsibilities, and impact.
Strong Team: Work alongside world-class engineers, researchers, and operators.
OVERVIEW
As a SWE (Environments), you will design the simulations, data, and evaluations that directly influence how frontier models learn. You'll work hands-on with research teams at top AI labs, experimenting with environment design, piloting novel data creation strategies, diagnosing model failure modes, and developing the metrics that determine whether a model is actually improving. You'll go from hypothesis to live experiment quickly, and your output will feed directly into model training runs at scale. Day to day, you will design environments, tasks, and data that expose meaningful failure modes across domains like finance, code, and enterprise workflows. You will build and refine reward signals for various RL pipelines. You will develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on alignment and capability. You will partner with lab research teams to translate their training objectives into concrete data and evaluation specifications.
RESPONSIBILITIES
Partner with lab research teams to translate their training objectives into concrete data and evaluation specifications
REQUIRED QUALIFICATIONS
PREFERRED QUALIFICATIONS
COMPANY BENEFITS (FOR ELIGIBLE EMPLOYEES):
We are an equal opportunity employer committed to providing a workplace free from discrimination and harassment. Employment decisions are made without regard to legally protected characteristics under applicable federal, state, or local law.
We comply with applicable pay transparency requirements and provide compensation ranges based on the position, qualifications, experience, and other relevant factors. Reasonable accommodations are available to qualified individuals with disabilities and for sincerely held religious beliefs, as required by law. This job description is intended to describe the general nature and level of work performed and is not an exhaustive list of all duties, responsibilities, qualifications, or working conditions associated with the position. We reserve the right to modify this job description as business needs change.
Something wrong with this job? Report it · This flag looks wrong

talentpluto · San Francisco, CA
$180k–$220k/yrFull-time
StrongChecked open todayPosted today

Simple AI · San Francisco, CA
$130k–$280k/yr · see postingFull-timeOn-site
Wide pay rangeChecked open todayPosted 9 days ago

Ambrook · New York, NY +2 places
$115k–$260k/yr · see postingFull-timeHybrid
Wide pay rangeChecked open todayPosted 4 days ago
Integrated Biosciences, Inc. · Redwood City, CA
$140k–$230k/yrOn-site
StrongChecked open todayPosted 7 days ago
Twitch · San Francisco, CA
$127k–$185k/yr
StrongChecked open todayPosted 7 days ago

Motive · San Francisco, CA
$180k–$225k/yrHybrid
StrongChecked open todayPosted 4 days ago