New York jobs

RL Environment Engineer

ReplayNew York, NYFull-time3+ years experiencePosted 1 month ago

$200k–$350k/yr listed by the employer

Strong: looks real and checked open today.

On Replay’s own careers site (Ashby).

  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Design and build production-grade RL environments based on enterprise workflows, from task specification through versioned release.
  • Create reward functions and programmatic verifiers, and harden them against reward hacking and shortcuts.
  • Build evaluation environments with seeded failure modes and model and agent harnesses with bounded behavior and explicit output verification.
  • Work with frontier lab researchers to identify capability gaps and create task suites to train against them.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3–5+ years of ML or software engineering experience shipping production systems
  • Personally built production-grade RL environments used in real training or evaluation
  • Startup experience
  • Background at or working with a frontier AI lab, or research-adjacent engineering experience (preferred)
  • Experience in forward-deployed or customer-facing engineering roles (preferred)
  • Experience with sensitive enterprise data or other high-trust production systems (preferred)
  • Previously a founder or early employee at a startup (preferred)

Skills

  • Ability to turn ambiguous researcher goals into well-scoped, working systems

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
100% covered medical insurance
Dental & vision
100% covered dental and vision insurance
Paid time off
Unlimited PTO
Equity
Meaningful equity
Remote work stipend
$500 desk allowance
Wellness & mental health
Free gym and workout class memberships via Wellhub
Relocation help
Up to $15,000 relocation bonus where applicable

Full job description

From Replay’s careers site

ABOUT REPLAY

We are building the first-ever bank for enterprise data. There are over 35 million businesses in the US alone, many of which are sitting on an asset they don’t know they have. At Replay, we help businesses monetize their historical operating data by licensing it to the frontier AI and data labs for model training. Replay sits at the intersection of advancing the frontier of AI, while helping companies generate millions in growth capital without having to give up equity, take on debt, or lay off employees.

WHY JOIN REPLAY NOW:

  • We've scaled from $0 to a multi-eight figures run rate in a matter of months
  • We've raised from top-tier investors (Floodgate, Afore, Ludlow, Hustle Fund, etc.)
Show full descriptionShow less
  • We're small enough that you'll carry outsized responsibility and grow as fast as the company does
  • You'll partner and build for the fastest and most important companies in the world
  • You'll be a part of building a massive, category-defining business from the ground floor

THE ROLE

Replay is hiring RL Environment Engineers who are looking to take real-world, enterprise data and convert it into model progression. You’ll recreate the entire world of businesses across industries — crafting the highest quality environments and evals while working directly with researchers to understand the capabilities they’re looking to hillclimb.

WHAT YOU'LL DO

  • Design and build production-grade RL environments grounded in real enterprise workflows, from task spec through to a stable, versioned release
  • Write reward functions and programmatic verifiers that score outcomes reliably, and harden them against reward hacking and shortcut solutions
  • Build high-fidelity evaluation environments with seeded failure modes that expose subtle regressions, and reliable model and agent harnesses with bounded behaviour and explicit output verification
  • Work directly with frontier lab researchers to understand the capability gaps they want to close, and design task suites that expose and train against them
  • Measure task difficulty and solvability by running frontier models against environments, then tune them until they give a usable training signal
  • Ship quickly, and help set the standards and patterns for how Replay builds tasks and environments

REQUIRED APTITUDE

  • 3-5+ years of ML / software engineering experience shipping production systems
  • Personally built production-grade RL environments that were used in real training or evaluation, not only prototypes or research demos
  • Ability to turn ambiguous goals from researchers into well-scoped, working systems
  • A high-ownership, action-oriented mindset: you take problems from idea to shipped.
  • Startup experience, a taste for broad ownership and the ability to do well when requirements are evolving
  • Clear written and verbal communication with researchers, engineers, and non-technical partners

BONUS

  • Background at or working with a frontier AI lab, or in research-adjacent engineering
  • Experience in forward-deployed or customer-facing engineering roles
  • Experience with sensitive enterprise data or other high-trust production systems
  • Previously a founder or early employee at a startup

COMPENSATION & BENEFITS

  • $200K-350K base salary
  • Meaningful equity
  • 100% covered medical, dental, and vision
  • Unlimited PTO
  • Free gym + workout class memberships (via Wellhub)
  • $500 desk allowance
  • Up to $15,000 relocation bonus where applicable

HOW WE HIRE

1. Intro Chat (20 min): mutual fit and interests

2. Technical Screen (45 min): technical discussion & systems design challenge

3. Take-home project (4 hours): work through a technical take-home asynchronously with our team

4. Onsite (~3 hrs): meet the team, have snacks

5. References -> Offer

Something wrong with this job? Report it

Similar jobs

GTM Engineer

Replay · New York, NY

$175k–$235k/yrFull-timeOn-site

StrongOpen 4 monthsChecked open todayPosted 4 months ago

Machine Learning Engineer

Replay · New York, NY

Pay not listedFull-time

Looks good2 to checkChecked open todayPosted 3 months ago

Data Scientist

Replay · New York, NY

Pay not listedFull-time

Looks good2 to checkChecked open todayPosted 3 months ago

Strategic Project Lead

Replay · New York, NY

$175k–$220k/yrFull-timeOn-site

StrongChecked open todayPosted 1 month ago

See more like this