Machine Learning Engineer jobs

Founding Engineer, Environments and Data

Clera (agency)San Francisco, CAFull-timeOn-sitePosted 3 days ago

$200k–$300k/yr listed by the employer

Above the typical $197k a year for mid-level Machine Learning Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 58 mid-level Machine Learning Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Key facts

Experience
1+ years
US visa
Sponsors US visas

Looks real and checked open today.

On Clera’s own careers site (Ashby).

Trust score ready Nov 25

  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Note: Too new for a trust scoreScored after a week of daily checks, from Nov 25
See all 4 checksShow fewer
How we check

What you’ll do

  • Design synthetic company environments with realistic emails, records, and files for agents to use across extended tasks.
  • Build graders and evaluation systems to assess advanced AI agents.
  • Develop benchmarks that correlate with real-world production performance.
  • Identify and address evaluation failure modes, including reward hacking and benchmark gaming.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Mid-level or senior engineering or research experience, including at least 1 to 2 years at a fast-growing or AI-focused startup
  • Hands-on AI research or engineering experience with synthetic data pipelines, benchmarks, evaluations, or post-training
  • Experience building environments or benchmarks used to train or evaluate agents, and designing and implementing agent graders or evaluation systems
  • Experience simulating complex software systems for agent tool use, identifying flaws in established benchmarks, and detecting and fixing reward hacking
  • Background in AI evaluation, benchmark design, simulation, agent systems, or related areas
  • Startup founding or accelerator experience (preferred)
  • High-level competition experience in mathematics, programming, debate, or games (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Equity
Meaningful founding equity
Bonus
Commission-style bonus compensation of up to $200,000 or more, tied to the value of delivered environments
Other
Visa sponsorship available

Full job description

From Clera’s careers site

ABOUT THE ROLE

Build evaluation environments and benchmarks that measure whether AI agents can perform real-world company work and match or exceed human performance. This founding engineering role focuses on agent capability assessment and production readiness, with work that shapes how agent competence is measured.

WHAT YOU'LL DO

  • Design synthetic company environments with realistic email, records, and files for agents to use over extended tasks.
  • Build graders and evaluation systems that can reliably assess advanced AI agents.
  • Develop benchmarks that correlate with real-world production performance.
  • Find and address evaluation failure modes, including reward hacking and benchmark gaming.
Show full descriptionShow less
  • Simulate software tools such as inboxes and CRMs with enough fidelity to support agent interactions at scale.

WHAT WE'RE LOOKING FOR

  • Mid-level or senior engineering or research experience, including at least 1 to 2 years at a fast-growing or AI-focused startup.
  • Hands-on AI research or engineering experience with synthetic data pipelines, benchmarks, evaluations, or post-training. This is a research-oriented role, not solely infrastructure engineering.
  • Experience building environments or benchmarks used to train or evaluate agents, and designing and implementing agent graders or evaluation systems.
  • Experience simulating complex software systems for agent tool use, identifying flaws in established benchmarks, and detecting and fixing reward hacking.
  • Background in AI evaluation, benchmark design, simulation, agent systems, or related areas. Startup founding or accelerator experience and high-level competition experience in mathematics, programming, debate, or games are valued.
  • Collaborative, adaptable, and effective in a fast-moving environment.

COMPENSATION & BENEFITS

Base salary is $200,000 to $300,000 annually, with up to $350,000 for exceptional candidates. Additional commission-style bonus compensation of up to $200,000 or more is tied to the value of delivered environments. Meaningful founding equity is included. Visa sponsorship is available.

LOCATION

On-site five days a week in San Francisco, California, United States.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

AI Research Engineer III

Agility Robotics · Fremont, CA +2 places

$166k–$260k/yrFull-timeHybrid

StrongChecked open todayPosted 11 days ago

Machine Learning Engineer

Gotion, Inc. · Fremont, CA

$110k–$135k/yrFull-timeHybrid

StrongChecked open todayPosted 18 days ago

Machine Learning Engineer

Sift · San Francisco, CA +1 place

$170k–$240k/yrFull-timeHybrid

StrongChecked open todayPosted 24 days ago

See more like this