Machine Learning Engineer jobs

Founding Engineer, Environments + Data

Clera (agency)San Francisco, CAFull-timeOn-siteSponsors US visasPosted 16 days ago

$200k–$300k/yr listed by the employer

About the typical $242k a year for Machine Learning Engineer jobs in California (all levels)How we compare

How we compare. Typical is the median yearly pay of 670 Machine Learning Engineer jobs in California (all levels) that list pay, from the employers' own postings. About means within 5%.

This job is closed.

The employer took it down 10 days ago, after 5 days open. Here are similar open jobs.

  • Checked: On the company's own careers siteAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 4 checksShow fewer
How we check

Similar open jobs

Machine Learning Engineer

Voyager Technologies, Inc. · El Segundo, CA

$120k–$280k/yr · see postingOn-site

Wide pay rangeChecked open todayPosted 8 days ago

AI Research Engineer III

Agility Robotics · Fremont, CA +2 places

$166k–$260k/yrFull-timeHybrid

StrongChecked open todayPosted 11 days ago

See more like this

What you’ll do

  • Design synthetic company environments with realistic email, records, and files for agents to use over extended periods.
  • Build graders and evaluation systems for advanced AI agents, including cases where human reviewers may lack relevant expertise.
  • Develop benchmarks that correlate with real-world production performance.
  • Identify and address evaluation failure modes, including reward hacking and benchmark gaming.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Hands-on research experience in synthetic data pipelines, benchmarks, evaluations, or model post-training
  • Experience building environments or benchmarks used to train or evaluate agents at a frontier AI lab
  • Experience implementing graders or evaluation systems for AI agents
  • At least 1 to 2 years at a fast-growing or AI-focused startup, plus mid-level or senior engineering or research experience
  • Experience simulating software systems for agent tool use, identifying benchmark flaws, and detecting and fixing reward hacking in evaluation systems
  • High-level competition experience in mathematics, programming, debate, or games (preferred)

Education

  • A degree from a highly selective university or an equivalent credential, such as founding a company or participating in a recognized founder program

Other requirements

  • On-site five days per week in San Francisco, California

Benefits

Equity
Meaningful founding equity
Bonus
Commission-style bonus of up to $200,000 or more, tied to the value of delivered environments
Other
Visa sponsorship available

Full job description

From Clera’s careers site

ABOUT THE ROLE

Build evaluation environments and benchmarks that measure whether AI agents can perform real-world company work and meet or exceed human performance. This founding engineering role combines agent evaluation research with production readiness, helping establish reliable evidence of agent capability.

WHAT YOU'LL DO

  • Design synthetic company environments with realistic email, records, and files for agents to use over extended periods.
  • Build graders and evaluation systems capable of assessing advanced agents, including cases where human reviewers may lack the relevant expertise.
  • Develop benchmarks that correlate with real-world production performance.
Show full descriptionShow less
  • Find and address evaluation failure modes, including reward hacking and benchmark gaming.
  • Simulate software tools such as inboxes and CRMs with enough fidelity to support agent interactions at scale.

WHAT WE'RE LOOKING FOR

  • Hands-on research experience in synthetic data pipelines, benchmarks, evaluations, or model post-training; this is a research-oriented role, not a pure infrastructure engineering position.
  • Experience building environments or benchmarks used to train or evaluate agents at a frontier AI lab, and implementing graders or evaluation systems for AI agents.
  • At least 1 to 2 years at a fast-growing or AI-focused startup, plus mid-level or senior engineering or research experience.
  • Experience simulating software systems for agent tool use, identifying benchmark flaws, and detecting and fixing reward hacking in evaluation systems.
  • A degree from a highly selective university or an equivalent credential, such as founding a company or participating in a recognized founder program.
  • High-level competition experience in mathematics, programming, debate, or games is a plus.

COMPENSATION & BENEFITS

Base salary is $200,000 to $300,000 annually, with up to $350,000 for exceptional candidates. Additional commission-style bonus of up to $200,000 or more is tied to the value of delivered environments. Meaningful founding equity is included. Visa sponsorship is available.

LOCATION

On-site five days per week in San Francisco, California, United States.

Something wrong with this job? Report it · This flag looks wrong