Machine Learning Engineer jobs

Senior Software Engineer, Model Evaluation

Clera (agency)San Francisco, CAFull-timeOn-site3+ years experiencePosted 3 days ago

$180k–$250k/yr listed by the employer

Below the typical $235k a year for senior Machine Learning Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 158 senior Machine Learning Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

This job is closed.

The employer took it down 2 days ago, after 1 day open. Here are similar open jobs.

  • Checked: On the company's own careers siteAshby board
  • Checked: Pay listedJob posting
See all 2 checksShow fewer
How we check

Similar open jobs

See more like this

What you’ll do

  • Design and build evaluation suites for procurement and supply-chain workflows.
  • Work with domain experts to scope tasks, write reference answers and rubrics, and build graders.
  • Train and fine-tune models, using evaluation results to guide experiments.
  • Identify agent failures, improve production systems, and measure the impact of changes.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • At least 3 years of experience, operating at a senior or staff level
  • Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks
  • Practical experience training and fine-tuning models, not only using models through APIs
  • Supply-chain, procurement, manufacturing, or early-stage startup experience (preferred)

Skills

  • Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks

Benefits

Equity

Full job description

From Clera’s careers site

ABOUT THE ROLE

Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably.

WHAT YOU'LL DO

  • Design and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.
  • Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders.
  • Train and fine-tune models, using evaluation results to guide experiments.
  • Identify agent failures, improve production systems, and measure whether changes work.
Show full descriptionShow less
  • Help establish the team's research and evaluation practices.

WHAT WE'RE LOOKING FOR

  • At least 3 years of experience, operating at a senior or staff level.
  • Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks.
  • Practical experience training and fine-tuning models, not only using models through APIs.
  • Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
  • Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful.

COMPENSATION & BENEFITS

Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship details were not provided.

LOCATION

Hybrid in San Francisco, California, United States.

Something wrong with this job? Report it · This flag looks wrong