Machine Learning Engineer jobs

Research Engineer, Benchmarks

Clera (agency)SingaporeFull-timeOn-site2+ years experiencePosted 3 days ago

$100k–$170k/yr listed by the employer

Looks real and checked open today.

On Clera’s own careers site (Ashby).

Trust score ready Nov 25

  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Note: Too new for a trust scoreScored after a week of daily checks, from Nov 25

This job is outside the US, so these US-only checks are not applied: pay-transparency law, pay likely required by state law, US visa sponsorship wording.

See all 4 checksShow fewer
How we check

Summary, requirements and match are for US jobs for now.

Full job description

From Clera’s careers site

ABOUT THE ROLE

Join a small, technical team building benchmarks to evaluate frontier AI agents on realistic, domain-specific workflows. You will own evaluation design and implementation, helping ensure benchmark results are rigorous, credible, and relevant to real-world performance.

WHAT YOU'LL DO

  • Design, implement, and maintain benchmarks for evaluating frontier agents on domain-specific tasks.
  • Work with subject-matter experts to translate real workflows into realistic tasks and evaluation criteria.
  • Build reliable infrastructure for running models and agents against benchmark tasks at scale.
  • Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.
Show full descriptionShow less
  • Validate whether benchmark results correlate with real-world evaluations and user needs.
  • Write clear documentation and reports for technical audiences.

WHAT WE'RE LOOKING FOR

  • Two or more years of experience in research engineering or machine learning engineering, building AI benchmarks, evaluation infrastructure, or agent environments.
  • Technical education or equivalent grounding, with strong first-principles reasoning about task design, scoring, and failure modes.
  • Proficiency in Python, Docker, and Linux, including experience operating infrastructure for AI models or agents.
  • Hands-on experience designing and running evaluations for AI agents or large language models, with relevant, focused experience in benchmarks or evaluation.
  • Experience developing metrics, statistical analyses, or validation studies, and translating workflows across domains into benchmark tasks.
  • Strong technical writing and communication skills. Published papers or technical writing on benchmarking, evaluation, or model failure modes are valued.
  • Experience with reinforcement learning pipelines, data generation, or agent evaluation is a plus.
  • Comfort working independently in an early-stage, fast-paced environment and navigating open-ended problems.

COMPENSATION & BENEFITS

Base salary: $100,000 to $170,000 annually. Visa sponsorship is available.

LOCATION

On-site in Singapore, Singapore.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

AI Research Engineer III

Agility Robotics · Fremont, CA +2 places

$166k–$260k/yrFull-timeHybrid

StrongChecked open todayPosted 11 days ago

Machine Learning Engineer

Voyager Technologies, Inc. · El Segundo, CA

$120k–$280k/yr · see postingOn-site

Wide pay rangeChecked open todayPosted 8 days ago

See more like this