Machine Learning Engineer jobs

Research Engineer, Benchmarks

Clera (agency)SingaporeFull-timeOn-site2+ years experiencePosted 16 days ago

$100k–$170k/yr listed by the employer

This job is closed.

The employer took it down 11 days ago, after 5 days open. Here are similar open jobs.

  • Checked: On the company's own careers siteAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good

This job is outside the US, so these US-only checks are not applied: pay-transparency law, pay likely required by state law, US visa sponsorship wording.

See all 4 checksShow fewer
How we check

Similar open jobs

AI Research Engineer III

Agility Robotics · Fremont, CA +2 places

$166k–$260k/yrFull-timeHybrid

StrongChecked open todayPosted 10 days ago

Machine Learning Engineer

Voyager Technologies, Inc. · El Segundo, CA

$120k–$280k/yr · see postingOn-site

Wide pay rangeChecked open todayPosted 8 days ago

See more like this

Summary, requirements and match are for US jobs for now.

Full job description

From Clera’s careers site

ABOUT THE ROLE

Join a small, technical team at an early-stage AI evaluation company building benchmarks for frontier AI agents. You will own the design and implementation of rigorous, domain-specific evaluations that help research teams and customers understand real-world agent performance.

WHAT YOU'LL DO

  • Design, implement, and maintain benchmarks for evaluating AI agents on domain-specific tasks.
  • Work with subject-matter experts to translate real workflows into realistic tasks and evaluation criteria.
  • Build reliable infrastructure for running models and agents against benchmark tasks at scale.
  • Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.
Show full descriptionShow less
  • Validate how benchmark results relate to real-world evaluations and user needs.
  • Write clear technical documentation and reports communicating benchmark methods and results.

WHAT WE'RE LOOKING FOR

  • Two to four years of experience in research engineering, machine learning engineering, or a related technical role, including at least two years building or delivering AI benchmarks, evaluation infrastructure, or agent environments.
  • Strong proficiency in Python, Docker, and Linux for research or production infrastructure.
  • Hands-on experience designing, implementing, and operating evaluations for AI agents or large language models.
  • Experience building infrastructure to run models or agents reliably, and developing metrics, statistical analyses, or validation studies.
  • Ability to collaborate with subject-matter experts and analyze workflows across different domains to create useful evaluation tasks.
  • Strong technical writing, attention to detail, first-principles reasoning, and comfort working independently in a fast-paced startup.
  • Published research or technical writing on benchmarking, model evaluation, or failure modes is valued. Reinforcement learning pipelines, data generation, and agent evaluation experience are also relevant.

COMPENSATION & BENEFITS

Base salary: $100,000 to $170,000 USD annually. Visa sponsorship is available.

LOCATION

On-site in Singapore, Singapore.

Something wrong with this job? Report it · This flag looks wrong