Machine Learning Engineer jobs

Lead Research Engineer, Data Quality

Clera (agency)United StatesFull-timeOn-sitePosted 15 days ago

$130k–$225k/yr listed by the employer

Key facts

Experience
5+ years
US visa
Sponsors US visas

This job is closed.

The employer took it down 9 days ago, after 6 days open. Here are similar open jobs.

  • Checked: On the company's own careers siteAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 4 checksShow fewer
How we check

Similar open jobs

AI Research Engineer III

Agility Robotics · Fremont, CA +2 places

$166k–$260k/yrFull-timeHybrid

StrongChecked open todayPosted 11 days ago

Machine Learning Engineer

Voyager Technologies, Inc. · El Segundo, CA

$120k–$280k/yr · see postingOn-site

Wide pay rangeChecked open todayPosted 8 days ago

See more like this

What you’ll do

  • Lead development of systems that evaluate tasks across reinforcement learning environments, synthetic data, benchmarks, and domain-specific workflows.
  • Set data quality strategy and standards, and design experiments to assess agent outputs.
  • Develop scalable methods for synthetic data validation, including failure analysis, task mutation checks, and trajectory audits.
  • Work with research engineers, domain experts, and data vendors to diagnose quality issues and improve data generation.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • At least 5 years of research or engineering experience focused on AI/ML data evaluation or data quality systems
  • Experience leading technical projects or teams through ambiguous problem definition, implementation, and iteration
  • Background in AI evaluations, post-training, benchmarks, synthetic data pipelines, or model evaluation infrastructure
  • Experience designing metrics, experiments, and quality processes, and translating research findings into production systems
  • Ability to work with subject-matter experts and convert domain judgment into scalable review or generation workflows
  • Experience in an early-stage startup environment

Skills

  • Advanced proficiency in Python, Docker, and Linux

Other requirements

  • On-site in the United States

Full job description

From Clera’s careers site

ABOUT THE ROLE

Lead the data quality team at an early-stage AI company building infrastructure for reinforcement learning and model evaluation. You will shape how training data is assessed and improved, helping research teams create more reliable and useful AI agents.

WHAT YOU'LL DO

  • Lead development of systems that evaluate tasks across reinforcement learning environments, synthetic data, benchmarks, and domain-specific workflows.
  • Set data quality strategy, establish standards, and design experiments to assess agent outputs.
  • Develop scalable methods for validating synthetic data, including failure analysis, task mutation checks, and trajectory audits.
Show full descriptionShow less
  • Work with research engineers, domain experts, and data vendors to diagnose quality issues and improve data generation.
  • Turn research insights into production tools, dashboards, validation pipelines, and feedback loops.
  • Mentor research engineers and promote technical rigor, clear communication, and strong execution.

WHAT WE'RE LOOKING FOR

  • At least 5 years of research or engineering experience focused on AI/ML data evaluation or data quality systems.
  • Experience leading technical projects or teams through ambiguous problem definition, implementation, and iteration.
  • Advanced proficiency in Python, Docker, and Linux.
  • Background in AI evaluations, post-training, benchmarks, synthetic data pipelines, or model evaluation infrastructure.
  • Strong judgment about what makes agent training data realistic, learnable, diverse, reliable, and useful.
  • Experience designing metrics, experiments, and quality processes, and translating research findings into production systems.
  • Ability to work with subject-matter experts and convert domain judgment into scalable review or generation workflows.
  • Strong written communication, attention to detail, and experience in an early-stage startup environment.

COMPENSATION & BENEFITS

Base salary: $130,000 to $225,000 annually. Visa sponsorship is available.

LOCATION

On-site in the United States. The primary city was not specified.

Something wrong with this job? Report it · This flag looks wrong