Clera (agency)SingaporeFull-timeOn-site2+ years experiencePosted 16 days ago
$100k–$170k/yr listed by the employer
This job is closed.
The employer took it down 11 days ago, after 5 days open. Here are similar open jobs.
Checked: On the company's own careers siteAshby board
Checked: Pay listedJob posting
Checked: No reposts foundAshby board
Trust score 89 / 100 · Looks good
This job is outside the US, so these US-only checks are not applied: pay-transparency law, pay likely required by state law, US visa sponsorship wording.
Summary, requirements and match are for US jobs for now.
Full job description
From Clera’s careers site
ABOUT THE ROLE
Join a small engineering team at an AI and reinforcement learning infrastructure company. You will build quality control systems for training data and help ensure that agent evaluations produce reliable, useful results.
WHAT YOU'LL DO
Automate quality control for training data generated in reinforcement learning environments.
Set and enforce data quality standards using human judgment and clear evidence rather than relying heavily on large language models.
Design experiments and metrics to evaluate agent outputs.
Work with data vendors to investigate quality issues, diagnose agent failure modes, and improve data generation processes.
Show full descriptionShow less
Turn quality findings into auditing systems, including sampling strategies and rule-based or model-assisted validation pipelines.
Improve infrastructure tools and vendor portals to reduce anomalies, inconsistencies, and edge cases.
WHAT WE'RE LOOKING FOR
Two to four years of experience as a research engineer or in a similar engineering or research role focused on quality control automation.
Technical education or equivalent technical experience, with proficiency in Python, Docker, and Linux.
Experience building scalable data validation pipelines and end-to-end automated QA/QC systems with autonomy in unstructured problem spaces.
Background in benchmarks and evaluations for reinforcement learning training data, including defining realistic tasks, reliable rubrics, and useful trajectories.
Experience defining and measuring training data quality, and designing evaluation metrics, experiments, and QA/QC processes.
Knowledge of statistics, strong communication skills, curiosity across domains, and the ability to collaborate independently across time zones.
COMPENSATION & BENEFITS
Base salary: $100,000 to $170,000 USD annually. Visa sponsorship is available.