Data & AI jobs

Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)

Clera (agency)Remote · location not statedFull-timePosted 6 days ago

$104k–$250k/yr listed by the employer

Key facts

Experience
5+ years
Degree
Master's degree

This job is closed.

The employer took it down 4 days ago, after 1 day open. Here are similar open jobs.

  • To check: Mentions a talent pool or pipelineWhy: “Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)”Some postings collect applications for later. Ask if there is an opening now.
  • To check: Wide pay range: top of the range is 2.4× the bottomAsk what the job pays at your level before you interview.
  • Checked: On the company's own careers siteAshby board
  • Checked: Pay listedJob posting
  • Trust score 80 / 100 · Looks good
See all 5 checksShow fewer
How we check

Similar open jobs

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted today

Senior Data Scientist

Figure Lending · Remote · location not stated

$132k–$198k/yr

StrongChecked open todayPosted 8 days ago

Senior DataOps Engineer

Voyager Technologies, Inc. · Remote · US only

$140k–$180k/yr

StrongChecked open todayPosted 8 days ago

See more like this

Summary, requirements and match are for US jobs for now.

Full job description

From Clera’s careers site

ABOUT THE ROLE

Join a remote expert network as a senior rater and reviewer, evaluating challenging AI model outputs and helping calibrate other graders. Your work supports the development of reliable, high-quality AI systems.

WHAT YOU'LL DO

  • Rank and rate expert-level model answers in your domain using detailed rubrics and written rationales.
  • Evaluate model reasoning step by step in specialized fields such as mathematics, code, law, medicine, or finance.
  • Fact-check detailed claims against primary sources and verify accuracy.
  • Assess answers against content policies, style guides, and edge cases.
  • Review other raters' work, calibrate standards, and develop or refine grading guidelines.
Show full descriptionShow less
  • Assess search relevance and share feedback in live sessions.

WHAT WE'RE LOOKING FOR

  • At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or deep expertise in a relevant field.
  • Native or near-native written English proficiency.
  • Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
  • Experience leading, reviewing, or mentoring other raters or reviewers.
  • An advanced degree, professional license, or deep working expertise in the domain you evaluate.
  • Hands-on experience with AI data annotation, preference ranking, rubric grading, process labeling, or search-quality rating is a plus.

COMPENSATION & BENEFITS

Compensation is $50 to $120 per hour, depending on project, field, and expertise. Payment is for hours worked.

LOCATION

Fully remote. Projects typically last from one week to several months.

Something wrong with this job? Report it · This flag looks wrong