Data & AI jobs

Subject Matter Experts: Machine Learning Model Evaluation

TeracRemote · US onlyContractPosted 10 days ago

$75/hr listed by the employer

Key facts

Pay per year
≈ $156kEstimate for full-time hours.

This job is closed.

The employer took it down 4 days ago, after 5 days open. Here are similar open jobs.

  • Checked: On the company's own careers siteAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 4 checksShow fewer
How we check

Similar jobs

TEMPLATE

Terac · Remote · US only +1 place

Pay not listedContract

Looks good2 to checkChecked open todayPosted 3 months ago

See more like this

What you’ll do

  • Review machine learning model outputs across research tasks.
  • Rate AI-generated responses for accuracy, relevance, factual correctness, and overall quality.
  • Provide brief written justifications for evaluation scores.
  • Complete approximately five hours of asynchronous evaluation work.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Professional or academic expertise in a specialized domain
  • Experience evaluating technical content or research data (preferred)

Skills

  • Comfortable reading and assessing complex technical or research-focused text

Other requirements

  • Ability to commit approximately five hours to complete the evaluation tasks

Benefits

Other
$75 per hour

Full job description

From Terac’s careers site

WHAT WE'RE RESEARCHING

We are running a paid study to evaluate the quality and accuracy of machine learning model outputs. This work directly informs how AI systems handle complex research tasks and domain-specific prompts. By analyzing these generated responses, we can better understand where current models succeed and where they require further refinement.

HOW IT WORKS

Show full descriptionShow less

Participants will review a series of machine learning model outputs generated in response to specific research prompts. You will evaluate these responses for accuracy, relevance, and overall quality using a structured rating system. The project involves approximately five hours of independent work, which you can complete asynchronously. You will also provide brief written justifications for your ratings to help us understand your evaluation process.

WHO THIS IS FOR

We are looking for subject matter experts across various academic and professional domains with a strong eye for detail. We welcome researchers, data analysts, technical writers, and domain specialists who can critically assess complex information. If you have experience evaluating technical content or research data, you will be a great fit for this project.

WHAT YOU'LL DO

  • Review machine learning model outputs across a variety of research tasks
  • Rate AI-generated responses for accuracy, relevance, and factual correctness
  • Provide clear written justifications for your evaluation scores
  • Complete approximately five hours of asynchronous evaluation work

WHO SHOULD APPLY

  • Professional or academic expertise in a specialized domain
  • Strong critical thinking and analytical skills
  • Comfortable reading and assessing complex technical or research-focused text
  • Ability to commit approximately five hours to complete the evaluation tasks

COMPENSATION

$75 per hour

READY TO PARTICIPATE?

Start your paid interview now https://terac.com/interview/start/r/a39b1a24-e39d-4bdf-a43e-c6ba5076d62a?utm_source=ashby_listing_description

ABOUT TERAC

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

Learn more at terac.com https://terac.com or on YouTube at @jointerac https://www.youtube.com/@jointerac.

Something wrong with this job? Report it · This flag looks wrong