Data & AI jobs

LLM Model Response Evaluation

Lifted, an Upwork Company™Remote · US onlyContract

Pay not listed

Key facts

Experience
3+ years
Degree
Bachelor's degree

Looks real. 2 things to check before you apply.

On Lifted, an Upwork Company™’s own careers site (SmartRecruiters), checked open today.

  • To check: Posted by the employer 3 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listed, though one is likely required in MDAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteSmartRecruiters board
  • Checked: Checked open todaySmartRecruiters board
  • Checked: No reposts foundSmartRecruiters board
  • Trust score 80 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Evaluate model-generated content against quality rubrics such as factuality, consistency, and aesthetics.
  • Assess UI widgets, infographics, image factuality, side-by-side comparisons, and related AI evaluation tasks.
  • Evaluate content across text, images, audio, video, HTML widgets, PDFs, and combinations of modalities.
  • Research unfamiliar topics using trusted sources before making evaluation decisions.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3+ years of hands-on experience in LLM / GenAI data evaluation

Education

  • Bachelor's Degree

Skills

  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments
  • Comfortable evaluating content across multiple modalities

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Flexible schedule
Flexible work; variable workload, with tasks accepted or declined based on availability. No guaranteed hours; workload may vary weekly.
Other
Remote work.

Full job description

From Lifted, an Upwork Company™’s careers site

Company Description

Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
Show full descriptionShow less
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities

Additional Information

Flexible and remote work

Variable workload: Accept or decline tasks based on your availability

No guaranteed hours: Workload may vary weekly

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Clinical Pharmacist

Lifted, an Upwork Company™ · Remote · US only

Contract

StrongPay not listedChecked open todayPosted 15 days ago

See more like this