Data & AI jobs

Technical Experts needed to stump AI Models

Lifted, an Upwork Company™Remote · US onlyContractPosted 1 month ago

Pay not listed

Key facts

Experience
10+ years
Degree
Master's degree

Looks real. 1 thing to check before you apply.

On Lifted, an Upwork Company™’s own careers site (SmartRecruiters), checked open today.

  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteSmartRecruiters board
  • Checked: Checked open todaySmartRecruiters board
  • Checked: No reposts foundSmartRecruiters board
  • Trust score 95 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Design genuinely difficult, expert-level problems in your technical field for AI agents to solve from scratch in a Linux terminal.
  • Create tasks that test where AI models fail, with each task evaluated across three frontier models making three attempts each.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 10+ years of professional experience in a technical domain
  • At least one academic or professional publication

Education

  • Master’s degree or higher

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Lifted, an Upwork Company™’s careers site

Company Description

This enterprise client helps the world’s most innovative companies improve their AI models by providing human feedback.

Job Description

Help build a benchmark of real, expert-level problems that today’s best AI agents still can’t solve. Experts take a genuinely hard problem from their own field and turn it into a task an AI must solve from scratch in a Linux terminal.

The goal: stump the model. A task counts only if, when three frontier AI models each try it three times, they mostly fail. It’s not annotation — contributors design the problems that expose where AI still breaks.

Qualifications

Who we need:

  • Masters degree or higher
Show full descriptionShow less
  • 10+ years of professional experience in a technical domain
  • At least one publication (academic or professional)

Domains in demand:

  • Coding
  • Machine Learning
  • Systems
  • Security
  • Hardware

Additional Information

  • This is an ongoing project — at least 7 weeks
  • Onboarding process is approximately 90 minutes total

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Clinical Pharmacist

Lifted, an Upwork Company™ · Remote · US only

Contract

StrongPay not listedChecked open todayPosted 15 days ago

See more like this