Subject Matter Experts: ML Model Evaluation (PhD)
Weekday AI · Remote · US only
$150/hrContract

TransPerfectRemote · Indonesia, VietnamContractPosted 5 days ago
$45/hr listed by the employer
On TransPerfect’s own careers site (Recruitee).
Trust score ready Nov 23
This job is outside the US, so these US-only checks are not applied: pay-transparency law, pay likely required by state law, US visa sponsorship wording.
Summary, requirements and match are for US jobs for now.
From TransPerfect’s careers site
DataForce by TransPerfect is part of the TransPerfect family of companies, the world’s largest provider of language and technology solutions for global business, with offices in more than 100 cities worldwide.
We offer high-quality data for Human-Machine Interaction to some of the most prestigious technology companies in the world. Our department focuses on gathering, enriching, and processing data for Machine Learning in different AI domains.
To learn more about DataForce please visit us at https://www.transperfect.com/dataforce.
Work Location: Remote
Engagement model: Independent Contractor/Freelance
Project start: November 2026
Estimated project duration: until end of 2026
Estimated workload: up to 20 hours in total
Required Languages: English
About the Role
We are looking for experienced professionals and subject-matter experts to contribute to an AI training and evaluation project focused on the creation of realistic professional knowledge-based tasks.
The ideal candidate has hands-on experience in Education, Content and Communications, or similar and understands how real workplace assignments are completed.
The ideal candidate is also comfortable using modern LLM tools such as ChatGPT, Claude, Gemini, or similar platforms.
What You’ll Do
- Develop realistic professional task scenarios based on your work experience in different roles within the above-mentioned sectors.
- Create and review supporting business materials such as spreadsheets, reports, presentations, documents, datasets, or other occupation-specific files.
Requirements
- Bachelor’s degree or equivalent professional qualification, where appropriate.
- Minimum 3 years of relevant professional work experience
- Must be located in the job opening location.
- Strong practical knowledge of workflows, tools, terminology, standards, and deliverables used in your profession.
- Have experience using tools such as ChatGPT, Claude, Gemini, or similar AI tools.
- Strong analytical and problem-solving skills.
- Experience working with multiple documents, data sources, reports, spreadsheets, presentations, or similar professional materials.
- Strong written English (all project-related task creation will be done in English).
- High attention to detail and ability to produce accurate, internally consistent work.
- Ability to distinguish realistic professional work from overly simplified or artificial scenarios.
- Experience creating, reviewing, validating, auditing, or quality-checking professional work is a plus.
- Experience developing training materials, case studies, or professional assessments is a plus.
Something wrong with this job? Report it

Weekday AI · Remote · US only
$150/hrContract
StrongLast seen open yesterdayPosted 8 days ago
American Institutes for Research · Remote · US only
$114k–$140k/yrFull-time
StrongChecked open todayPosted 7 days ago

Weekday AI · Remote · US only
$90–$120/hrFull-time
StrongChecked open todayPosted 8 days ago

TransPerfect · New York City, NY
$45k–$50k/yrFull-timeHybrid
StrongChecked open todayPosted 1 month ago

TransPerfect · Pune, MH, IN
Full-timeOn-site
StrongPay not listedChecked open todayPosted 1 month ago

TransPerfect · New York City, NY +1 place
$48k–$60k/yrFull-timeHybrid
StrongChecked open todayPosted 18 days ago