Data & AI jobs

Welsh-Speaking JSON & Coding Experts for Audio Evaluations

Lifted, an Upwork Company™Remote · US onlyContractPosted 25 days ago

Pay not listed

This job is closed.

The employer took it down 10 days ago, after 10 days open. Here are similar open jobs.

  • To check: No pay range listed, though one is likely required in CAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteSmartRecruiters board
  • Checked: No reposts foundSmartRecruiters board
  • Note: Last seen open 19 days agoLive check
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

Similar jobs

Clinical Pharmacist

Lifted, an Upwork Company™ · Remote · US only

Contract

StrongPay not listedChecked open todayPosted 15 days ago

See more like this

What you’ll do

  • Participate in live conversational scenarios with AI systems and speak naturally in real time.
  • Review and label conversation transcripts.
  • Evaluate AI-generated responses against structured rubrics and provide written justifications.
  • Assess language quality, customer experience, technical accuracy, formatting, and JSON structure.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Skills

  • C1/C2-level spoken and listening fluency in Welsh as spoken in the United Kingdom
  • JSON fluency, including reading, validating, troubleshooting, and identifying structural or formatting issues
  • Ability to evaluate customer experience and technical correctness (preferred)

Other requirements

  • Pass a basic computational concepts assessment covering JSON structures, functions, general reasoning, and language proficiency
  • Ability to produce clear audio with no background noise

Full job description

From Lifted, an Upwork Company™’s careers site

Company Description

An Enterprise client is seeking Welsh-speaking coding experts with JSON expertise to combine language fluency, customer service judgment, and technical evaluation skills to help improve the quality, accuracy, and usability of AI-generated outputs, in an audio format.

Work is expected to begin right away, and continue for 2-3 months, with the potential for additional work beyond this initial project.

Show full descriptionShow less

Experts may work at any schedule of their choosing, for as long as tasks are available. Experts (Operators) will review a mix of customer service-style responses and technical content, with a strong focus on coding knowledge, JSON structure, formatting accuracy, and overall response quality. Experts should be comfortable identifying whether outputs are clear, helpful, natural, technically accurate, and aligned with project guidelines.

Fluency in Welsh, as spoken in the United Kingdom, is required. Experts with multilingual fluency may be offered work for this project and/or others, in additional languages.

Job Description

Tasks include:

  • Participating in live, real-time conversational scenarios with AI systems
  • Reviewing and labeling conversation transcripts
  • Evaluating AI-generated responses using structured rubrics and providing written justifications
  • Assessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure
  • Capturing required session artifacts, including recordings, Session IDs, and tool-call/console logs
  • Environment preparation and tool verification before each session

Experts should speak naturally and spontaneously, as if responding in real time, without pre-planned, written, or scripted responses - the client is evaluating natural voice cadence.

Qualifications

To be considered for this project, experts are required to pass a basic computational concepts assessment (JSON structures, function, general reasoning, and language proficiency), which takes about 15 minutes to complete, and will not be compensated. If the expert passes the assessment, they will be provided with further onboarding steps.

“Operator” requirements:

  • Strong spoken-language proficiency: C1/C2-level fluency (CEFR) in the target evaluation language, verified through a speaking/listening assessment, not just a resume claim.
  • Technical literacy: JSON fluency required - reading, validating, troubleshooting, and identifying structural/formatting issues.
  • Audio setup: capable of producing clear audio quality with no background noise.

Ideal experts will have strong attention to detail, strong written communication skills, and the ability to evaluate both the customer experience and the technical correctness of a response. A solid understanding of JSON is especially important, including the ability to read, validate, troubleshoot, and identify structural or formatting issues.

Something wrong with this job? Report it · This flag looks wrong