Data & AI jobs

AI Agentic Workflow Reviewer

Innodata Inc.San Jose, CAOn-site

$50–$55/hr listed by the employer

Key facts

Pay per year
≈ $104k–$114kEstimate for full-time hours.
Experience
2+ years
Degree
Bachelor's degree or equivalent

Looks real. 1 thing to check before you apply.

On Innodata Inc.’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 2 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay range listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 95 / 100 · Strong
See all 6 checksShow fewer
How we check

What you’ll do

  • Review multi-step agent task trajectories for task success, safety, and policy adherence.
  • Assess whether agents respect user agency and informed consent.
  • Apply privacy guardrails when reviewing tasks involving sensitive or personal data.
  • Work in isolated test environments and verify resets between test runs.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 2–5+ years in quality review, QA/QC, trust & safety, content moderation, data annotation, or a similarly judgment-intensive review role

Education

  • Bachelor's degree or equivalent practical experience

Skills

  • Comfort with ambiguity and structured decision-making under a rubric
  • Some familiarity with AI/ML concepts and how AI agents complete tasks (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Innodata Inc.’s careers site

Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.

Scope of the Role:

Show full descriptionShow less

We're building a dedicated reviewer team to evaluate complex, real-world agentic AI workflows, assessing whether AI agents complete tasks safely, respect user intent and consent, and hold up under close scrutiny. This isn't routine content moderation: reviewers work through ambiguous, multi-step scenarios where judgment calls matter as much as checklists. You'll operate inside isolated test environments, apply structured rubrics, and help calibrate what "safe and policy adherent agent behavior" actually looks like.

What You’ll Own:

  • Review multi-step agent task trajectories against rubric-based criteria covering task success, safety, and policy adherence
  • Evaluate whether an agent respected user agency and informed consent — not just whether it followed literal instructions
  • Apply privacy guardrails when reviewing tasks involving sensitive or personal data
  • Work inside isolated test environments, including verifying environment resets between test runs to prevent cross-contamination
  • Flag and escalate safety-relevant or ambiguous findings through defined escalation paths

You’ll Thrive in This Role If You Have:

  • Bachelor's degree or equivalent practical experience
  • 2–5+ years in quality review, QA/QC, trust & safety, content moderation, data annotation, or a similarly judgment-intensive review role
  • Strong written communication – you can justify a scoring decision clearly enough for someone else to audit it
  • Comfort with ambiguity and structured decision-making under a rubric, rather than needing a fixed rulebook for every case
  • Baseline understanding of AI/ML concepts and how AI agents complete tasks (can be learned through onboarding, but some familiarity helps)

The expected hourly salary range for this position is $50-$55p/hour, based on experience, skills, and qualifications.

Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams.

If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at verifyjoboffer@innodata.com and consider reporting it to the FTC at ReportFraud.ftc.gov.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

See more like this