Clera (agency)San Francisco, CAFull-timeOn-sitePosted 24 days ago
$130k–$225k/yr listed by the employer
Above the typical $129k a year for mid-level Project & Program Manager jobs in CaliforniaHow we compare
How we compare. Typical is the median yearly pay of 65 mid-level Project & Program Manager jobs in California that list pay, from the employers' own postings. About means within 5%.
Key facts
Experience
3+ years
US visa
Sponsors US visas
This job is closed.
The employer took it down 17 days ago, after 4 days open. Here are similar open jobs.
Checked: On the company's own careers siteAshby board
Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
Turn technical requests into specifications with milestones, owners, dependencies, and acceptance criteria.
Assess and improve data quality using quantitative signals and qualitative review.
Manage external vendors and scale reliable production pipelines.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Experience
At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a related cross-functional setting
Experience as a Technical Program Manager or Strategic Program Lead at a startup, translating ambiguity into executable plans and maintaining momentum as requirements change
Strong quantitative and qualitative judgment to assess dataset quality using aggregate metrics and individual examples
Experience improving data quality procedures, managing vendors, scaling delivery pipelines, and documenting or automating workflows
Background supporting AI research teams, technical enterprise customers, or frontier AI labs with urgent, changing requirements
Strong written and verbal communication, sound tradeoff judgment, and ability to work independently in a fast-paced startup environment
Familiarity with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, or expert data collection (preferred)
Other requirements
On-site in San Francisco, California, or remote with 70%–80% time-zone overlap with San Francisco or Singapore
Benefits
Relocation help
Relocation support available for strong full-time candidates
Other
Visa sponsorship available for strong full-time candidates
Full job description
From Clera’s careers site
ABOUT THE ROLE
Own complex data and evaluation programs for AI research teams and internal partners. This role brings together technical program management, data operations, and vendor coordination to deliver high-quality data that improves LLM and agent evaluation.
WHAT YOU'LL DO
Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
Turn ambiguous technical requests into specifications with clear milestones, owners, dependencies, and acceptance criteria.
Improve data quality processes using quantitative signals and qualitative review, including task coverage, difficulty, and reward distributions.
Show full descriptionShow less
Manage external vendors throughout delivery and scale reliable production pipelines.
Improve workflows, documentation, automation, and cross-functional handoffs for data production and evaluation.
Work with research, platform, and marketplace teams to turn findings into product improvements.
WHAT WE'RE LOOKING FOR
At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a related cross-functional environment.
Experience as a Technical Program Manager or Strategic Program Lead at a startup, translating ambiguity into executable plans and maintaining momentum as requirements change.
Strong quantitative and qualitative judgment, with the ability to assess dataset quality using aggregate metrics and individual examples.
Experience improving data quality procedures, managing vendors, scaling delivery pipelines, and documenting or automating workflows.
Background supporting AI research teams, technical enterprise customers, or frontier AI labs with urgent, changing requirements.
Familiarity with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, or expert data collection is valuable.
Strong written and verbal communication skills, sound tradeoff judgment, and the ability to work independently in a fast-paced startup environment.
COMPENSATION & BENEFITS
Base salary is $130,000 to $225,000 USD annually. Visa sponsorship and relocation support are available for strong full-time candidates.
LOCATION
On-site in San Francisco, California. The role is also open to remote candidates who can maintain 70% to 80% time zone overlap with San Francisco or Singapore.