Clera (agency)San Francisco, CAFull-timeOn-sitePosted 16 days ago
$130k–$225k/yr listed by the employer
Above the typical $127k a year for mid-level Project & Program Manager jobs in CaliforniaHow we compare
How we compare. Typical is the median yearly pay of 62 mid-level Project & Program Manager jobs in California that list pay, from the employers' own postings. About means within 5%.
Key facts
Experience
3+ years
US visa
Sponsors US visas
This job is closed.
The employer took it down 8 days ago, after 8 days open. Here are similar open jobs.
Checked: On the company's own careers siteAshby board
Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
Turn ambiguous requests into specifications with milestones, owners, dependencies, and acceptance criteria.
Assess and improve data quality using quantitative metrics and qualitative review.
Manage external vendors and improve delivery pipelines as programs scale.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Experience
At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a related cross-functional field
Startup experience as a Technical Program Manager or Strategic Program Lead
Experience translating ambiguous technical requirements into executable plans
Experience maintaining or improving complex data quality processes
Experience managing vendors, scaling delivery pipelines, and supporting AI research teams or technical customers with evolving requirements
Skills
Strong judgment in evaluating datasets using aggregate metrics and individual examples
Familiarity with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, or expert data collection
Other requirements
On-site in San Francisco, California; remote candidates may be considered if they can maintain 70% to 80% time zone overlap with San Francisco or Singapore
Benefits
Relocation help
Relocation support available for qualified full-time candidates
Other
Visa sponsorship available for qualified full-time candidates
Full job description
From Clera’s careers site
ABOUT THE ROLE
Own complex data and evaluation programs for AI research teams and internal partners. This role brings together technical program management, data operations, and vendor coordination to help ensure evaluation data is high quality and useful for improving AI systems.
WHAT YOU'LL DO
Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
Turn ambiguous requests into clear specifications with milestones, owners, dependencies, and acceptance criteria.
Assess and improve data quality using quantitative metrics and qualitative review, including task coverage, difficulty, and reward distributions.
Show full descriptionShow less
Manage external vendors throughout the delivery lifecycle and improve pipelines as programs scale.
Improve workflows, documentation, automation, and cross-functional handoffs for data production.
Partner with research, platform, and marketplace teams to turn feedback into product improvements.
WHAT WE'RE LOOKING FOR
At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a related cross-functional field.
Startup experience as a Technical Program Manager or Strategic Program Lead, with the ability to work independently in a fast-paced environment.
Experience translating ambiguous technical requirements into executable plans and maintaining or improving complex data quality processes.
Strong judgment in evaluating datasets, moving between aggregate metrics and individual examples.
Experience managing vendors, scaling delivery pipelines, and supporting AI research teams or technical customers with evolving requirements.
Familiarity with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, or expert data collection.
Clear written and verbal communication, sound prioritization, and comfort navigating changing requirements.
COMPENSATION & BENEFITS
Base salary is $130,000 to $225,000 USD annually. Visa sponsorship and relocation support are available for qualified full-time candidates.
LOCATION
On-site in San Francisco, California. Remote candidates may be considered if they can maintain 70% to 80% time zone overlap with San Francisco or Singapore.