Remote · US only jobs

Member of Technical Staff, Agents

Clera (agency)Remote · US onlyFull-timePosted today

$200k–$300k/yr listed by the employer

Key facts

Experience
11+ years
US visa
No US visa sponsorship

Looks real and checked open today.

On Clera’s own careers site (Ashby).

Trust score ready Nov 28

  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Note: Too new for a trust scoreScored after a week of daily checks, from Nov 28
See all 4 checksShow fewer
How we check

What you’ll do

  • Build agents that complete executive workflows end to end.
  • Define and measure task success using evaluation frameworks and representative datasets.
  • Develop agent capabilities and validate their performance before launch.
  • Investigate production failures, find root causes, and implement fixes.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • At least 3 years of experience in data science or machine learning, including evaluation systems, metrics, or product quality measurement
  • Experience designing evaluation frameworks, selecting meaningful metrics, and building representative test datasets
  • A track record delivering production AI, machine learning, agent, or agent-evaluation systems to real users
  • Experience owning systems end to end and using statistics, experiment design, and realistic simulations to assess changes
  • A record of startup experience or sustained growth and promotion at one organization
  • Up to 11 years of experience

Skills

  • Production-quality Python and SQL skills for analysis, large datasets, and automated pipelines
  • Experience with Django, React, and TypeScript
  • Strong engineering fundamentals
  • Familiarity with post-training, fine-tuning, or reinforcement learning (preferred)
  • Exposure to evaluation tools such as Braintrust or Raindrop (preferred)

Other requirements

  • Visa sponsorship is not available

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Clera’s careers site

ABOUT THE ROLE

Join a small, senior team building an AI-powered executive assistant that handles real work across communication and productivity tools. You will develop agent capabilities and evaluation systems that help ensure tasks are completed reliably before new features reach users.

WHAT YOU'LL DO

  • Build agents that complete executive workflows end to end with minimal oversight.
  • Define and measure task success with trusted evaluation frameworks and representative datasets.
  • Develop new agent capabilities and validate their performance before launch.
  • Investigate production failures, identify underlying causes, and deliver fixes that prevent recurrence.
Show full descriptionShow less
  • Build scaled systems to detect known failure patterns and unexpected issues.
  • Improve agent resilience when external tools or websites fail.
  • Create repeatable methods for engineers to measure the impact of agent changes.

WHAT WE'RE LOOKING FOR

  • At least 3 years of experience in data science or machine learning, including evaluation systems, metrics, or product quality measurement.
  • Production-quality Python and SQL skills for analysis, large datasets, and automated pipelines.
  • Experience designing evaluation frameworks, selecting meaningful metrics, and building representative test datasets.
  • A track record delivering production AI, machine learning, agent, or agent-evaluation systems to real users.
  • Experience owning systems end to end and using statistics, experiment design, and realistic simulations to assess changes.
  • Familiarity with post-training, fine-tuning, or reinforcement learning is valuable.
  • Experience with Django, React, and TypeScript; exposure to evaluation tools such as Braintrust or Raindrop is useful.
  • A record of startup experience or sustained growth and promotion at one organization, strong engineering fundamentals, and up to 11 years of experience.

COMPENSATION & BENEFITS

Base salary: $200,000 to $300,000 annually. Visa sponsorship is not available.

LOCATION

On-site in Palo Alto, California.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Member of Technical Staff

Clera (agency) · Remote · US only

Full-time

Looks goodPay not listedChecked open todayPosted yesterday

Agent Engineer

Clera (agency) · Remote · US only

Full-time

Looks goodPay not listedChecked open todayPosted 2 days ago

Freelance Engineer

Clera (agency) · Remote · location not stated

Contract

Pay not listedChecked open todayPosted today

See more like this