Software Engineer jobs

Applied AI Engineer, Video Agent

HeyGenSan Francisco, CA +1 placePosted 1 month ago

$180k–$240k/yr listed by the employer

Above the typical $177k a year for mid-level Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 469 mid-level Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Key facts

Where
San Francisco, CA · Palo Alto, CA
Experience
2+ years

Strong: looks real and checked open today.

On HeyGen’s own careers site (Greenhouse).

  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Design agent tools, prompts, and context; improve planning, error recovery, and handling of long, multi-turn conversations.
  • Build evaluations and offline replays, run experiments, and analyze user sessions and agent traces.
  • Build user-facing features in TypeScript and React, and backend services and long-running workflows in Python and Go.
  • Partner with product, design, research, and rendering teams.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Built and shipped an AI agent used by real people, with a model that calls tools, plans across several steps, and acts on results
  • 2 or more years of professional experience
  • Fine-tuned models (preferred)
  • Worked on code-to-video models that generate video by writing code such as HTML or animation scripts (preferred)
  • Worked on video agent models (preferred)

Education

  • A degree in computer science or a related field (preferred)

Skills

  • Built evaluations or test sets for model behavior and can distinguish real improvements from noise
  • Fluent in TypeScript and React on the frontend and Python on the backend

Other requirements

  • Strong product sense and customer awareness
  • Takes ownership and identifies important problems without waiting for a specification

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Health benefits
Dental & vision
Dental and vision benefits
Retirement plan
401(k) match
Paid time off
Flexible PTO
Equity
Equity in a high-growth AI company

Full job description

From HeyGen’s careers site

About HeyGen

At HeyGen, our mission is to make visual storytelling accessible to all. Over the last decade, visual content has become the preferred method of information creation, consumption, and retention. But the ability to create such content, in particular videos, continues to be costly and challenging to scale. Our ambition is to build technology that equips more people with the power to reach, captivate, and inspire audiences. Learn more at www.heygen.com. Visit our Mission and Culture doc here.

About the Video Agent team

Show full descriptionShow less

Video Agent turns a prompt, a document, or a handful of assets into a finished video. Behind a simple chat box sits a multi-step AI agent. It plans a storyboard, writes the script, chooses avatars, voices, and visuals, calls many tools along the way, and hands the result to our rendering pipeline. Customers use it every day to make training videos, product explainers, marketing content, and more.

We are a small team that owns the agent end to end. That covers the prompts and tools the agent uses, the backend services that run it, and the product screens where people chat with it and edit what it makes.

This is not a role where you only call someone else’s model through an API. HeyGen trains its own models in house, and the agent is built on top of them. You will work directly with those models and with the researchers who build them, which is an experience few applied AI roles offer.

About the role

You will make Video Agent better at doing what the user actually asked for, and you will prove it with data. Some weeks that means redesigning a tool the agent calls. Other weeks it means building an eval, running an A/B test, or shipping a new editing experience in React. You will own features from the first idea through launch and follow-up, and you will decide which problems belong to the model and which belong to plain, deterministic code.

What you’ll do

  • Build the agent. Design the tools, prompts, and context the agent works with. Improve how it plans, how it recovers from mistakes, and how it handles long, multi-turn conversations.
  • Measure quality. Build evals and offline replays of real sessions. Run experiments behind feature flags and read the results honestly. Watch real user sessions and agent traces to find where things go wrong.
  • Ship across the stack. Build user-facing features in TypeScript and React. Build backend services and long-running workflows in Python and Go.
  • Work closely with others. Partner with product managers, designers, and the research and rendering teams that the agent depends on.

What we’re looking for

  • You have built and shipped an AI agent that real people use. We mean a system where a model calls tools, plans across several steps, and acts on the results. A chat wrapper or a prompt demo is not enough on its own. We want to hear what broke in production and how you fixed it.
  • You know how to tell whether an AI system got better. You have built evals or test sets for model behavior. You can tell a real improvement from noise, and you are skeptical of results that look too good.
  • You are a strong full-stack engineer. You have 2 or more years of professional experience. You are fluent in TypeScript and React on the frontend and Python on the backend.
  • You have strong product sense. You use what you build, you care how it feels, and you look at how customers actually use it.
  • You take ownership. You do not wait for a spec. You find the most important problem, fix it, and tell people what changed.

A degree in computer science or a related field is welcome but not required. Equivalent experience counts.

Nice to have

  • You have fine-tuned models before.
  • You have worked on code-to-video models, which generate video by writing code such as HTML or animation scripts.
  • You have worked on video agent models in general.

Show us an agent you’ve built

With your application, please include a short note (a few sentences is fine) about an agent you have built. Tell us what it does, how you measured whether it worked, and one failure you found and fixed. A link to code, a demo, or a write-up is a bonus.

Compensation & Benefits

  • $180,000 – $240,000 annually
  • Equity in a high-growth AI company.
  • 401K Match
  • Health, dental, and vision benefits.
  • Flexible PTO.
  • Opportunity to help define a new category in AI video.
  • High ownership, high velocity, and direct impact on revenue growth.

Equal Opportunity

HeyGen is an Equal Opportunity Employer. We value diversity and are committed to building an inclusive environment for all employees.

Something wrong with this job? Report it

Similar jobs nearby

Software Engineer

talentpluto · San Francisco, CA

$165k–$250k/yrFull-timeOn-site

StrongChecked open todayPosted yesterday

Software Engineer

Simple AI · San Francisco, CA

$130k–$280k/yr · see postingFull-timeOn-site

Wide pay rangeChecked open todayPosted 10 days ago

Software Engineer, Product

Ambrook · New York, NY +2 places

$115k–$260k/yr · see postingFull-timeHybrid

Wide pay rangeChecked open todayPosted 5 days ago

See more like this