Software Engineer jobs

Software Engineer, AI Agent & LLM

Otter.aiMountain View, CAHybrid3+ years experience

$155k–$185k/yr listed by the employer

About the typical $177k a year for mid-level Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 469 mid-level Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Looks real. 1 thing to check before you apply.

On Otter.ai’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 4 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 90 / 100 · Strong
See all 6 checksShow fewer
How we check

What you’ll do

  • Build AI-agent experiences for Otter AI Chat that reason over conversations, retrieve knowledge, and complete tasks.
  • Improve the conversational knowledge engine through knowledge extraction, annotation, and indexing.
  • Create evaluation datasets, automated graders, regression tests, and release gates for AI quality.
  • Diagnose failures and build shared infrastructure for agent orchestration, tracing, debugging, retries, sandboxed execution, and observability.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3+ years of AI Agent engineering, machine learning engineering, or related experience
  • Hands-on experience building and shipping AI-agent or LLM-powered products
  • Experience evaluating nondeterministic systems
  • Ability to take ambiguous problems from initial exploration through production launch and continuous improvement

Skills

  • Strong backend or distributed-systems engineering skills
  • Ability to use data, traces, logs, and qualitative examples to identify and resolve complex failures
  • Strong product judgment and rigorous engineering and evaluation practices
  • Demonstrated ability to use coding agents effectively while rigorously reviewing and controlling the quality of their output (preferred)

Other requirements

  • High agency, strong ownership, and a bias toward action

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Otter.ai’s careers site

The Opportunity

We are looking for an AI Agent & LLM Engineer who combines strong software engineering capabilities with a deep focus on AI quality. You will help build and improve the AI systems behind Otter’s conversational knowledge engine and AI Chat, spanning user-facing agent experiences, evaluation systems, and the shared platform required to operate them reliably at scale.

This is a hands-on role for someone who can move from an ambiguous product problem to a working production solution, define how quality should be measured, and drive improvements across services, models, and user experience.

Your Impact

Show full descriptionShow less
  • Build AI-agent experiences for Otter AI Chat that help users reason over conversations, retrieve knowledge, and complete complex tasks.
  • Advance Otter’s conversational knowledge engine through better knowledge extraction, annotation, and indexing.
  • Develop robust evaluation datasets, automated graders, regression tests, and release gates for AI quality.
  • Diagnose failures across models, prompts, retrieval, tools, data pipelines, backend services, and product workflows.
  • Build shared agent infrastructure for orchestration, tracing, debugging, retries, sandboxed execution, and observability.
  • Improve task completion, correctness, groundedness, reliability, latency, and cost.
  • Turn production traces, customer feedback, and usage signals into measurable product and model improvements.
  • Collaborate across AI, product, infrastructure, data, security, and application teams to deliver end-to-end capabilities.

We're looking for someone who

  • Has 3+ years of AI Agent engineering, machine learning engineering, or related experience.
  • Brings strong backend or distributed-systems engineering skills.
  • Has hands-on experience building and shipping AI-agent or LLM-powered products.
  • Has a strong focus on AI quality and experience evaluating nondeterministic systems.
  • Can use data, traces, logs, and qualitative examples to identify and resolve complex failures.
  • Works effectively across services, technical domains, and organizational boundaries.
  • Combines strong product judgment with rigorous engineering and evaluation practices.
  • Operates with high agency, strong ownership, and a bias toward action.
  • Can take ambiguous problems from initial exploration through production launch and continuous improvement.
  • Demonstrated ability to use coding agents effectively while rigorously reviewing and controlling the quality of their output is a plus.

About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Accessibility & Accommodations

*Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.

Salary range

Salary Range: $155,000 to $185,000 USD per year

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package. #LI-Hybrid

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace. We provide reasonable accommodations for qualified applicants throughout the hiring process.

Otter.ai is committed to providing reasonable accommodations for candidates with disabilities in our hiring process. If you need assistance or an accommodation during any stage of the recruitment process, please contact hr@otter.ai at least 3 business days before your interview.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

Staff Software Engineer

LinkedIn · Mountain View, CA

$156k–$255k/yrFull-timeHybrid

StrongChecked open todayPosted 5 days ago

See more like this