California jobs

Research Engineer, AI Security

TolmoSan Francisco, CAFull-timeHybridPosted 19 days ago

Pay not listed

Looks real. 1 thing to check before you apply.

On Tolmo’s own careers site (Ashby), checked open today.

  • To check: No pay range listed, though one is likely required in CAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: No reposts foundAshby board
  • Trust score 90 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Improve how security agents plan, use tools, and reason over production-system graphs.
  • Build evaluations, benchmarks, and graders to measure agent performance and include them in the release process.
  • Compare models, prompts, and agent designs on cost, latency, and quality to guide production decisions.
  • Protect agents against prompt injection, data exfiltration, and manipulation; research security risks in customers’ LLM-based applications.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Hands-on experience building, evaluating, or improving LLM-based agents or systems in production
  • Daily use of AI coding agents such as Claude Code or Cursor
  • Research background in machine learning, AI safety, or security, such as publications, open-source work, or talks (preferred)
  • Offensive security experience in penetration testing, red teaming, bug bounty, or CTFs (preferred)
  • Experience with reinforcement learning, fine-tuning, or synthetic data generation for agents (preferred)
  • Experience with graph data models or reasoning over structured data (preferred)
  • Prior early-stage startup experience (preferred)

Skills

  • Rigorous, empirical approach to designing experiments and evaluating results
  • Production-quality coding in Python, TypeScript, or Go
  • Working understanding of security, or a strong drive to learn it fast
  • Familiarity with LLM security risks such as prompt injection, jailbreaks, and tool misuse

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Comprehensive medical coverage
Dental & vision
Comprehensive dental and vision coverage
Equity
Early-stage equity
Other
Equipment needed to do your best work

Full job description

From Tolmo’s careers site

ABOUT TOLMO

Tolmo is cybersecurity for the age of AI. Coding agents now ship software faster than any human team can review or secure it; 100+ pull requests per engineer per week is no longer an outlier, and attackers are using the same agents to find and exploit weaknesses in days, not months. The old playbook of quarterly pentests and endless alert queues breaks at this speed.

Show full descriptionShow less

We're building a new security playbook. Tolmo runs a fleet of AI security agents that reason over a live graph of your entire production system (code, CI, cloud, and telemetry) and continuously attack a faithful copy of it like a real adversary. Every finding arrives validated, with its blast radius and a remediation plan that lands in your workflow, ready for a coding agent to fix. Hours to integrate, days to your first validated finding.

We've done this before: Tolmo's founders built Sqreen (acquired by Datadog) and led security products that thousands of organizations trusted. We're backed by Accel and Y Combinator and just getting started.

THE ROLE

Our product is only as good as our agents' judgment. As a Research Engineer on AI Security, you make that judgment better and measurably so: how our agents plan, reason over a graph of a customer's production system, decide what is worth testing, and know when a finding is real.

This sits between research and engineering. In one week you might design an eval that catches a new class of false positive, change how an agent plans a multi-step investigation, compare models on a hard benchmark, and harden the agents themselves against prompt injection from the systems they inspect. You'll work directly with the founders, our engineers, and the security leads who run pentests with our agents, and your work ships to production.

WHAT YOU'LL DO

  • Agent reasoning: improve how our agents plan, use tools, and reason over a live graph of code, cloud, and telemetry, so they reach real findings faster and with fewer dead ends.
  • Evaluation: build the evals, benchmarks, and graders that tell us whether an agent actually got better, and make them part of how every change ships.
  • Model selection and tuning: compare models, prompts, and agent designs on cost, latency, and quality, and turn the results into production decisions.
  • Model and agent security: defend our agents against prompt injection, data exfiltration, and manipulation by the very systems they test, and research the security of LLM-based applications our customers build.
  • Reliability at scale: make long-running agents dependable across thousands of runs: verification, self-checks, and sensible stopping.
  • Learning from the field: study agent runs from customer engagements, find where reasoning broke, and turn each failure into an eval and a fix.

WHAT WE'RE LOOKING FOR

  • Hands-on experience building, evaluating, or improving LLM-based agents or systems in production.
  • A rigorous, empirical approach: you design experiments, distrust single anecdotes, and let the evals decide.
  • Strong engineering skills: you write production-quality code (Python, TypeScript, or Go) and build tools other people rely on.
  • A working understanding of security, or a strong drive to learn it fast: how real systems are attacked and how findings are validated.
  • Familiarity with LLM security risks such as prompt injection, jailbreaks, and tool misuse.
  • You build with AI coding agents daily (e.g., Claude Code, Cursor) and have opinions about what makes them reliable.

NICE TO HAVE

  • Research background in machine learning, AI safety, or security: publications, open-source work, or talks.
  • Offensive security experience: penetration testing, red teaming, bug bounty, or CTFs.
  • Experience with reinforcement learning, fine-tuning, or synthetic data generation for agents.
  • Experience with graph data models or reasoning over structured data.
  • Prior early-stage startup experience.

COMPENSATION & BENEFITS

  • Competitive salary, depending on level and experience.
  • Early-stage equity: you're joining early; you'll own a real piece of what we build.
  • Comprehensive medical, dental, and vision coverage, and the equipment you need to do your best work.
  • Based in San Francisco; we work in person.

Tolmo is building a team with wide-ranging backgrounds, perspectives, and paths into security; we think it makes our product and judgment better. If you're excited about this role but don't match every point above, we'd still like to hear from you. We're an equal opportunity employer and welcome applicants of every background.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Growth Engineer

Tolmo · San Francisco, CA

Full-timeHybrid

Looks goodPay not listedChecked open todayPosted 2 days ago

Product Designer

Tolmo · San Francisco, CA

Full-timeHybrid

Looks goodPay not listedChecked open todayPosted yesterday

See more like this