Staff Engineer, Web Operations
Freshworks · San Mateo, CA
$192k–$237k/yrFull-timeHybrid

LiteLLMSan Francisco, CAFull-timeOn-sitePosted 12 days ago
$250k–$350k/yr listed by the employer
How we compare. Typical is the median yearly pay of 704 staff-level Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.
On LiteLLM’s own careers site (Ashby).
Summarised from the posting by AI and can be wrong. The full description is the source.
Sign in and add your resume to see which of this job's requirements it shows.
Sign in to check your matchSaved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
Also: equity
From LiteLLM’s careers site
LiteLLM is the world’s most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We’ve grown ARR 6x in the last year to nearly $30M with a team of 20, and developers use LiteLLM to call 100+ LLM providers through one API.
We're looking for a Staff Engineer to lead our unified API team and make sure every new model and provider works with LiteLLM on day one.
ABOUT THE ROLE
This is a hands-on technical lead role. You'll own how LiteLLM unifies LLM APIs across the OpenAI and Anthropic specs, lead the engineers who build it, and set the bar for what good looks like.
Every week a provider ships something new: a new API, a new modality, a new feature. The promise of LiteLLM is that it works with all of them on day one. Your job is to keep that promise: new endpoints ship on day one, open source translation issues go down, and developers can count on LiteLLM to keep up.
You’ll lead our open source pod, where most issues are LLM translation issues. You’ll report to the CEO, and later to our Head of Engineering. This role is in person in San Francisco. We help with relocation and support H-1B transfers.
RESPONSIBILITIES
What is our tech stack
The tech stack includes Python, FastAPI, Redis, Postgres. We're moving the gateway to Rust.
WHAT WE'RE LOOKING FOR
BONUS POINTS
WHY JOIN LITELLM?
ABOUT LITELLM
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you want to lead the team that keeps LiteLLM ahead of every model launch, we'd love to meet you.
Something wrong with this job? Report it
Freshworks · San Mateo, CA
$192k–$237k/yrFull-timeHybrid
StrongChecked open todayPosted 3 days ago

Motive · San Francisco, CA
$180k–$225k/yrHybrid
StrongChecked open todayPosted 4 days ago
GoodLeap · Roseville, CA +4 places
$155k–$209k/yrFull-timeHybrid
StrongChecked open todayPosted 7 days ago
Synthetic · San Francisco, CA
$300k–$350k/yrFull-timeOn-site
StrongChecked open todayPosted 8 days ago

Anthropic · San Francisco, CA +2 places
$405k–$485k/yrHybrid
StrongChecked open todayPosted 7 days ago
Peregrine Technologies · Washington, DC +2 places
$200k–$275k/yrHybrid
StrongChecked open todayPosted 8 days ago