Staff Production Engineer
Zscaler · Santa Clara, CA +1 place
$152k–$190k/yrFull-timeHybrid

LiteLLMSan Francisco, CAFull-timeOn-siteSponsors US visasPosted 13 days ago
$250k–$350k/yr listed by the employer
On LiteLLM’s own careers site (Ashby).
Summarised from the posting by AI and can be wrong. The full description is the source.
Sign in and add your resume to see which of this job's requirements it shows.
Sign in to check your matchSaved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
Also: equity
From LiteLLM’s careers site
LiteLLM is the world’s most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We’ve grown ARR 6x in the last year to nearly $30M with a team of 20, and thousands of companies run production AI through LiteLLM across 100+ provider integrations.
We're looking for a Staff Engineer to own the stability and reliability of the gateway.
ABOUT THE ROLE
This is a hands-on staff role. You'll find the components behind our regressions and security issues, and refactor or rewrite them so the same problem doesn't come back in 20 places. You'll raise the quality of the codebase through your own code and review, not process documents.
LiteLLM is mission-critical infrastructure for our customers. When it breaks, their AI products break. You'll make sure that happens less, and that we know before they do.
You’ll work with our security and infrastructure team and report to the CEO, and later to our Head of Engineering. This role is in person in San Francisco. We help with relocation and support H-1B transfers.
RESPONSIBILITIES
What is our tech stack
The tech stack includes Python, FastAPI, Redis, Postgres. We're moving the gateway to Rust.
WHAT WE'RE LOOKING FOR
BONUS POINTS
WHY JOIN LITELLM?
ABOUT LITELLM
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you want to own the reliability of the gateway thousands of companies depend on, we'd love to meet you.
Something wrong with this job? Report it

Zscaler · Santa Clara, CA +1 place
$152k–$190k/yrFull-timeHybrid
StrongChecked open todayPosted 2 days ago

Mutual of Omaha Mortgage · Irvine, CA
$135k–$150k/yrFull-timeHybrid
StrongChecked open todayPosted yesterday
Peregrine Technologies · San Francisco, CA +2 places
$240k–$300k/yrOn-site
StrongChecked open todayPosted 2 days ago
ID.me · Mountain View, CA
$194k–$253k/yrFull-timeOn-site
StrongChecked open todayPosted 4 days ago

talentpluto · San Francisco, CA
$165k–$250k/yrFull-timeOn-site
StrongChecked open todayPosted yesterday

SpaceX · Hawthorne, CA
$135k–$160k/yr
StrongChecked open todayPosted 2 days ago