Software Engineering jobs

Product Engineer

LiteLLMSan Francisco, CAFull-timeOn-siteBachelor's degree

$200k–$260k/yr listed by the employer

Looks real. 1 thing to check before you apply.

On LiteLLM’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 4 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 90 / 100 · Strong
See all 6 checksShow fewer
How we check

What you’ll do

  • Build product features from concept through production, including backend APIs and services.
  • Talk with customers to understand pain points, validate solutions, and iterate based on feedback.
  • Build developer experiences across the API, dashboard, and CLI, and improve major product areas over time.
  • Work with the founders on product direction, technical decisions, and the company's second major product.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience building production software
  • Experience building production software with Python (preferred)
  • Experience at an early-stage startup (preferred)
  • Experience building developer tools or infrastructure products (preferred)
  • Open source contributions (preferred)
  • Built and launched your own product (preferred)

Education

  • Bachelor's or Master's degree in Computer Science or a related field

Skills

  • Strong software engineering fundamentals
  • Comfortable moving across backend, frontend, infrastructure, and APIs
  • Strong product intuition and curiosity about how customers use software
  • Familiarity with AI infrastructure, LLMs, or developer platforms (preferred)

Other requirements

  • High ownership and ability to identify and solve problems independently
  • Comfortable operating in ambiguity and making decisions with incomplete information
  • Excited by shipping quickly and learning from real users

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Health benefits
Dental & vision
Dental and vision benefits
Other
Competitive salary

Also: equity

Full job description

From LiteLLM’s careers site

PRODUCT ENGINEER

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.

We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.

ABOUT THE ROLE

This isn't a traditional product management role, and it isn't a traditional software engineering role.

Show full descriptionShow less

You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.

If you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.

RESPONSIBILITIES

  • Build new product features from concept to production.
  • Work directly with customers to understand pain points and validate solutions.
  • Ship quickly while maintaining a high quality bar.
  • Prototype new ideas and iterate based on user feedback.
  • Own major product areas and continuously improve them over time.
  • Design backend APIs and services using Python and FastAPI.
  • Build intuitive developer experiences across our API, dashboard, and CLI.
  • Collaborate directly with the founders on product direction and technical decisions.
  • Help define and build LiteLLM's second major product.

WHAT WE'RE LOOKING FOR

  • Bachelor's or Master's degree in Computer Science or a related field.
  • Strong software engineering fundamentals.
  • Experience building production software, preferably with Python.
  • Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
  • Strong product intuition and curiosity about how customers use software.
  • Excellent written and verbal communication.
  • High ownership—you naturally identify problems and solve them without waiting to be asked.
  • Comfortable operating in ambiguity and making decisions with incomplete information.
  • Excited by shipping quickly and learning from real users.

BONUS POINTS

  • Experience at an early-stage startup.
  • Experience building developer tools or infrastructure products.
  • Open source contributions.
  • You've built and launched your own product.
  • Familiarity with AI infrastructure, LLMs, or developer platforms.

WHY JOIN LITELLM?

  • Work directly with the founders every day.
  • Build products used by thousands of engineering teams around the world.
  • Own meaningful product decisions—not just implementation.
  • Move incredibly fast and see your work in production immediately.
  • Help define the future of AI infrastructure and developer tooling.
  • Competitive salary, equity, health, dental, and vision benefits.

ABOUT LITELLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 2 days ago

Staff Production Engineer

Zscaler · Santa Clara, CA +1 place

$152k–$190k/yrFull-timeHybrid

StrongChecked open todayPosted today

Senior Platform Engineer

Arta Finance · Bay Area, CA

$110k–$205k/yrFull-timeHybrid

StrongChecked open todayPosted yesterday

See more like this