Software Engineer jobs

Inference Engineer

CartesiaSan Francisco, CAFull-timeOn-siteUS visa sponsorship case by case

$180k–$250k/yr listed by the employer

About the typical $210k a year for senior Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 1,288 senior Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Looks real. 1 thing to check before you apply.

On Cartesia’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 23 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 75 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Build low-latency, scalable, reliable inference and serving systems for foundation models.
  • Work with research and product teams to serve products efficiently and reliably.
  • Build inference infrastructure and monitoring for products.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience building large-scale distributed systems with high demands on performance, reliability, and observability
  • Technical leadership and ability to deliver zero-to-one results amidst ambiguity
  • Background in or experience working on inference pipelines with machine learning and generative models
  • Experience implementing state-of-the-art machine learning models and research to applied problems
  • Experience with vLLM, SGLang, continuous batching, or other inference frameworks (preferred)
  • Experience working in CUDA, Triton, or similar (preferred)

Skills

  • Strong engineering skills, including navigating complex codebases and writing clean, maintainable code

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Fully covered medical insurance for you and your family
Dental & vision
Dental and vision coverage for you and your family
Retirement plan
401(k)
Paid time off
Flexible PTO; take as much time as needed
Parental leave
9 weeks of paternity leave and 12 weeks of maternity leave
Equity
Attractive equity package
Commuter benefits
Monthly commuter stipend
Meals
Lunch, dinner, and snacks provided daily
Other
Personal Yoshi

Full job description

From Cartesia’s careers site

ABOUT CARTESIA

Our mission is to architect AI that learns from and interacts with the world like humans do.

We're pioneering the model architectures that will make this possible. Our founding team met as PhDs at the Stanford AI Lab, where we invented State Space Models or SSMs, a new primitive for training efficient, large-scale foundation models. Our team combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team to build and ship cutting edge models and experiences.

Show full descriptionShow less

We're funded by leading investors at Index Ventures and Lightspeed Venture Partners, along with Factory, Conviction, A Star, General Catalyst, SV Angel, Databricks and others. We're fortunate to have the support of many amazing advisors, and 90+ angels across many industries, including the world's foremost experts in AI.

ABOUT THE ROLE

We're hiring an Inference Engineer to advance our mission of building real-time multimodal intelligence.

YOUR IMPACT

  • Design and build low latency, scalable, and reliable model inference and serving stack for our cutting edge foundation models using Transformers, SSMs and hybrid models.
  • Work closely with our research team and product engineers to serve our suite of products in a fast, cost-effective, and reliable manner.
  • Design and build robust inference infrastructure and monitoring for our products.
  • Have significant autonomy to shape our products and directly impact how cutting-edge AI is applied across various devices and applications.

WHAT YOU BRING

Given the scale and difficulty of problems we work on, we value strong engineering skills at Cartesia.

  • Strong engineering skills, comfortable navigating complex codebases and an eye for writing clean and maintainable code.
  • Experience building large-scale distributed systems with high demands on performance, reliability, and observability.
  • Technical leadership with the ability to execute and deliver zero-to-one results amidst ambiguity.
  • Background in or experience working on inference pipelines with machine learning and generative models.
  • Experience implementing state of the art Machine Learning models and research to applied problems.
  • Preferable: experience with vLLM, SGLang, Continuous Batching or other inference frameworks.
  • Preferable: experience working in CUDA, Triton or similar

MORE DETAILS

🏢 In-office policy: We’re an in-person team based out of offices in 🇺🇸 San Francisco, 🇬🇧 London and 🇮🇳 Bangalore. We love being in the office, hanging out together, and learning from each other every day.

🌎 Visa sponsorship: We provide visa sponsorship support and assess each circumstance on a case-by-case basis. However, visa sponsorship is dependent on many factors, including the role you are applying for, and the location you are going to be based, and so we can't always guarantee success. Your Recruiter will work with you to understand your visa sponsorship needs from the first call.

🚢 We ship fast. All of our work is novel and cutting edge, and execution speed is paramount. We have a high bar, and we don’t sacrifice quality or design along the way.

🤝 We support each other. We have an open & inclusive culture that’s focused on giving everyone the resources they need to succeed.

OUR BENEFITS (US EMPLOYEES ONLY)

💰 Compensation Competitive base salary alongside attractive equity package.

🩺 Health Insurance Fully covered medical insurance along with dental and vision for you and your family.

🧑‍🧑‍🧒‍🧒 Parental Leave 9 weeks paternity & 12 weeks maternity leave

🏦 401(k)

🚆 Commuter Allowance A monthly stipend to help you get to and from the office.

🏖️ Flexible PTO Take as much time as you need to recharge your batteries.

🍲 Meals & Snacks Lunch, dinner and plenty of snacks, provided daily.

🦖 Your own personal Yoshi

Note: Cartesia participates in E-Verify and will provide the federal government with Form I-9 information to confirm employment eligibility after hire.

OUR COMMITMENT TO EQUAL OPPORTUNITY

Cartesia is an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, or any other legally protected status.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer

Simple AI · San Francisco, CA

$130k–$280k/yr · see postingFull-timeOn-site

Wide pay rangeChecked open todayPosted 9 days ago

Software Engineer, Product

Ambrook · New York, NY +2 places

$115k–$260k/yr · see postingFull-timeHybrid

Wide pay rangeChecked open todayPosted 4 days ago

Software Engineer, Robotics

Integrated Biosciences, Inc. · Redwood City, CA

$140k–$230k/yrOn-site

StrongChecked open todayPosted 7 days ago

See more like this