Software Engineer jobs

Senior AI Serving Engineer, Backend

SciforiumSan Francisco, CAFull-timeOn-site

$190k–$250k/yr listed by the employer

Above the typical $176k a year for mid-level Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 466 mid-level Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Key facts

Experience
3+ years
Degree
Bachelor's degree or equivalent

Looks real. 1 thing to check before you apply.

On Sciforium’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 12 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 75 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Build the model serving platform, including its API, control plane, billing, monitoring, and distributed inference features.
  • Integrate multimodal models into production workflows in collaboration with ML researchers.
  • Write reliable, maintainable code and support strong testing and documentation practices.
  • Provide operational support to keep production services performant, available, and reliable.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3+ years of software engineering experience focused on infrastructure or machine learning systems
  • Experience with Kubernetes and containerization
  • Experience building large-scale ML/MLOps infrastructure
  • Experience with ML systems engineering and open-source inference engines such as vLLM, SGLang, or TRT-LLM (preferred)
  • Contributions to open-source ML or HPC infrastructure (preferred)

Education

  • Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience

Skills

  • Strong proficiency in C++, Python, Go, or Rust
  • Proficiency in CUDA or ROCm and experience with GPU profiling tools (preferred)

Other requirements

  • Comfortable working from the office

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Medical insurance
Dental & vision
Dental and vision insurance
Retirement plan
401(k) plan
Paid time off
Flexible time off
Meals
Daily lunch, snacks, and beverages
Other
Competitive salary

Also: equity

Full job description

From Sciforium’s careers site

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

ABOUT THE ROLE

This role offers a unique opportunity to work on the core systems that power Sciforium’s multimodal AI models. You’ll help build the model serving platform working across C++, Python, runtime execution, and distributed infrastructure to create a fast, reliable engine for real-time AI applications.

Show full descriptionShow less

You’ll gain hands-on experience with performance engineering, learn how large AI models are optimized and deployed at scale, and collaborate closely with ML researchers and experienced systems engineers. If you enjoy low-level programming, care deeply about performance, and want exposure to the full AI stack, this role provides both high-impact work and strong growth potential.

WHAT YOU'LL DO

  • Build the model serving platform, including API, Control Plane, Billing, Monitoring, and distributed inference features.
  • Collaborate with ML researchers to integrate new multimodal models into production workflows.
  • Write reliable, maintainable code with strong testing and documentation practices.
  • Provide operational support for keeping our production services highly performant, available and reliable
  • Help troubleshoot complex issues across runtime, service, and GPU layers, working closely with other engineers.

IDEAL CANDIDATE PROFILE

  • Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
  • 3+ years of software engineering experience, with a focus on infrastructure or machine learning systems.
  • Strong proficiency in C++/Python/Go/Rust
  • Experience with Kubernetes, Containerization
  • Experience in building large scale ML/MLOps infrastructure
  • Strong collaboration and communication skills, with the ability to work effectively across engineering and ML teams.
  • Comfortable working from the office and contributing to a fast-moving, high-ownership team culture.

NICE-TO-HAVE

  • Experience with ML systems engineering, open source inference engine like vLLM, Sglang, or TRT-LLM
  • Proficiency in CUDA or ROCm and experience with GPU profiling tools
  • Contributions to open-source ML or HPC infrastructure

BENEFITS INCLUDE

  • Medical, dental, and vision insurance
  • 401k plan
  • Daily lunch, snacks, and beverages
  • Flexible time off
  • Competitive salary and equity

EQUAL OPPORTUNITY

Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

See more like this