Software Engineer jobs

Lead Software Engineer, Model Serving Platform

SciforiumSan Francisco, CAFull-timeOn-site

$230k–$300k/yr listed by the employer

Above the typical $210k a year for senior Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 1,291 senior Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Key facts

Experience
5+ years
Degree
Bachelor's degree or equivalent

Looks real. 1 thing to check before you apply.

On Sciforium’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 3 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Lead the serving platform’s technical direction, architecture, and engineering execution.
  • Build serving runtimes, batching and scheduling components, distributed inference systems, GPU modules, and Python APIs and services.
  • Work with ML researchers to productionize multimodal models and deliver low-latency, scalable inference.
  • Mentor engineers and drive performance profiling, benchmarking, observability, testing, and reliability.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 5+ years designing and building scalable, reliable backend systems or distributed infrastructure
  • Experience with Kubernetes or Ray and containerization
  • Ability to collaborate with ML researchers and translate model or runtime requirements into production-grade systems
  • Ability to lead technical discussions, mentor engineers, and drive engineering quality
  • Experience with ML systems engineering, distributed GPU scheduling, or inference engines such as vLLM, Sglang, or TRT-LLM (preferred)
  • Experience building large-scale ML/MLOps infrastructure (preferred)
  • Experience at an AI/ML startup, research lab, or Big Tech infrastructure/ML team (preferred)
  • Contributions to open-source ML or HPC infrastructure (preferred)

Education

  • Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience

Skills

  • Strong understanding of LLM inference mechanics, including prefill vs. decode, batching, and KV cache
  • Strong proficiency in C++ and Python
  • Strong system-level debugging, profiling, and performance optimization skills
  • Proficiency in CUDA or ROCm and experience with GPU profiling tools (preferred)
  • Familiarity with multimodal model architectures, raw-byte models, or efficient inference techniques (preferred)

Other requirements

  • Comfort working from the office

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Medical insurance
Dental & vision
Dental and vision insurance
Retirement plan
401(k) plan
Paid time off
Flexible time off
Equity
Competitive salary and equity
Meals
Daily lunch, snacks, and beverages

Full job description

From Sciforium’s careers site

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

ABOUT THE ROLE

Show full descriptionShow less

This is a rare chance to help architect and lead the development of Sciforium’s next-generation model serving platform, the high-performance engine that will bring a multimodal, highly efficient foundation model to market. As a senior technical leader, you’ll not only build core components yourself but also guide and mentor other engineers, influencing engineering direction, standards, and execution quality.

You will learn and shape the full AI stack: from GPU kernels and quantized execution paths to distributed serving, scheduling, and the APIs that power real-time AI applications. If you enjoy deep systems work, thrive on ownership, and want to lead engineers in building foundational AI infrastructure, this role puts you at the center of SciForium’s mission and growth.

WHAT YOU'LL DO

  • Lead the technical direction of the model serving platform, owning architecture decisions and guiding engineering execution.
  • Build core serving components including execution runtimes, batching, scheduling, and distributed inference systems.
  • Develop high-performance C++ and CUDA/HIP modules, including custom GPU kernels and memory-optimized runtimes.
  • Collaborate with ML researchers to productionize new multimodal models and ensure low-latency, scalable inference.
  • Build Python APIs and services that expose model capabilities to downstream applications.
  • Mentor and support other engineers through code reviews, design discussions, and hands-on technical guidance.
  • Drive performance profiling, benchmarking, and observability across the inference stack.
  • Ensure high reliability and maintainability through testing, monitoring, and engineering best practices.
  • Troubleshoot and resolve complex issues across GPU, runtime, and service layers.

IDEAL CANDIDATE PROFILE

  • Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience
  • 5+ years of experience designing and building scalable, reliable backend systems or distributed infrastructure.
  • Strong understanding of LLM inference mechanics (prefill vs decode, batching, KV cache)
  • Experience with Kubernetes/Ray, Containerization
  • Strong proficiency in C++, Python.
  • Strong debugging, profiling, and performance optimization skills at the system level.
  • Ability to collaborate closely with ML researchers and translate model or runtime requirements into production-grade systems.
  • Effective communication skills and the ability to lead technical discussions, mentor engineers, and drive engineering quality.
  • Comfortable working from the office and contributing to a fast-moving, high-ownership team culture.

NICE-TO-HAVE

  • Experience with ML systems engineering, distributed GPU scheduling, open source inference engine like vLLM, Sglang, or TRT-LLM
  • Experience in building large scale ML/MLOps infrastructure
  • Proficiency in CUDA or ROCm and experience with GPU profiling tools
  • Experience at an AI/ML startup, research lab, or Big Tech infrastructure/ML team.
  • Familiarity with multimodal model architectures, raw-byte models, or efficient inference techniques.
  • Contributions to open-source ML or HPC infrastructure

BENEFITS INCLUDE

  • Medical, dental, and vision insurance
  • 401k plan
  • Daily lunch, snacks, and beverages
  • Flexible time off
  • Competitive salary and equity

EQUAL OPPORTUNITY

Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer

talentpluto · San Francisco, CA

$165k–$250k/yrFull-timeOn-site

StrongChecked open todayPosted yesterday

Software Engineer

Simple AI · San Francisco, CA

$130k–$280k/yr · see postingFull-timeOn-site

Wide pay rangeChecked open todayPosted 10 days ago

Software Engineer, Product

Ambrook · New York, NY +2 places

$115k–$260k/yr · see postingFull-timeHybrid

Wide pay rangeChecked open todayPosted 5 days ago

Software Engineer, Robotics

Integrated Biosciences, Inc. · Redwood City, CA

$140k–$230k/yrOn-site

StrongChecked open todayPosted 8 days ago

See more like this