Software Engineer jobs

Software Engineer, GPU Kernels

River AI Inc.Palo Alto, CA

$200k–$420k/yr listed by the employer

Above the typical $210k a year for Software Engineer jobs in California (all levels)How we compare

How we compare. Typical is the median yearly pay of 3,397 Software Engineer jobs in California (all levels) that list pay, from the employers' own postings. About means within 5%.

Key facts

Degree
Bachelor's degree or equivalent
US visa
Sponsors US visas

Looks real. 2 things to check before you apply.

On River AI Inc.’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 2 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: Wide pay range: top of the range is 2.1× the bottomAsk what the job pays at your level before you interview.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 95 / 100 · Strong
See all 7 checksShow fewer
How we check

What you’ll do

  • Build and optimize GPU kernels for attention, matrix multiplication, expert routing, and related operations.
  • Develop low-precision kernels and optimize memory access, tiling, and synchronization while maintaining numerical correctness.
  • Accelerate fine-tuning and reinforcement learning with optimized adapters, backward passes, and fused operations.
  • Profile workloads, integrate kernel improvements into training and inference runtimes, and create reproducible correctness and performance benchmarks.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience optimizing GPU kernels with CUDA, Triton, CUTLASS, CuTe, or comparable tools
  • Experience optimizing for NVIDIA Blackwell or Hopper GPUs (preferred)
  • Work on attention, mixture-of-experts kernels, grouped GEMMs, or low-rank adapters (preferred)
  • Experience implementing backward passes and validating gradients (preferred)
  • Experience integrating custom operators into PyTorch, SGLang, vLLM, or similar frameworks (preferred)
  • Open-source contributions or a track record of shipping substantial kernel optimizations (preferred)

Education

  • Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical experience

Skills

  • Strong understanding of GPU architecture, memory hierarchies, and parallel execution
  • Proficiency in C++ and Python
  • Strong foundations in linear algebra, floating-point arithmetic, and numerical computing
  • Strong debugging and profiling skills
  • Familiarity with FP8, FP4, and quantized weight layouts (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Comprehensive health insurance
Dental & vision
Comprehensive dental and vision insurance
Paid time off
Unlimited PTO
Relocation help
Relocation assistance as needed
Other
Visa sponsorship

Also: equity

Full job description

From River AI Inc.’s careers site

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructure, next-generation UIs, and frontier deep learning research.

Who we are

We are scientists, engineers, and builders from the industry's top tech companies and AI labs. We bring a proven track record of scaling consumer systems for hundreds of millions of users and architecting the pre-training infrastructure behind today's frontier models.

About the Role

Show full descriptionShow less

We are looking for exceptional GPU kernel engineers to build the compute primitives behind River’s training and inference infrastructure. Your goal is to make large models faster to train and more efficient to serve.

You will own performance-critical operations, including attention, matrix multiplication, mixture-of-experts execution, and low-precision computation. Working closely with researchers and systems engineers, you will identify bottlenecks, implement kernels, validate correctness, and bring improvements into production.

What You’ll Do

  • Build fast GPU kernels for attention, matrix multiplication, expert routing, and related operations.
  • Optimize memory access, tiling, and synchronization to make efficient use of GPU hardware.
  • Develop FP8, FP4, and mixed-precision kernels while preserving numerical correctness.
  • Accelerate fine-tuning and RL through optimized adapters, backward passes, and fused operations.
  • Profile real workloads and integrate improvements into training and inference runtimes.
  • Build reproducible benchmarks that verify correctness, gradients, and performance.

Skills & Qualifications

Minimum Qualifications:

  • Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical experience.
  • Experience optimizing GPU kernels with CUDA, Triton, CUTLASS, CuTe, or comparable tools.
  • Strong understanding of GPU architecture, memory hierarchies, and parallel execution.
  • Proficiency in C++ and Python.
  • Strong foundations in linear algebra, floating-point arithmetic, and numerical computing.
  • Strong debugging and profiling skills, with a collaborative approach to engineering.

Preferred Qualifications: (We encourage you to apply even if you don't meet all of these)

  • Experience optimizing for NVIDIA Blackwell or Hopper GPUs.
  • Work on attention, mixture-of-experts kernels, grouped GEMMs, or low-rank adapters.
  • Experience implementing backward passes and validating gradients.
  • Familiarity with FP8, FP4, and quantized weight layouts.
  • Experience integrating custom operators into PyTorch, SGLang, vLLM, or similar frameworks.
  • Open-source contributions or a track record of shipping substantial kernel optimizations.

Logistics & Benefits

  • Location: Palo Alto, California.
  • Compensation: Depending on experience and skills the expected base pay is $200,000 - $420,000 USD per year, plus equity.
  • Benefits: Comprehensive health, dental, and vision insurance; unlimited PTO; and relocation assistance as needed.
  • Visa Sponsorship: We sponsor visas and are committed to supporting the process for the right candidate.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

Staff Software Engineer

LinkedIn · Mountain View, CA

$156k–$255k/yrFull-timeHybrid

StrongChecked open todayPosted 5 days ago

See more like this