Software Engineer jobs

Software Engineer, River API

River AI Inc.Palo Alto, CAOn-site

$200k–$420k/yr listed by the employer

Above the typical $210k a year for Software Engineer jobs in California (all levels)How we compare

How we compare. Typical is the median yearly pay of 3,397 Software Engineer jobs in California (all levels) that list pay, from the employers' own postings. About means within 5%.

Key facts

Degree
Bachelor's degree or equivalent
US visa
Sponsors US visas

Looks real. 2 things to check before you apply.

On River AI Inc.’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 6 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: Wide pay range: top of the range is 2.1× the bottomAsk what the job pays at your level before you interview.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 80 / 100 · Looks good
See all 7 checksShow fewer
How we check

What you’ll do

  • Architect and deploy fault-tolerant distributed systems for training and inference across large clusters.
  • Design high-performance kernels and optimize tensor operations, memory throughput, and networking.
  • Profile systems end to end and resolve bottlenecks across hardware, software, data loading, and collective communication.
  • Work with research scientists to implement, optimize, and scale experimental model architectures.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Hands-on experience with PyTorch, JAX, or other modern AI frameworks and tooling for large-scale model training (preferred)
  • Track record of shipping and maintaining high-performance distributed systems or low-level software libraries (preferred)

Education

  • Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical industry experience

Skills

  • Deep expertise in C, C++, or Rust, with a track record of writing performant, maintainable code
  • Strong foundation in computer architecture, memory management, and concurrent programming
  • Exceptional debugging skills, especially with complex, non-deterministic issues in distributed environments
  • Deep familiarity with modern NVIDIA or AMD GPU architectures and hardware constraints such as HBM bandwidth and PCIe limits (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Comprehensive health insurance
Dental & vision
Comprehensive dental and vision insurance
Paid time off
Unlimited PTO
Relocation help
Relocation assistance as needed
Other
Visa sponsorship and support with the process for the right candidate

Also: equity

Full job description

From River AI Inc.’s careers site

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructure, next-generation UIs, and frontier deep learning research.

Who we are

We are scientists, engineers, and builders from the industry's top tech companies and AI labs. We bring a proven track record of scaling consumer systems for hundreds of millions of users and architecting the pre-training infrastructure behind today's frontier models.

About the Role

Show full descriptionShow less

We are looking for exceptional systems engineers to build the high-performance engines that train our models. Your goal is to make training at River fast, reliable, and massively scalable.

You will take ownership of our core infrastructure stack; from writing custom GPU kernels to managing clusters of thousands of nodes, ensuring our researchers can focus on science rather than system bottlenecks.

What You’ll Do

  • Architect and deploy fault-tolerant distributed systems for training and inference workloads across clusters with thousands of nodes.
  • Design high-performance kernels to maximize tensor operation efficiency, memory throughput, and networking over InfiniBand/RDMA.
  • Profile systems end-to-end to resolve blockers across hardware, software, data loading pipelines, and collective communication primitives.
  • Partner directly with research scientists to rapidly implement, optimize, and scale experimental model architectures.

Skills & Qualifications

Minimum Qualifications:

  • Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical industry experience.
  • Deep expertise in systems-level languages (C, C++, or Rust) with a track record of writing performant, maintainable code.
  • Strong foundation in computer architecture, memory management, and concurrent programming.
  • Exceptional debugging skills, especially when tackling complex, non-deterministic issues in distributed environments.
  • A highly collaborative mindset and a bias for action to push boundaries across the stack.

Preferred Qualifications: (We encourage you to apply even if you don't meet all of these)

  • Hands-on experience with modern AI frameworks (e.g., PyTorch, JAX) and tooling for large-scale model training.
  • Deep familiarity with modern GPU architectures (NVIDIA/AMD) and hardware constraints (HBM bandwidth, PCIe limits).
  • A proven track record of shipping and maintaining high-performance distributed systems or low-level software libraries.

Logistics & Benefits

  • Location: Palo Alto, California.
  • Compensation: Depending on experience and skills the expected base pay is $200,000 - $420,000 USD per year, plus equity.
  • Benefits: Comprehensive health, dental, and vision insurance; unlimited PTO; and relocation assistance as needed.
  • Visa Sponsorship: We sponsor visas and are committed to supporting the process for the right candidate.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

Staff Software Engineer

LinkedIn · Mountain View, CA

$156k–$255k/yrFull-timeHybrid

StrongChecked open todayPosted 5 days ago

See more like this