Software Engineer jobs

Kernel Engineer (Custom Silicon), Hardware

River AI Inc.Palo Alto, CA +1 place

$200k–$420k/yr listed by the employer

Key facts

Where
Palo Alto, CA · Austin, TX
Experience
5+ years
Degree
Bachelor's degree
US visa
Sponsors US visas

Looks real. 2 things to check before you apply.

On River AI Inc.’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 4 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: Wide pay range: top of the range is 2.1× the bottomAsk what the job pays at your level before you interview.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 90 / 100 · Strong
See all 7 checksShow fewer
How we check

What you’ll do

  • Build C++ code-generation frameworks that emit optimized assembly for custom silicon.
  • Implement and optimize deep learning kernels, including GEMM, attention, convolutions, and element-wise operations.
  • Tune instruction scheduling, register allocation, pipelining, tiling, buffering, and data movement for the hardware.
  • Work with compiler, RTL, architecture, and research teams to evaluate simulations and inform hardware design.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 5+ years of practical industry experience in low-level performance programming
  • Proven track record of shipping highly optimized kernels
  • Experience with advanced C++ template metaprogramming or code-generation techniques for parameterized kernel variants (preferred)
  • Experience with low-level hardware profiling tools, execution tracing, and performance counters (preferred)

Education

  • Bachelor’s degree in Computer Engineering, Computer Science, Electrical Engineering, or a related field

Skills

  • Deep understanding of hardware programming models such as CUDA, Triton, CUTLASS, or custom accelerator assembly
  • Advanced knowledge of computer architecture, including vector units, execution pipelines, register files, and memory hierarchies
  • Proficiency in modern C++ for meta-programming and code-generation frameworks
  • Strong mathematical foundation in linear algebra operations and deep learning primitives
  • Familiarity with microarchitectural optimizations for Tensor Cores, matrix multiply-accumulate units, or custom vector extensions (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Health benefits
Dental & vision
Dental and vision benefits
Paid time off
Unlimited PTO
Relocation help
Relocation support as needed

Also: equity

Full job description

From River AI Inc.’s careers site

At River, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, custom training infrastructure, next-generation UIs, and frontier deep learning research.

Who we are

We are scientists, engineers, and builders from the industry's top tech companies and AI labs. We bring a proven track record of scaling consumer systems for hundreds of millions of users and architecting the pre-training infrastructure behind today's frontier models.

About the Role

Show full descriptionShow less

We are looking for exceptional performance and kernel generation engineers to build the foundational compute engine for our high-performance custom silicon. In this role, you will design and implement robust kernel generators that programmatically emit optimized low-level assembly code for our greenfield hardware architecture.

You will bridge the gap between high-level compilation and raw hardware capability, pushing our custom architecture to its absolute theoretical limits for critical deep learning operations (including GEMMs, FlashAttention, and custom activations). You will collaborate closely up and down the stack with compiler engineers, silicon architects, and deep learning researchers to unlock maximum compute efficiency.

What You’ll Do

  • Kernel Generator Development: Design and build C++ code-generation frameworks and meta-programming toolchains that automatically emit optimized custom ISA assembly code.
  • Low-Level Compute Optimization: Author and optimize core deep learning primitives (GEMM/MatMul, Attention mechanisms, Convolutions, and element-wise layers) directly targeted at our custom hardware.
  • Microarchitectural Tuning: Hand-craft and automate instruction scheduling, register allocation, and software pipelining to maximize ALU utilization and hide execution latency on our silicon.
  • Memory Hierarchy Management: Design sophisticated tiling, double-buffering, and data-movement strategies to optimize on-chip SRAM utilization and minimize memory bandwidth bottlenecks.
  • HW/SW Co-Design: Partner with the RTL and architecture teams to evaluate hardware simulations, provide feedback on the ISA, and influence the design of future compute units based on kernel execution profiles.
  • Performance Profiling & Validation: Benchmark generated assembly against hardware simulators and silicon, utilizing hardware performance counters to eliminate performance gaps and ensure mathematical correctness.

Minimum Qualifications:

  • Bachelor’s degree in Computer Engineering, Computer Science, Electrical Engineering, or a related field, and 5+ years of practical industry experience in low-level performance programming.
  • Deep understanding of hardware programming models (e.g., CUDA, Triton, CUTLASS, or custom accelerator assembly) and a proven track record of shipping highly optimized kernels.
  • Advanced knowledge of Computer Architecture, including vector units, execution pipelines, register files, and complex memory hierarchies (caches, SRAM, HBM/DRAM).
  • Proficiency in modern C++ for building robust, scalable meta-programming and code-generation frameworks.
  • Strong mathematical foundation in linear algebra operations and deep learning primitives.
  • A highly collaborative mindset to push boundaries and co-design effectively with hardware and compiler teams.

Preferred Qualifications: (We encourage you to apply even if you don't meet all of these)

  • Deep familiarity with implementing microarchitectural optimizations for Tensor Cores, matrix multiply-accumulate units, or custom vector extensions.
  • Experience utilizing advanced C++ template metaprogramming or code-generation techniques to automate the creation of heavily parameterized kernel variants.
  • Advanced experience with low-level hardware profiling tools, execution tracing, and utilizing performance counters to identify cache misses, pipeline stalls, and ALU bubbles.

Logistics

  • Location: This role is based in Austin, Texas or Palo Alto, California.
  • Compensation: Depending on background, skills, experience, and location, the expected annual salary range for this position is $200,000 - $420,000 USD, plus equity.
  • Visa Sponsorship: We sponsor visas. We can't guarantee success for every candidate or role, but if you're the right fit, we're committed to working through the visa process.
  • Benefits: River AI offers generous health, dental, and vision benefits, unlimited PTO, and relocation support as needed.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

Staff Software Engineer

LinkedIn · Mountain View, CA

$156k–$255k/yrFull-timeHybrid

StrongChecked open todayPosted 5 days ago

See more like this