Software Engineer jobs

Member of Technical Staff - Kernels

Gimlet LabsSan Francisco, CAFull-timeOn-siteBachelor's degree or equivalent

$150k–$390k/yr listed by the employer

Above the typical $250k a year for staff-level Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 704 staff-level Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Looks real. 2 things to check before you apply.

On Gimlet Labs’ own careers site (Ashby), checked open today.

  • To check: Posted by the employer 8 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: Wide pay range: top of the range is 2.6× the bottomAsk what the job pays at your level before you interview.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 80 / 100 · Looks good
See all 7 checksShow fewer
How we check

What you’ll do

  • Build and optimize kernels for latency, throughput, and hardware utilization in production AI workloads.
  • Develop execution strategies across established and emerging accelerator architectures.
  • Improve memory efficiency, scheduling behavior, and execution characteristics across the inference stack.
  • Work with compiler, runtime, and distributed systems engineers on end-to-end performance optimization.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience working on performance-critical systems close to hardware
  • Experience with CUDA, Triton, CUTLASS, or other accelerator programming models (preferred)
  • Experience optimizing memory access patterns (coalescing, shared memory, cache behavior) (preferred)
  • Experience using profiling and performance analysis tools (preferred)
  • Familiarity with multi-GPU or distributed execution (preferred)

Education

  • Bachelor's degree in a relevant field, or an equivalent combination of education, training, and professional experience

Skills

  • Strong software engineering fundamentals
  • Comfort reasoning about low-level execution behavior, memory hierarchies, and performance tradeoffs
  • Deep understanding of GPU execution models (warps/wavefronts, blocks, grids) (preferred)
  • Familiarity with occupancy, latency hiding, and instruction-level parallelism (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Gimlet Labs’ careers site

About us

Gimlet is building the first multi-silicon neocloud designed for fast, efficient AI inference.

We combine large-scale compute infrastructure with an execution platform that partitions AI workloads and maps each stage to the hardware best suited to run it.

We work with foundation labs, hyperscalers, and AI-native companies, giving our team access to technical problems spanning frontier models, production infrastructure, and emerging hardware.

About the role

As a Member of Technical Staff, you will build and optimize the low-level execution primitives that turn accelerator performance into production inference performance.

Show full descriptionShow less

Rather than optimizing for one hardware architecture, you will work across accelerators with different execution models, memory hierarchies, capabilities, and software stacks. Your work will shape the latency, throughput, and efficiency Gimlet can achieve across established and emerging hardware architectures.

You will work close to the hardware across kernel implementation, memory access, execution behavior, profiling, and performance validation. You will develop optimizations that account for differences between accelerator architectures and partner with compiler, ML systems, and distributed systems engineers to improve performance across the full execution stack.

What success looks like

In the first 12-18 months, you will:

  • Build and optimize kernels that improve latency, throughput, and hardware utilization for production AI workloads
  • Develop execution strategies that unlock performance across both established and emerging accelerator architectures
  • Improve memory efficiency, scheduling behavior, and execution characteristics across the inference stack
  • Partner with compiler, runtime, and distributed systems engineers to ensure end-to-end performance optimization
  • Influence how heterogeneous hardware is deployed and utilized within the next generation of AI infrastructure
  • Help establish performance engineering standards that shape the future of Gimlet's execution platform

You may be a good fit if

  • Strong software engineering fundamentals
  • Experience working on performance-critical systems close to hardware
  • Comfort reasoning about low-level execution behavior, memory hierarchies, and performance tradeoffs
  • Bachelor's degree in a relevant field, or an equivalent combination of education, training, and professional experience.

Strong candidates may also have

  • Experience with CUDA, Triton, CUTLASS, or other accelerator programming models
  • Deep understanding of GPU execution models (warps/wavefronts, blocks, grids)
  • Experience optimizing memory access patterns (coalescing, shared memory, cache behavior)
  • Familiarity with occupancy, latency hiding, and instruction-level parallelism
  • Experience using profiling and performance analysis tools
  • Familiarity with multi-GPU or distributed execution is a plus

Why join now?

Gimlet is expanding from its core technology into a production neocloud spanning new hardware, customers, and data centers.

  • Solve hard problems.
  • Own meaningful work.
  • Build for production.
  • Help define what’s next.

Agency Policy: Gimlet Labs does not accept unsolicited resumes from recruitment agencies or search firms. Any unsolicited resumes submitted without a signed agreement will be considered the property of Gimlet Labs, and no fees will be paid.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

See more like this