Software Engineer jobs

Member of Technical Staff - Distributed Systems

Gimlet LabsSan Francisco, CAFull-timeOn-siteBachelor's degree or equivalent

$150k–$390k/yr listed by the employer

Above the typical $250k a year for staff-level Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 706 staff-level Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Looks real. 2 things to check before you apply.

On Gimlet Labs’ own careers site (Ashby), checked open today.

  • To check: Posted by the employer 8 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: Wide pay range: top of the range is 2.6× the bottomAsk what the job pays at your level before you interview.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 80 / 100 · Looks good
See all 7 checksShow fewer
How we check

What you’ll do

  • Build scheduling and orchestration systems for heterogeneous compute and distributed inference pipelines.
  • Design systems to place, coordinate, route, recover, and operate workloads across infrastructure.
  • Improve reliability, fault tolerance, and resource management in production AI infrastructure.
  • Develop control planes and APIs for deploying and managing workloads.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience building or operating distributed systems in production
  • Experience with scheduling, resource management, RPC, or asynchronous messaging
  • Experience with Kubernetes or Kubernetes-adjacent systems beyond basic usage (preferred)
  • Experience designing service-oriented architectures using RPC or asynchronous messaging (preferred)
  • Familiarity with scheduling, queues, or resource management systems (preferred)
  • Experience building reliable APIs and operating systems under high load (preferred)
  • Software development experience in Go, C++, or Python (preferred)

Education

  • Bachelor’s degree in a relevant field or equivalent practical experience

Skills

  • Strong software-engineering and systems fundamentals
  • Ability to reason about concurrency, consistency, failure modes, and system tradeoffs

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Gimlet Labs’ careers site

About us

Gimlet is building the first multi-silicon neocloud designed for fast, efficient AI inference.

We combine large-scale compute infrastructure with an execution platform that partitions AI workloads and maps each stage to the hardware best suited to run it.

We work with foundation labs, hyperscalers, and AI-native companies, giving our team access to technical problems spanning frontier models, production infrastructure, and emerging hardware.

About the role

As a Member of Technical Staff, you will build the systems that schedule, route, and coordinate AI workloads across Gimlet’s infrastructure.

Show full descriptionShow less

Different stages of an inference pipeline may run on different hardware, scale independently, and exchange state across the system. Your work will determine how those workloads are placed, coordinated, routed, recovered, and operated in production.

You will work across scheduling, orchestration, control planes, APIs, and fault tolerance. You will design systems that make distributed infrastructure easier to operate, enable workloads to run reliably across a heterogeneous fleet, and partner with compiler, ML systems, networking, and infrastructure engineers to connect the full execution stack.

What success looks like

In the first 12-18 months, you will:

  • Build scheduling and orchestration systems for heterogeneous compute
  • Design systems that manage independently scalable stages of distributed inference pipelines
  • Improve the reliability and fault tolerance of production AI infrastructure
  • Develop control planes and APIs that simplify how workloads are deployed and managed
  • Improve resource management and scheduling as Gimlet expands across new accelerator types, nodes, and data centers
  • Help the platform scale across additional hardware, nodes, and data centers

You may be a good fit if you have

  • Experience building or operating distributed systems in production
  • Strong software-engineering and systems fundamentals
  • The ability to reason about concurrency, consistency, failure modes, and system tradeoffs
  • Experience with scheduling, resource management, RPC, or asynchronous messaging
  • A bachelor’s degree in a relevant field or equivalent practical experience

Strong candidates may also have

  • Experience with Kubernetes or Kubernetes-adjacent systems beyond basic usage
  • Experience designing service-oriented architectures using RPC or asynchronous messaging
  • Familiarity with scheduling, queues, or resource management systems
  • Experience building reliable APIs and operating systems under high load
  • Software development experience in languages commonly used for systems development (e.g., Go, C++, Python)

Why join now?

Gimlet is expanding from its core technology into a production neocloud spanning new hardware, customers, and data centers.

  • Solve hard problems.
  • Own meaningful work.
  • Build for production.
  • Help define what’s next.

Agency Policy: Gimlet Labs does not accept unsolicited resumes from recruitment agencies or search firms. Any unsolicited resumes submitted without a signed agreement will be considered the property of Gimlet Labs, and no fees will be paid.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer

talentpluto · San Francisco, CA

$165k–$250k/yrFull-timeOn-site

StrongChecked open todayPosted yesterday

See more like this