Software Engineer jobs

Senior Systems Engineer - AI Infrastructure

Clockwork.ioPalo Alto, CAOn-sitePosted 1 month ago

$150k–$210k/yr listed by the employer

Below the typical $210k a year for senior Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 1,292 senior Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Looks real and checked open today.

On Clockwork.io’s own careers site (Greenhouse).

  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

What you’ll do

  • Design and implement low-level systems software for GPU clusters.
  • Modify and extend internals of frameworks and runtimes such as PyTorch, NCCL, and CUDA runtime.
  • Build components to improve the reliability and efficiency of large-scale GPU training.
  • Debug complex distributed and concurrent systems with subtle, non-deterministic failures.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Systems building experience designing and building complex systems
  • Experience reasoning about distributed system behavior, including consistency, ordering, and partial failures
  • GPU programming (CUDA) or GPU systems experience (preferred)
  • ML framework or runtime internals (preferred)
  • Cluster scheduling or orchestration systems (preferred)

Skills

  • Strong C/C++ in systems contexts
  • Deep understanding of concurrency and memory models
  • Ability to read and modify large, unfamiliar codebases
  • High-performance networking (RDMA, InfiniBand) (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Equity
Eligible to participate in the company equity program, which may include stock options, subject to the equity plan, approval, and applicable vesting schedules.
Meals
Catered lunch

Full job description

From Clockwork.io’s careers site

About Clockwork Systems

Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization

Show full descriptionShow less

Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination. Clockwork is pioneering a software-driven approach to AI fabrics by delivering cross-stack observability to catch and quickly resolve problems, workload fault tolerance to keep jobs running through failures, and performance acceleration that dynamically routes and paces traffic to avoid congestion.

To learn more, visit www.clockwork.io.

About the Role

We're building infrastructure for fault-tolerant, high-performance distributed GPU training. You'll work at the intersection of GPU systems, high-speed networking, and distributed coordination—designing and implementing systems that run at scale.

This is a systems building role. You'll dig into internals, understand why things break under pressure, and design solutions that handle the messy reality of distributed systems.

What You'll Do

  • Design and implement low-level systems software for GPU clusters
  • Work with internals of frameworks like PyTorch, NCCL, CUDA runtime—not as a user, but modifying and extending them
  • Build components that make large-scale GPU training more reliable and efficient
  • Debug complex distributed/concurrent systems where failures are subtle and non-deterministic
  • Own systems end-to-end: from design through production

What We're Looking For

Required: Systems building experience

You've designed and built complex systems—not just deployed or operated them. Examples:

  • Kernel subsystems, device drivers, or OS-level components
  • Distributed storage, databases, or coordination systems
  • Runtimes, profilers, or performance tooling
  • Network stacks, protocols, or high-performance I/O systems
  • Large-scale infrastructure at the systems layer

Core technical skills:

  • Strong C/C++ in systems contexts
  • Deep understanding of concurrency, memory models.
  • Experience reasoning about distributed system behavior: consistency, ordering, partial failures
  • Comfortable reading and modifying large, unfamiliar codebases

Nice to have:

  • GPU programming (CUDA) or GPU systems experience
  • High-performance networking (RDMA, InfiniBand)
  • ML framework or runtime internals
  • Cluster scheduling or orchestration systems

We believe strong systems engineers pick up domain-specific tools quickly. We value your ability to reason about complex systems over checkbox familiarity with our specific stack.

Enjoy

  • Challenging projects.
  • A friendly and inclusive workplace culture.
  • Competitive compensation.
  • A great benefits package.
  • Catered lunch.

Compensation for this position will vary based on the skills and experience you bring, as well as internal equity considerations. For candidates hired at the posted level, the expected base salary range is $150,000 - $210,000. In addition to cash compensation, this role is eligible to participate in the company’s equity program, which may include stock options granted in accordance with the company’s equity plan and subject to approval and applicable vesting schedules.

Clockwork Systems is an equal opportunity employer. We are committed to building world-class teams by welcoming bright, passionate individuals from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, religion, age, sex, sexual orientation, gender identity or expression, national origin, disability, or protected veteran status. We believe diversity drives innovation, and we grow stronger together.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

See more like this