DevOps, SRE & Cloud Engineer jobs

Site Reliability Engineer (SRE)

MithrilPalo Alto, CA +1 placeHybrid

Pay not listed

Key facts

Where
Palo Alto, CA · San Francisco, CA · hybrid
Degree
PhD

Looks real. 2 things to check before you apply.

On Mithril’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 7 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listed, though one is likely required in CAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: No reposts foundGreenhouse board
  • Trust score 70 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Implement and own SLIs and SLOs for the API layer and internal orchestration services.
  • Build and maintain monitoring dashboards, alerts, distributed tracing, and tools for tracking GPU availability, provider health, and reservation fill rates.
  • Develop and maintain Terraform or Pulumi modules and Kubernetes configurations for multi-cloud infrastructure.
  • Write Python or Go tools to automate operational tasks, provider API reconciliation, health checks, and capacity rebalancing.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3+ years of experience in SRE, Production Engineering, or Infrastructure roles at a high-growth technology company
  • Built infrastructure or automation that is still running in production
  • Experience with GPU/TPU-accelerated workloads or AI/ML infrastructure (preferred)
  • Exposure to multi-cloud deployments or specialized cloud providers such as CoreWeave, Lambda Labs, or Nebius (preferred)
  • Production experience with Prometheus, Grafana, or OpenTelemetry (preferred)
  • Experience in a high-growth startup environment where infrastructure scope expands faster than headcount (preferred)

Skills

  • Hands-on Kubernetes experience managing clusters and deployments and troubleshooting production incidents in a multi-tenant environment
  • Proficiency with at least one major cloud provider: AWS, GCP, or Azure
  • Practical understanding of cloud networking fundamentals, including VPC, DNS, load balancing, and security groups
  • Proficiency in Python or an equivalent language such as Go or Rust
  • Strong command of Linux systems, TCP/IP networking, and security best practices
  • Familiarity with distributed systems concepts, including service discovery, circuit breakers, and consensus protocols (preferred)

Other requirements

  • Able to document processes and explain technical trade-offs to engineering and non-engineering teammates
  • Primarily work from the local Palo Alto or San Francisco office, with at least one day per week at headquarters

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Health coverage for you and your dependents
Dental & vision
Dental and vision coverage for you and your dependents
Retirement plan
401(k) plan with company match
Paid time off
14 company holidays, including 2 floating holidays

Full job description

From Mithril’s careers site

About Mithril

Mithril is an AI infrastructure platform built to make GPU compute more accessible and affordable for the world’s leading enterprises, AI startups, and the AI research community, including LG AI Research, Saronic, and the Broad Institute (among many others). Founded by a former Google DeepMind research scientist and Stanford CS PhD, Mithril has raised $80M across seed and Series A funding led by Sequoia Capital & Lightspeed Venture Partners. Platform revenue has grown >6x over the past year, and we were recently recognized by Fast Company as the 8th Most Innovative Company in Artificial Intelligence for 2026.

Show full descriptionShow less

Our engineering team is lean and high-impact. This role is a core infrastructure hire that will shape how Mithril scales its platform across a heterogeneous, multi-cloud environment.

About the Opportunity

You will be a core contributor to the stability and performance of Mithril's global GPU orchestration platform. This is not a 'keep the lights on' role — you will build the automation, observability, and tooling that allows Mithril to coordinate advanced compute across multiple cloud providers at scale, ensuring customers have fast, reliable access to the infrastructure they need.

You will work directly with our founding team on high-impact infrastructure decisions — from SLO design to capacity orchestration — with clear visibility into the technical and commercial dynamics of the business.

What Makes This Role Different

Most SRE roles at this stage are primarily reactive — on-call, incident management, keeping services stable. At Mithril, you'll also be building infrastructure that directly shapes how our marketplace operates: how supply is sourced, allocated, and monitored across providers. The systems you build will have a direct line to customer experience and company revenue.

You'll have real ownership, a short feedback loop to leadership, and the opportunity to define how infrastructure engineering operates as the company scales.

Core Responsibilities

Platform reliability and infrastructure automation are the primary focus of this role (~70–75% of time).

Reliability & SLOs

  • Implement and own SLIs and SLOs across Mithril's API layer and internal orchestration services to ensure customer commitments are met.
  • Partner with Product and Platform teams to ensure new features are designed for operability, reliability, and performance from the start.
  • Participate in an on-call rotation; drive root cause analysis (RCA) for production incidents and implement durable fixes to prevent recurrence.

Observability & Monitoring

  • Build and maintain dashboards, alerts, and distributed tracing within Mithril's monitoring stack to provide high-granularity visibility into our multi-cloud infrastructure.
  • Own the tooling that surfaces supply-side signal — GPU availability, provider health, reservation fill rates — to both engineering and operations teams.

Infrastructure as Code & Automation

  • Develop and maintain Terraform/Pulumi modules and Kubernetes configurations to manage Mithril's growing multi-cloud provider footprint.
  • Write clean, maintainable Python (or Go) to automate repetitive operational tasks — from provider API reconciliation to automated health checks and capacity rebalancing.

Capacity Support

  • Assist in managing GPU capacity across providers, ensuring the marketplace can dynamically respond to supply fluctuations and customer demand signals.
  • Surface capacity constraints and failure modes early; contribute to the tooling that enables Mithril to make fast, data-driven supply decisions.

Requirements

The profile we're hiring for combines strong systems instincts with the ability to build and own tooling end-to-end. Candidates should be able to point to infrastructure or automation they've built that is still running in production.

  • 3+ years of experience in SRE, Production Engineering, or Infrastructure roles at a high-growth technology company.
  • Hands-on Kubernetes experience: comfortable managing clusters, deployments, and troubleshooting production incidents in a multi-tenant environment.
  • Cloud proficiency in at least one major provider (AWS, GCP, or Azure), including practical understanding of cloud networking fundamentals (VPC, DNS, load balancing, security groups).
  • Coding ability: proficiency in Python or equivalent (Go, Rust, etc.) — you build tools and services, not just scripts. Willing to pick up new languages as needed.
  • Linux fundamentals: strong command of Linux systems, TCP/IP networking, and security best practices.
  • Disciplined troubleshooter: calm under pressure during production incidents, with a rigorous approach to RCA and long-term remediation.
  • Clear communicator: able to document processes and explain technical trade-offs to engineering and non-engineering teammates.

Nice to Have

  • Experience with GPU/TPU-accelerated workloads or AI/ML infrastructure.
  • Exposure to multi-cloud deployments or niche/specialized cloud providers (e.g., CoreWeave, Lambda Labs, Nebius).
  • Familiarity with distributed systems concepts — service discovery, circuit breakers, consensus protocols.
  • Production experience with Prometheus, Grafana, or OpenTelemetry.
  • Prior experience in a high-growth startup environment where infrastructure scope expands faster than headcount.

Benefits

  • Health, dental, and vision coverage for you and your dependents
  • 401k Plan with company match
  • 14 company holidays; including 2 floating holidays

Salary Range Information

In consideration of market analysis and various pertinent factors, the remuneration bracket for this role is set between $170,000 and $230,000. Nevertheless, adjustments beyond this range could be warranted for candidates whose qualifications substantially deviate from those delineated in the job description.

In-Office Requirement

At Mithril, we take our work extremely seriously, though not always ourselves. We recognize that we are striving to achieve something substantial—an all-too-rare and elusive counterfactual contribution. Our work is not easy, so we seek out any lever that can accelerate our progress and increase the likelihood of realizing our full ambitions. Working collaboratively in person is one such lever.

Our headquarters is in Palo Alto (very near the Caltrain station) and we recently opened a second office in the Jackson Square area of San Francisco. We expect team members to primarily work from their local office (Palo Alto or SF), with everyone gathering at HQ a minimum one day a week while our team remains small and cross-collaboration is critical.

This approach is built on trust. We take our mission seriously and are committed to fostering an environment where you can make impactful decisions and drive success. We also understand that life can present challenges, and if extenuating circumstances arise, we’re here to support you.

Ultimately, we believe this guidance helps us be as effective as possible while maintaining the spirit of teamwork and flexibility.

We emphasize that candidates need not fulfill every expectation listed to be eligible for this position. Our objective is to cultivate a diverse team encompassing a spectrum of backgrounds, experiences, and skill sets.

Equal Opportunity Employer

Mithril maintains a strict commitment to Equal Opportunity employment practices. All applicants are evaluated without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

See more like this