Software Engineer jobs

AI Inference Engineer

Fuse EnergyRemote · US onlyFull-timePosted 11 days ago

Pay not listed

Looks real and checked open today.

On Fuse Energy’s own careers site (Workable).

Trust score after our next daily check

  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteWorkable board
  • Checked: Checked open todayWorkable board
  • Checked: No reposts foundWorkable board
  • Note: Too new for a trust scoreScored after our next daily check
See all 5 checksShow fewer
How we check

What you’ll do

  • Define the inference serving strategy and architecture.
  • Build request routing, batching, scheduling, and autoscaling for high-throughput, latency-sensitive workloads.
  • Optimize models for serving, including decisions about quantisation, distillation, and speculative decoding.
  • Translate performance and uptime commitments into technical specifications and serving capacity plans.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 4+ years building or operating large-scale inference serving systems, or equivalent strong project/industry experience
  • Comfort working directly with GPU/CUDA engineers to integrate low-level performance work into a serving system
  • Track record of making high-stakes architecture calls and owning the outcome
  • Comfort operating without a playbook in a founding role shaping a new function
  • Experience with autoscaling or capacity planning for large-scale inference (preferred)
  • Experience with multi-tenant serving or SLA-driven infrastructure (preferred)
  • Background at a hyperscaler, frontier AI lab, or large-scale distributed inference system (preferred)

Skills

  • Deep, hands-on experience with inference serving frameworks and optimization techniques, including batching, KV-cache management, quantisation, and speculative decoding
  • Ability to reason about the full path from incoming request to served response across a large cluster
  • Experience with Triton or custom ML inference/training frameworks (preferred)
  • Kubernetes or Slurm (preferred)

Other requirements

  • Interest in energy markets, grid systems, or sustainability-focused compute (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Private health insurance
Equity
Eligibility for equity
Bonus
Biannual bonus scheme
Meals
Breakfast and dinner allowance for office-based employees
Other
Fully expensed technology to match your needs

Full job description

From Fuse Energy’s careers site

Fuse Energy is an energy startup on a mission to make energy abundant and affordable, fast. We combine first-principles thinking with cutting-edge technology to build a radically better energy system.

We've raised over $200M from top-tier investors including Balderton, Lakestar, Accel, Creandum, Lowercarbon, Ribbit, 20VC, Hummingbird and Collaborative Fund, alongside strategic angels including Nico Rosberg and GPs behind Meta, Revolut, Spotify and Uber.

Show full descriptionShow less

We're building a fully integrated energy company: developing our own solar, batteries and other generation projects, building our own hardware, improving and developing grid infrastructure, trading power in real time, using AI across the business, and installing distributed energy in homes. By selling directly to consumers we cut out the middleman, lower costs and pass the savings on to our customers.

As data centres become one of the largest and fastest-growing sources of electricity demand, Fuse is expanding into high-performance compute infrastructure at the intersection of energy and AI. We're building the GPU/CUDA performance layer and the inference serving layer at the same time, from scratch, and we're looking for the founding engineer to own the latter. Reporting directly to the CTO, you'll own the layer above kernels and hardware: how models actually get served, scaled and delivered against committed performance targets. Few companies can pair real power delivery with real compute the way Fuse can, which puts inference serving at the heart of our offering.

Responsibilities

  • Define Fuse's inference serving strategy and architecture from first principles
  • Design and build the serving stack: request routing, batching, scheduling and autoscaling for high-throughput, latency-sensitive inference workloads
  • Own model-level optimisation strategy for serving, deciding where and how to apply quantisation, distillation, speculative decoding and similar techniques to improve throughput and cost per token, partnering with the CUDA/GPU engineers
  • Make the core software architecture calls on serving frameworks and orchestration (e.g. vLLM, TensorRT-LLM, SGLang, Triton Inference Server or equivalents)
  • Translate throughput, latency and uptime commitments into concrete technical specifications and serving capacity plans
  • Act as direct technical owner of inference performance and reliability
  • Work closely with the CUDA and GPU engineering teams to integrate custom kernels and hardware performance work cleanly into the serving layer
  • Set the standards, tooling and benchmarks this function will run on as it grows

Requirements

  • 4+ years building or operating large-scale inference serving systems, or equivalent strong project/industry experience
  • Deep, hands-on experience with inference serving frameworks and the techniques used to optimise them (batching, KV-cache management, quantisation, speculative decoding)
  • Strong systems thinking, able to reason about the full path from incoming request to served response across a large cluster
  • Comfortable working directly with GPU/CUDA engineers to integrate low-level performance work into a serving system
  • A track record of making high-stakes architecture calls and owning the outcome
  • Comfort operating without a playbook: this is a founding role shaping a new function, not joining an established one
  • Bonus: Triton or custom ML inference/training frameworks; autoscaling or capacity planning for large-scale inference; multi-tenant serving or SLA-driven infrastructure; background at a hyperscaler, frontier AI lab or large-scale distributed inference system; Kubernetes/Slurm; interest in energy markets, grid systems or sustainability-focused compute

Benefits

  • Competitive salary and eligibility for equity
  • Biannual bonus scheme
  • Fully expensed tech to match your needs
  • Private health insurance
  • Breakfast and dinner allowance for office-based employees

As we hire globally, benefits vary by location.

Something wrong with this job? Report it · This flag looks wrong

Similar remote jobs

AI Engineer III

Vericast · Remote · US only

$120k–$140k/yrFull-time

StrongChecked open todayPosted 3 days ago

See more like this