Software Engineering jobs

Developer Relations Engineer

Vast.aiSan Francisco, CA +1 placeFull-timeOn-site

$160k–$200k/yr listed by the employer

Key facts

Schedule
Weekends
Where
San Francisco, CA · Los Angeles, CA · on-site

Looks real. 1 thing to check before you apply.

On Vast.ai’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 3 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Run workloads on Vast GPUs, including deploying, fine-tuning, and serving open-source models and keeping inference endpoints live.
  • Build public example repositories, Docker templates, and benchmarks for developers to use.
  • Create guides, short videos, talks, and livestreams explaining technical work.
  • Answer technical questions in community channels and represent Vast at hackathons and conferences.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Public proof of shipped work, such as a GitHub profile, technical writing, or live projects
  • Content or side projects that have found a real audience (preferred)
  • Previous developer relations, community, or customer-facing work (preferred)
  • Experience at a cloud, GPU, AI infrastructure, or developer tools company (preferred)

Skills

  • Take an open source model from Hugging Face to a running endpoint on rented GPUs independently
  • Linux, Docker, Python, and SSH
  • Debug GPU driver and CUDA mismatches, out-of-memory errors, and multi-GPU configuration issues including NCCL and topology
  • Explain technical topics clearly in writing and out loud
  • Knowledge of vLLM or SGLang internals (preferred)
  • Distributed training with FSDP or DeepSpeed (preferred)
  • CUDA (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Dental & vision
Dental and vision insurance
Retirement plan
401(k) with company match
Life & disability insurance
Life insurance
Meals
Meals on site
Other
Travel and conference budget

Also: health insurance, equity, bonus

Full job description

From Vast.ai’s careers site

ABOUT VAST.AI

Vast.ai runs one of the largest GPU marketplaces in the world. Over 20,000 GPUs, from RTX 4090s up to B300s, rented by more than 25,000 customers a month who train, fine-tune, and serve AI models on them. We are profitable, the team is flat, and we ship quickly. Your application goes straight to the hiring team.

THE ROLE

This is an engineering job that happens in public. You will be our heaviest user.

Show full descriptionShow less

Most of your week goes to renting GPUs on Vast and building things on them. Serving open source models with vLLM and SGLang. Fine-tuning. Running ComfyUI pipelines. Keeping live inference endpoints up, including token endpoints on markets like OpenRouter. Writing the example repos, Docker templates, and benchmarks that other developers copy.

The rest of your week is spent showing your work. Short videos, technical write-ups, answers in Discord and on Reddit, hackathons. You are not building the Vast product. You are using it harder than any of our customers, in the open, and reporting back everything that breaks.

If you want a content calendar and a campaign plan, this is the wrong job. If you already spin up GPUs on weekends because you want to see whether the new model actually runs, keep reading.

WHAT YOU'LL DO

  • Run real workloads on Vast every week. Deploy, fine-tune, and serve open source models, and keep live endpoints running.
  • Build public example repos, Docker templates, and benchmarks that developers can clone and use.
  • Turn what you build into teaching: guides, short videos, talks, livestreams.
  • Be the most technically credible voice in our Discord, on Reddit, and on X.
  • Represent Vast at hackathons and conferences, roughly one trip a month.
  • Report the friction, the breakage, and the missing docs straight to engineering and product.

WHAT WE NEED TO SEE

  • You can take an open source model from Hugging Face to a running endpoint on rented GPUs with nobody helping you. Linux, Docker, Python, SSH.
  • You can debug the GPU stack. Driver and CUDA mismatches, out of memory errors, and multi-GPU configuration including NCCL and topology issues do not scare you.
  • Public proof of work you have shipped. A GitHub profile, technical writing, or live projects. We will ask you to walk us through code you wrote and explain the parts that went wrong.
  • You work without a roadmap and prefer it that way. Nobody here will hand you a task list.
  • You can explain a hard thing clearly, in writing and out loud.

NICE TO HAVE

  • Content or side projects that found a real audience.
  • Previous developer relations, community, or customer-facing work. Useful here, but it is a bonus and not the job.
  • vLLM or SGLang internals, distributed training with FSDP or DeepSpeed, CUDA.
  • Time at a cloud, GPU, AI infrastructure, or developer tools company.

FIRST 90 DAYS

  • Ship several public example projects on Vast, including at least one live serving endpoint.
  • Publish benchmarks or guides that developers actually use and pass around.
  • Become the recognizable technical voice in our community channels.
  • Represent Vast at a sponsored hackathon.

COMPENSATION & BENEFITS

$160,000 to $200,000 base, plus equity and bonus. Health, dental, vision, and life insurance. 401(k) with company match. Meals on site. Travel and conference budget. This role is on site in San Francisco or Los Angeles.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 2 days ago

Staff Production Engineer

Zscaler · Santa Clara, CA +1 place

$152k–$190k/yrFull-timeHybrid

StrongChecked open todayPosted today

Senior Platform Engineer

Arta Finance · Bay Area, CA

$110k–$205k/yrFull-timeHybrid

StrongChecked open todayPosted yesterday

See more like this