Senior Staff Software Engineer, AI Developer Experience
SoFi · San Francisco, CA +1 place
On-site

Together AIAmsterdam, NetherlandsPosted 1 month ago
Pay not listed
On Together AI’s own careers site (Greenhouse), checked open today.
This job is outside the US, so these US-only checks are not applied: pay-transparency law, pay likely required by state law, US visa sponsorship wording.
Summary, requirements and match are for US jobs for now.
From Together AI’s careers site
About the Role
Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the [Together GPU Clusters](https://www.together.ai/gpu-clusters) flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products.
As a Staff Software Engineer focusing on AI Compute in the Together Cloud org, you will set technical direction for and build major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware: GB300s/VRs, BlueField DPUs, InfiniBand and dual/quad-plane RoCEv2 fabrics. That virtualized computing platform powers our own SaaS products – inference, RL, and fine-tuning – and serves external cloud customers through self-serve offerings such as on-demand/reserved Kubernetes/Slurm clusters, across dozens of data centers and hundreds of thousands of GPUs.
This is an architect-and-build role. Fully automated bootstrapping of GPU data centers, high-performance virtualization of GPU compute and DC networking without compromising isolation or portability, and fault-tolerant decentralized control planes — you'll set the architecture for these across our global and in-DC services, and be a key owner of the hardest parts, in the code as well as the design. Your designs will span the IaaS layer of a greenfield Vera Rubin data center up to the global management plane that schedules capacity across all of them. At this level the job is as much leverage as code: the standards you set and the engineers you grow decide how fast the rest of Together Cloud ships.
Responsibilities
To be successful you'll need to be deeply technical and an excellent communicator — expert software development fundamentals, deep systems knowledge and troubleshooting instincts, and the leadership and diplomacy skills to align teams that don't report to you. Much of this work starts ambiguous, and we expect you to define the scope yourself and drive it to production.
Requirements
Preferred Qualifications (not must haves)
About Together AI
Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.
Application Policy
Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at https://www.together.ai/privacy
Something wrong with this job? Report it · This flag looks wrong

SoFi · San Francisco, CA +1 place
On-site
Looks goodPay not listedChecked open todayPosted 23 days ago

Together AI · San Francisco, CA
$250k–$320k/yrFull-time
StrongChecked open todayPosted 1 month ago

Together AI · Remote · US only
$250k–$330k/yrFull-time
StrongOpen 5 monthsChecked open todayPosted 5 months ago

Together AI · San Francisco, CA
$240k–$280k/yrFull-timeHybrid
StrongOpen 4 monthsChecked open todayPosted 4 months ago

Together AI · San Francisco, CA
$160k–$190k/yrFull-time
StrongOpen 4 monthsChecked open todayPosted 4 months ago

Together AI · Remote · US only
$270k–$300k/yrFull-time
StrongChecked open todayPosted 29 days ago