AI Research Engineer III
Agility Robotics · Fremont, CA +2 places
$166k–$260k/yrFull-timeHybrid
Together AISan Francisco, CAInternshipHybridMaster's degreePosted 1 month ago
$58–$70/hr listed by the employer
Hours vary, so we don't estimate a year.
The employer took it down 4 days ago, after 17 days open. Here are similar open jobs.
Agility Robotics · Fremont, CA +2 places
$166k–$260k/yrFull-timeHybrid
Bosch Group · Sunnyvale, CA
$160k–$180k/yrFull-timeHybrid
Anthropic · San Francisco, CA +1 place
$500k–$850k/yrHybrid
Bosch Group · Sunnyvale, CA
$185k–$215k/yrFull-timeHybrid
Maven Robotics · Santa Clara, CA
$175k–$350k/yr · see posting
Databricks · New York City, NY +1 place
$164k–$235k/yr
Summarised from the posting by AI and can be wrong. The full description is the source.
From Together AI’s careers site
About the Role
The Speculative Decoding team at Together AI builds the draft models and algorithms that let large language models generate faster without changing their outputs. Our speculators run in production on frontier open models such as DeepSeek, Kimi and GLM. Our work sits at the intersection of model training, inference algorithms and serving systems, and we co-design all three to lower the cost and latency of generation.
As a research intern, you will dive into open questions in speculative decoding: new drafter architectures and verification schemes, knowledge distillation and training recipes that align draft and target models, and drafters that adapt as traffic shifts. You will train and fine-tune draft models at scale on dedicated GPU clusters, and test your ideas against realistic serving workloads, including long-context and agentic traffic.
Projects aim to answer important research questions in speculative decoding, enabling faster generation on frontier models, drafters that keep pace with changing workloads, and robust, reproducible evaluation under real traffic.
Past Research
Speculative decoding research by Together researchers, interns and academic collaborators includes:
Responsibilities
Requirements
Preferred Qualifications
About Together AI
Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.
Internship Program Details
Our internship program runs 12 to 14 weeks, giving you the opportunity to work alongside industry-leading engineers and researchers across multiple teams. This cohort's internship dates span May 17th to August 6th or June 14th to September 3rd.
Compensation
We offer competitive compensation, housing stipends, and other competitive benefits. The estimated US hourly rate for this role is $58 - $70 an hour. Our hourly rates are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Application Policy
Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
For more information about our privacy policy, please visit: https://www.together.ai/privacy
Something wrong with this job? Report it · This flag looks wrong