Machine Learning Engineer jobs

Machine Learning Engineer - Inference

Together AISan Francisco, CAFull-time3+ years experience

$200k–$300k/yr listed by the employer

Above the typical $197k a year for mid-level Machine Learning Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 59 mid-level Machine Learning Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

1 thing to check before you apply.

On Together AI’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 2 years agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 65 / 100 · Check details
See all 6 checksShow fewer
How we check

What you’ll do

  • Design and build production systems for the inference engine, with a focus on reliability and performance at scale.
  • Develop and optimize runtime inference services for large-scale AI applications.
  • Collaborate with researchers, engineers, product managers, and designers to deliver features and research capabilities.
  • Conduct design and code reviews.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3+ years of experience writing high-performance, well-tested, production-quality code
  • Demonstrated experience building high-performance libraries and tooling

Skills

  • Proficiency with Python and PyTorch
  • Excellent understanding of low-level operating systems concepts, including multithreading, memory management, networking, storage, performance, and scale
  • Knowledge of AI inference systems such as TGI, vLLM, TensorRT-LLM, or Optimum (preferred)
  • Knowledge of AI inference techniques such as speculative decoding (preferred)
  • Knowledge of CUDA or Triton programming (preferred)
  • Knowledge of Rust, Cython, or compilers (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Equity
Startup equity

Also: health insurance

Full job description

From Together AI’s careers site

About the Role

Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems. This role involves working with state-of-the-art large language models models and ensuring they run efficiently and effectively at scale. If you are passionate about AI inference, PyTorch, and developing high-performance systems, we want to hear from you. This position offers the chance to collaborate closely with AI researchers and engineers to create cutting-edge AI solutions. Join us in shaping the future at Together AI!

Responsibilities

Show full descriptionShow less
  • Design and build the production systems that power the Together AI inference engine, enabling reliability and performance at scale.
  • Develop and optimize runtime inference services for large-scale AI applications.
  • Collaborate with researchers, engineers, product managers, and designers to bring new features and research capabilities to the world.
  • Conduct design and code reviews to ensure high standards of quality.
  • Create services, tools, and developer documentation to support the inference engine.
  • Implement robust and fault-tolerant systems for data ingestion and processing.

Requirements

  • 3+ years of experience writing high-performance, well-tested, production-quality code.
  • Proficiency with Python and PyTorch.
  • Demonstrated experience in building high performance libraries and tooling.
  • Excellent understanding of low-level operating systems concepts including multi-threading, memory management, networking, storage, performance, and scale.
  • Preferred: Knowledge of existing AI inference systems such as TGI, vLLM, TensorRT-LLM, Optimum
  • Preferred: Knowledge of AI inference techniques such as speculative decoding.
  • Preferred: Knowledge of CUDA/Triton programming.
  • Nice to have: Knowledge of Rust, Cython and compilers.

About Together AI

Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.

Compensation

We offer competitive compensation, startup equity, health insurance, and other competitive benefits. The US base salary range for this full-time position is $200,000 - $300,000 + equity + benefits. Our salary ranges are determined by location, level, and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Application Policy

Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunities to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Machine Learning Engineer

Gotion, Inc. · Fremont, CA

$110k–$135k/yrFull-timeHybrid

StrongChecked open todayPosted 18 days ago

Machine Learning Engineer

Sift · San Francisco, CA +1 place

$170k–$240k/yrFull-timeHybrid

StrongChecked open todayPosted 24 days ago

See more like this