Machine Learning Engineer jobs

Pre-training Research Engineer

SciforiumSan Francisco, CAFull-timeOn-site

$165k–$225k/yr listed by the employer

Below the typical $235k a year for senior Machine Learning Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 157 senior Machine Learning Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Key facts

Experience
5+ years
Degree
Master's degree

Looks real. 1 thing to check before you apply.

On Sciforium’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 2 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Train large byte-native and multimodal foundation models on massive, heterogeneous corpora.
  • Implement and evaluate model architectures, training objectives, and optimization methods.
  • Develop pre-training recipes and run scaling experiments for novel architectures.
  • Conduct ablations and analyze training dynamics, model behavior, and base-model quality.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 5+ years of experience in machine learning research or engineering
  • Proven track record of developing and pre-training large language or multimodal foundation models
  • Hands-on experience running training workloads in GPU-based environments, with familiarity with distributed training
  • Extensive experience with the JAX, Flax, and XLA stack (preferred)
  • Experience with multi-node pre-training using systems such as FSDP, ZeRO, or Megatron (preferred)
  • Experience developing training recipes, ablations, or scaling experiments (preferred)
  • Experience owning end-to-end training and evaluation pipelines with monitoring and reproducibility (preferred)

Education

  • MS in Computer Science, Machine Learning, Artificial Intelligence, Mathematics, or a related field
  • PhD in Computer Science, Machine Learning, Artificial Intelligence, Mathematics, or a related field (preferred)

Skills

  • Strong general software engineering skills, including writing robust and performant training code
  • Solid understanding of deep learning fundamentals and modern pre-training methods and literature
  • Ability to quickly implement research ideas and evaluate them using clear baselines, ablations, metrics, and analysis

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Medical insurance
Dental & vision
Dental and vision insurance
Retirement plan
401(k) plan
Paid time off
Flexible time off
Meals
Daily lunch, snacks, and beverages
Other
Competitive salary

Also: equity

Full job description

From Sciforium’s careers site

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

ABOUT THE ROLE

Show full descriptionShow less

As a Pre-training Research Engineer, you’ll focus on model implementation, pertaining and scaling, and improving the quality of our byte-native and multimodal foundation models. You’ll build and iterate quickly on research ideas, contribute production-grade training code and infrastructure, and help deliver high-quality base models that can serve real-world use cases at scale.

KEY RESPONSIBILITIES

PRE-TRAINING & SCALING

  • Train large byte-native and multimodal foundation models across massive, heterogeneous corpora.
  • Implement and evaluate new model architectures, training objectives, and optimization methods.
  • Develop stable pre-training recipes and run scaling experiments for novel architectures.
  • Conduct ablations and analyze training dynamics, model behavior, and base-model quality.
  • Work with data and distributed training engineers to improve training efficiency, reliability, and scalability.

MUST-HAVES

  • 5+ years of experience in machine learning research or engineering, with a proven track record of developing and pre-training large language or multimodal foundation models.
  • Software Engineering: Strong general software engineering skills, with the ability to write robust and performant training code.
  • ML Foundations: Solid understanding of deep learning fundamentals and modern pre-training methods and literature.
  • Research and Experimentation: Ability to quickly implement research ideas and evaluate them using clear baselines, ablations, metrics, and analysis.
  • GPU and Distributed Training: Hands-on experience running training workloads in GPU-based environments, with familiarity with distributed training.
  • Education: MS in Computer Science, Machine Learning, Artificial Intelligence, Mathematics, or a related field.

NICE-TO-HAVES

  • PhD in Computer Science, Machine Learning, Artificial Intelligence, Mathematics, or a related field.
  • JAX Ecosystem: Extensive experience with the JAX, Flax, and XLA stack.
  • Large-Scale Distributed Training: Experience with multi-node pre-training using systems such as FSDP, ZeRO, or Megatron.
  • Training Recipes and Scaling: Experience developing training recipes, ablations, or scaling experiments.
  • Monitoring and Reproducibility: Experience owning end-to-end training and evaluation pipelines with monitoring and reproducibility.

EDUCATION

  • MS or PhD in Computer Science, Machine Learning, Artificial Intelligence, Mathematics, or a related field.

BENEFITS INCLUDE

  • Medical, dental, and vision insurance
  • 401k plan
  • Daily lunch, snacks, and beverages
  • Flexible time off
  • Competitive salary and equity

EQUAL OPPORTUNITY

Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

AI Research Engineer III

Agility Robotics · Fremont, CA +2 places

$166k–$260k/yrFull-timeHybrid

StrongChecked open todayPosted 10 days ago

Machine Learning Engineer

Gotion, Inc. · Fremont, CA

$110k–$135k/yrFull-timeHybrid

StrongChecked open todayPosted 18 days ago

See more like this