Machine Learning Engineer jobs

Sr. Model Engineer, Multimodal Understanding

SpaceXSIPalo Alto, CA

$220k–$357k/yr listed by the employer

Above the typical $235k a year for senior Machine Learning Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 158 senior Machine Learning Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

This job is closed.

The employer took it down 12 days ago, after 9 days open. Here are similar open jobs.

  • To check: Posted by the employer 6 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 80 / 100 · Looks good
See all 5 checksShow fewer
How we check

Similar open jobs

Machine Learning Engineer

Voyager Technologies, Inc. · El Segundo, CA

$120k–$280k/yr · see postingOn-site

Wide pay rangeChecked open todayPosted 8 days ago

AI Research Engineer III

Agility Robotics · Fremont, CA +2 places

$166k–$260k/yrFull-timeHybrid

StrongChecked open todayPosted 11 days ago

See more like this

What you’ll do

  • Build and optimize distributed systems and high-throughput data pipelines for multimodal model training, inference, and data processing.
  • Improve multimodal understanding and generation across images, video, audio, and text, including real-time processing, reasoning, and world modeling.
  • Curate and analyze multimodal data, and develop evaluation frameworks, benchmarks, reward models, and metrics.
  • Develop algorithms, modeling approaches, and scaling methods for improved model performance.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
  • Experience training neural networks with 1B+ parameters (pretraining, post-training, fine-tuning, or RL training)
  • Track record building or optimizing large-scale distributed ML systems, including training or inference optimization, GPU utilization, multi-GPU/TPU setups, or hardware co-design (preferred)
  • Experience designing and running large-scale data pipelines, especially for noisy or real-world multimodal data (preferred)
  • Experience leading major model capability improvements through data, modeling, algorithms, or scaling (preferred)
  • Hands-on experience with large-scale orchestration tools such as Spark, Ray, or Kubernetes (preferred)
  • Background building full-stack tooling, real-time research demos or apps, or end-to-end products (preferred)

Skills

  • Expert-level proficiency in Python and strong experience with at least one of JAX, PyTorch, or XLA (preferred)
  • Fundamentals in evaluation design, benchmarks, reward modeling, or RL techniques, particularly for interactive or agentic behaviors (preferred)
  • Familiarity with multimodal LLMs, scaling laws, tokenizers, compression techniques, reasoning, or agentic systems (preferred)
  • Proficiency in Rust and/or C++ for performance-critical components (preferred)

Benefits

Health insurance
Comprehensive medical coverage
Dental & vision
Vision and dental coverage
Retirement plan
Access to a 401(k) retirement plan
Life & disability insurance
Short- and long-term disability insurance and life insurance
Other
Various discounts and perks

Also: equity

Full job description

From SpaceXSI’s careers site

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.

Show full descriptionShow less

SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next.

SR. MODEL ENGINEER, MULTIMODAL UNDERSTANDING

You will join the multimodal team to push toward superhuman multimodal intelligence. Advance understanding and generation across modalities—image, video, audio, and text—spanning the full stack: data curation/acquisition, tokenizer training, large-scale pre-training, post-training/alignment, infrastructure/scaling, evaluation, tooling/demos, and end-to-end product experiences.

Collaborate cross-functionally with pre-training, post-training, reasoning, data, applied, and product teams to deliver frontier capabilities in multimodal reasoning, world modeling, tool use, agentic behaviors, and interactive human-AI collaboration. Contribute to building models that can see, hear, reason about, and interact with the world in real time at unprecedented levels.

RESPONSIBILITIES:

  • Design, build, and optimize large-scale distributed systems for multimodal pre-training, post-training, inference, data processing, and tokenization at web/petabyte scale
  • Develop high-throughput pipelines for data acquisition, preprocessing, filtering, generation, decoding, loading, crawling, visualization, and management (images, videos, audio + text)
  • Advance multimodal capabilities including spatial-temporal compression, cross-modal alignment, world modeling, reasoning, emergent abilities, audio/image/video understanding & generation, real-time video processing, and noisy data handling
  • Drive data quality and studies: curation (human/synthetic), filtering techniques, analysis, and scalable pipelines to support trillion-parameter models
  • Create evaluation frameworks, internal benchmarks, reward models, and metrics that capture real-world usage, failure modes, interactive dynamics, and human-AI synergy
  • Innovate on algorithms, modeling approaches, hardware/software/algorithm co-design, and scaling paradigms for state-of-the-art performance
  • Build research tooling, user-friendly interfaces, prototypes/demos, full-stack applications, and enable rapid iteration based on feedback
  • Work across the stack (pre-training → SFT/RL/post-training) to enable reasoning, tool calling, agentic behaviors, orchestration, and seamless real-time interactions

BASIC QUALIFICATIONS:

  • Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
  • Experience training large models (e.g., pretraining, post-training, fine-tuning, or RL training of neural networks with 1B+ parameters)

PREFERRED SKILLS AND EXPERIENCE:

  • Expert-level proficiency in Python (core language), with strong experience in at least one of: JAX / PyTorch / XLA
  • Proven track record building or optimizing large-scale distributed ML systems (training/inference optimization, GPU utilization, multi-GPU/TPU setups, hardware co-design)
  • Deep experience designing and running data pipelines at scale: curation, filtering, generation, quality studies, especially for noisy/real-world multimodal data
  • Strong fundamentals in evaluation design, benchmarks, reward modeling, or RL techniques (particularly for interactive/agentic behaviors)
  • Proactive self-starter who thrives in high-intensity environments and is passionate about pushing multimodal AI frontiers
  • Willingness to own end-to-end initiatives and do whatever it takes to deliver breakthrough user experiences
  • Experience leading major improvements in model capabilities through better data, modeling, algorithms, or scaling
  • Familiarity with state-of-the-art in multimodal LLMs, scaling laws, tokenizers, compression techniques, reasoning, or agentic systems
  • Proficiency in Rust and/or C++ for performance-critical components
  • Hands-on work with large-scale orchestration tools such as Spark, Ray, or Kubernetes
  • Background building full-stack tooling: performant interfaces, real-time research demos/apps, or end-to-end product ownership
  • Passion for end-to-end user experience in interactive, real-time multimodal AI systems

COMPENSATION AND BENEFITS:

$220,000 - $357,000 USD

Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

SpaceXSI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

Something wrong with this job? Report it · This flag looks wrong