Machine Learning Engineer jobs

Member of Technical Staff (MTS) - Multimodal Foundation Models

Deeproute.aiFremont, CAMaster's degree

Pay not listed

Looks real. 2 things to check before you apply.

On Deeproute.ai’s own careers site (Workable), checked open today.

  • To check: Posted by the employer 5 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listed, though one is likely required in CAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteWorkable board
  • Checked: Checked open todayWorkable board
  • Checked: No reposts foundWorkable board
  • Trust score 80 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Develop scalable pretraining pipelines and training strategies for multimodal driving data and foundation models.
  • Research and improve self-supervised and multimodal learning methods, architectures, objectives, and training paradigms.
  • Evaluate model behavior through ablation studies, failure analysis, and representation probing.
  • Improve model efficiency and deployment through quantization, distillation, efficient attention, sparse architectures, inference acceleration, and serving optimization.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Hands-on experience with methods such as CLIP, DINO/DINOv2, MAE, contrastive learning, masked modeling, or MoE/scalable transformer architectures
  • Experience with video foundation models, long-context modeling, retrieval systems, efficient inference, distributed training, or model compression and deployment optimization (preferred)
  • Strong publication record in CVPR, ICCV, ECCV, NeurIPS, ICLR, or ICML (preferred)

Education

  • MS or PhD in Computer Vision, Machine Learning, Robotics, Computer Science, or a related field

Skills

  • Strong understanding of foundation models, self-supervised learning, representation learning, multimodal learning, and large-scale pretraining

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Deeproute.ai’s careers site

Focus

Multimodal Foundation Models · Representation Learning · Method Innovation

We are looking for strong technical builders and researchers who deeply understand foundation models and representation learning beyond simply applying existing frameworks.

Ideal candidates should have:

  • Strong experimental rigor
  • Solid systems and modeling intuition
  • Hands-on engineering ability
  • Interest in scalable multimodal AI systems for real-world autonomy

We value people who can bridge research and production, and who care about robustness, scalability, efficiency, and practical deployment in large-scale autonomous driving systems.

Responsibilities

1. Large-Scale Foundation Model Pretraining

Show full descriptionShow less
  • Develop scalable pretraining pipelines for large-scale multimodal driving data
  • Design and optimize training strategies for:
  • Vision-language-action models
  • Video foundation models
  • Long-context temporal modeling
  • Multimodal representation alignment
  • Improve:
  • Training stability
  • Data efficiency
  • Scaling efficiency
  • Representation robustness
  • Work on distributed training systems and large-scale model optimization using frameworks such as:
  • PyTorch Distributed
  • DeepSpeed
  • Megatron-LM

2. Representation Learning & Method Innovation

  • Design and improve self-supervised and multimodal learning methods for real-world autonomous driving systems
  • Conduct architecture-level research on:
  • Vision Transformers (ViT)
  • Video / temporal architectures
  • Multimodal fusion and alignment
  • Embedding and retrieval systems
  • Long-context and memory-efficient architectures
  • Explore and improve:
  • Pretraining objectives
  • Loss functions
  • Training paradigms
  • Generalization and robustness
  • Analyze model behavior through:
  • Rigorous ablation studies
  • Failure case analysis
  • Representation probing and evaluation

3. Efficient Foundation Models & Scalable Deployment

  • Improve the efficiency, scalability, and deployability of large multimodal foundation models for real-world autonomous driving systems
  • Work on areas such as:
  • Model quantization
  • Knowledge distillation
  • Efficient attention mechanisms
  • Sparse architectures and Mixture-of-Experts (MoE)
  • Long-context and memory-efficient modeling
  • Inference acceleration and serving optimization
  • Training and inference system efficiency
  • Optimize model throughput, latency, memory usage, and deployment performance for large-scale production environments

Requirements

  • MS or PhD in:
  • Computer Vision
  • Machine Learning
  • Robotics
  • Computer Science
  • Related fields
  • Strong understanding of:
  • Foundation models
  • Self-supervised learning
  • Representation learning
  • Multimodal learning
  • Large-scale pretraining
  • Hands-on experience with methods such as:
  • CLIP
  • DINO / DINOv2
  • MAE
  • Contrastive learning
  • Masked modeling
  • MoE or scalable transformer architectures
  • Experience with one or more of the following is highly valued:
  • Video foundation models
  • Long-context modeling
  • Retrieval systems
  • Efficient inference
  • Distributed training
  • Model compression and deployment optimization
  • Strong publication record in top-tier venues is preferred:
  • CVPR
  • ICCV
  • ECCV
  • NeurIPS
  • ICLR
  • ICML

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

See more like this