Machine Learning Engineer jobs

Machine Learning Scientist

Rime LabsRemote · US onlyFull-time

Pay not listed

Key facts

Degree
PhD or equivalent
US visa
Sponsors US visas

Looks real. 2 things to check before you apply.

On Rime Labs’ own careers site (Ashby), checked open today.

  • To check: Posted by the employer 6 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: No reposts foundAshby board
  • Trust score 75 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Design, train, and evaluate autoregressive and non-autoregressive speech synthesis models.
  • Research full- and half-duplex multimodal architectures, including unified S2S systems.
  • Select and iterate on speech representations such as neural codecs, semantic tokens, mel features, and continuous latents.
  • Build objective and perceptual evaluations for model quality and prosodic control.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Deep familiarity with contemporary and historical speech synthesis literature, including Tacotron, FastSpeech, VITS, VALL-E, and the codec-LM lineage
  • Hands-on training with neural codecs and experience with multiple speech representation choices
  • Experience with full- or half-duplex multimodal modeling
  • Working knowledge of TTS frontend behavior, including G2P, normalization, and prosody, and experience working with linguists
  • Attention to data quality, including detecting annotation pipeline degradation and evaluation-set leakage
  • Multilingual TTS experience (preferred)
  • Background in prosody or paralinguistics (preferred)
  • Published work in speech, audio, or core ML venues (preferred)
  • Experience taking research models to production, including quantization, distillation, or streaming inference (preferred)

Education

  • PhD or equivalent research experience in speech, audio, ML, or computational linguistics, or a track record that makes the credential irrelevant

Skills

  • Strong PyTorch fundamentals, including training loops, distributed training, and model internals

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Equity
Meaningful early-stage equity
Other
Competitive base compensation, Remote-friendly work, Access to a proprietary, full-duplex, studio-quality conversational speech corpus, Compute and tooling to do the work

Full job description

From Rime Labs’ careers site

MACHINE LEARNING SCIENTIST

Rime builds voice AI for enterprises running customer experiences at scale. Our text-to-speech models are purpose-built for high-volume conversational deployments, engineered for the pronunciation accuracy, latency, and deployment flexibility that production environments actually demand.

Show full descriptionShow less

We started from a different premise than the rest of the field: voice AI isn't bottlenecked by model architecture. It's bottlenecked by data. So before we trained a single model, we built our own corpus: full-duplex, studio-quality conversational speech, recorded and annotated by PhD linguists. That's our moat. It's also why enterprises pick Rime when pilots need to convert into production.

We're backed by top-tier investors including Unusual Ventures, and we've built a team at the intersection of product, research, and craft. Building voice models is an art. We intend to master it.

ROLE OVERVIEW

We're hiring a Machine Learning Scientist to push the frontier of speech synthesis and speech understanding at Rime.

What You'll Own

  • Design, train, and evaluate speech synthesis models, autoregressive and non-autoregressive.
  • Drive research on full-duplex and half-duplex multi-modal architectures, including unified S2S systems.
  • Choose and iterate on speech representations: neural codecs, semantic tokens, mel features, continuous latents.
  • Build rigorous evaluation, objective and perceptual. Hold the bar on quality and prosodic control.
  • Collaborate with our linguists on TTS frontend behavior so modeling and frontend choices reinforce each other.

WHAT WE'RE LOOKING FOR

  • Deep familiarity with the speech synthesis literature, contemporary and historical — Tacotron, FastSpeech, VITS, VALL-E, the codec-LM lineage. Opinions on what worked and why.
  • Hands-on training with neural codecs (EnCodec, DAC, Mimi, etc.) and multiple representation choices.
  • Experience with full- or half-duplex multi-modal modeling (Moshi, LLaMA-Omni, streaming S2S).
  • Strong attention to detail on data quality. You notice when an annotation pipeline is silently degrading or when an eval set has leakage.
  • Willing to roll up your sleeves on unglamorous data and training work — paired with the agency to build pipelines so the team isn't stuck doing it by hand.
  • Working knowledge of TTS frontend (G2P, normalization, prosody) and experience working with linguists.
  • Strong PyTorch fundamentals. Comfortable with training loops, distributed training, model internals.
  • PhD or equivalent research experience in speech, audio, ML, or computational linguistics or a track record that makes the credential irrelevant.

Nice to have

  • Multilingual TTS experience.
  • Background in prosody or paralinguistics.
  • Published work in speech, audio, or core ML venues.
  • Experience taking research models to production: quantization, distillation, streaming inference.

WHY JOIN RIME

  • Category-defining voice AI infrastructure, not incremental research deltas.
  • Direct collaboration with founders, including a CEO with a Stanford computational linguistics PhD.
  • Real impact on company trajectory.
  • Meaningful equity upside.
  • High ownership, high standards, low bureaucracy.

What We Offer

  • Competitive base + meaningful early-stage equity
  • Remote-friendly
  • Visa sponsorship available
  • Access to a proprietary, full-duplex, studio-quality conversational speech corpus
  • Compute and tooling to do the work
  • Direct influence on the future of voice AI

At Rime, we...

  • Are outliers
  • Cut through the hype to focus on the craft
  • Move fast with agency and freedom
  • Maintain a growth mindset, finding joy in the struggle
  • Do the right things, knowing that it'll lead to making money

If that sounds like you too, you'll be a great fit for Rime!

Something wrong with this job? Report it · This flag looks wrong

Similar remote jobs

See more like this