Machine Learning Engineer jobs

Applied AI Research and Engineering

OuterSignalNew York City, NYFull-timeHybrid

$200k–$300k/yr listed by the employer

About the typical $242k a year for Machine Learning Engineer jobs in New York (all levels)How we compare

How we compare. Typical is the median yearly pay of 191 Machine Learning Engineer jobs in New York (all levels) that list pay, from the employers' own postings. About means within 5%.

Looks real. 1 thing to check before you apply.

On OuterSignal’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 4 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Distill frontier-model enrichment pipelines into fine-tuned models and evaluate cost, quality, and throughput.
  • Design verifiers, graders, environments, and evaluations for multi-step enrichment agents; analyze failure modes and reward gaming.
  • Run post-training on open models and generate synthetic training data, measuring its impact.
  • Deploy trained models in production and route them alongside frontier APIs, monitoring cost, latency, and quality.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Strong software engineering, including production code, distributed systems, and data pipelines
  • Hands-on deep learning experience training or fine-tuning models
  • Post-training experience with SFT, DPO, or RL, especially RL with verifiers; full-model or LoRA training (preferred)
  • Experience with reward and verifier design or environments (preferred)
  • Open-source tools or reproductions used by others (preferred)
  • Public write-ups with ablations (preferred)
  • Publications (preferred)

Skills

  • Deep inference engineering, including vLLM or SGLang, quantization, or speculative decoding (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Equity
Meaningful equity in a venture-backed company
Other
Dedicated budget for training and research experiments

Full job description

From OuterSignal’s careers site

ABOUT OUTERSIGNAL

We are building the customer intelligence and personalization layer for consumer businesses. Every business knows when an order comes in or a user signs up, but they only see 5% of the real story.

We show them the other 95%: not just who’s buying, but who that person actually is. That includes the execs, influencers, journalists, retail buyers, investors, and everyday customers who become a brand’s best evangelists. Our platform enriches every customer in real time with professional and personal signals, builds personas, and powers everything from surprise-and-delight outreach to smarter email flows, analytics, and BD leads.

Show full descriptionShow less

We’re a small, high-performing team building the category-defining platform for customer intelligence, backed by a world-class investor base.

ABOUT THE ROLE

This is an applied research role for an engineer who can train and evaluate models. You will own the full loop: turn production traces into datasets, build the evals and verifiers that define "good", post-train open models (SFT, preference optimization, RL), and serve them in production at a fraction of the cost and latency of frontier models. Depending on your background, you'll join as a Research Engineer or Research Scientist; title and level follow your skillset and experience.

What You'll Work On

  • Distill multi-step, frontier-model enrichment pipelines into fine-tuned models, and prove with evals that cost, quality, and throughput improve.
  • Design verifiers, graders, and environments for our multi-step enrichment agents, where the answer is only partly checkable, then find out how a model games them.
  • Run post-training (DPO, GRPO) on open models against those verifiers and environments.
  • Build our eval suite from error analysis of real production traces: extraction accuracy, data quality, and end-to-end customer impact.
  • Ship the models you train: LoRA adapters trained with managed post-training APIs (like Tinker) and served by inference providers, routed alongside the frontier APIs they replace, with a clear read on cost, latency, and quality.
  • Generate synthetic training data, and measure whether it actually helps.
  • Ship all of it into our production pipelines (Temporal, Postgres, ClickHouse, Kubernetes) with observability on cost, latency, and quality.

Who You Are

  • A strong software engineer: you write production code, reason through distributed systems and data pipelines, and simplify aggressively.
  • You have hands-on deep learning experience: you've trained or fine-tuned models yourself, at work or in your own projects, and can tell us what broke and why.
  • You hunt for failure modes. When a metric goes up, your first question is how the model cheated: reward hacking, leaked labels, a grader that rewards format over substance. You reach for ablations, controls, and held-out evals before you believe a result.
  • You have taste: you know when to train, and when a better prompt, a better eval, or a smaller model is the real answer.
  • Strong signals: post-training: SFT, DPO, and especially RL with verifiers, full or LoRA; reward and verifier design, environments; open-source tools or reproductions others use; public write-ups with ablations. Publications are welcome but not required.
  • Bonus: deep inference engineering (vLLM/SGLang, quantization, speculative decoding) for when we bring serving in-house.

To apply: send links to one or two things you built (a repo, a reproduction, a write-up, a paper) and tell us about the most interesting failure you caught in your own work.

Why Join Now

  • Real compute for research: a dedicated, serious budget for training and research experiments.
  • We publish: we write up our research and share it through papers and our engineering blog.
  • Early seat: you'll help shape the DNA of OuterSignal's applied research org from the beginning.
  • Massive upside: meaningful equity in a venture-backed company defining a new category in commerce intelligence.
  • Right moment: we're past prototype, real brands already rely on us, and we have strong product-market fit, but the ceiling is still wide open.

HOW TO APPLY

Submit your resume along with responses to the application questions. We review applications on a rolling basis and will reach out to qualified candidates to discuss potential opportunities.

OuterSignal is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs in New York

AI Research Intern (PhD)

Duolingo · New York, NY +1 place

$67–$69/hrInternshipOn-site

StrongChecked open todayPosted 15 days ago

See more like this