Raydar (agency)Remote · US onlyFull-timePosted 1 month ago
$170k–$270k/yr listed by the employer
About the typical $225k a year for remote Machine Learning Engineer jobs (all levels)How we compare
How we compare. Typical is the median yearly pay of 284 remote Machine Learning Engineer jobs (all levels) that list pay, from the employers' own postings. About means within 5%.
Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
Benefits
Equity
Competitive equity
Other
Comprehensive benefits
Full job description
From Raydar’s careers site
About the company
Our client is a fast-growing AI data infrastructure company building a secure marketplace and data lab for high-quality model-training data. The company helps data holders license sensitive, real-world datasets to vetted AI teams while protecting governance, privacy, intellectual property, and security. It has raised $65 million, including a $55 million Series A backed by leading venture firms, employs approximately 80 people, and is scaling quickly after reaching its full-year growth target early.
The role and why it matters
Show full descriptionShow less
This is the first Machine Learning Engineer dedicated to the company's Benchmarks and Evaluations vertical. You will partner directly with the general manager, researchers, and early enterprise customers to establish the technical foundation for evaluating foundation models across domains and modalities. The role combines hands-on ML evaluation, backend infrastructure, and customer-facing delivery in a high-ownership environment.
What you'll do
Define, design, and build production benchmarks and evaluations with customers and internal researchers.
Build and own backend infrastructure, including data pipelines, execution environments, storage, and orchestration.
Create sandboxed environments for agentic evaluations involving tools, code execution, and multi-step tasks.
Own the engineering portion of customer engagements from technical scoping through production delivery.
Identify repeatable evaluation patterns and infrastructure gaps that can become scalable products.
Move quickly through ambiguity while maintaining strong technical judgment and clear written communication.
Requirements
What we're looking for
4 or more years of engineering experience, including hands-on machine learning model evaluation work.
Experience deploying end-to-end ML evaluation or benchmark systems to production against demanding customer timelines.
Strong proficiency with ML evaluation frameworks and benchmark design, including approaches such as LLM-as-judge.
Ownership of backend and infrastructure systems such as large-scale data pipelines, execution environments, storage, and orchestration.