Staff Machine Learning Engineer
MCG Health · Remote · US only
$168k–$235k/yr

Bask HealthRemote · US onlyFull-time3+ years experiencePosted 9 days ago
Pay not listed
On Bask Health’s own careers site (Workable), checked open today.
Summarised from the posting by AI and can be wrong. The full description is the source.
Sign in and add your resume to see which of this job's requirements it shows.
Sign in to check your matchSaved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
From Bask Health’s careers site
About Bask Health
Bask Health is a software platform that enables entrepreneurs, doctors, and healthcare businesses to launch, manage, and grow direct-to-consumer telehealth businesses.
Our platform brings together patient experiences, clinical workflows, pharmacy operations, and commerce tools in one place.
We're an entrepreneurial, product-focused engineering team that values ownership, technical excellence, and building software that solves real problems. Engineers work closely with product teams and company leadership, take features from idea to production, and have a direct role in shaping the platform.
Engineering at Bask is AI-first and builder-led. We use tools like Cursor and Claude Code throughout development while maintaining high standards for reliability, testing, and software quality.
About the Role
We're looking for a Machine Learning Engineer, Evaluation & Reliability to help ensure that AI-powered features across Bask Health are accurate, dependable, and ready for real-world use.
Bask Health uses software to connect patient experiences, merchant operations, clinical workflows, pharmacy coordination, and commerce capabilities. As AI becomes more integrated into these systems, we need reliable ways to measure model performance, identify failures, and verify that changes improve the user experience without introducing new risks.
You'll help develop the evaluation infrastructure, testing workflows, and performance measurements used to assess large language models, retrieval systems, AI assistants, and automated workflows.
This is a hands-on engineering role that combines machine learning evaluation, software development, data analysis, and production quality assurance. You'll work with model outputs, evaluation datasets, automated testing tools, and application telemetry to understand how AI systems perform under realistic conditions.
Your work may include creating evaluation datasets, implementing automated benchmarks, measuring response quality, testing retrieval accuracy, analyzing model failures, and monitoring production behavior.
You'll collaborate with applied AI engineers, machine learning engineers, backend engineers, product managers, and other stakeholders to define what successful AI behavior looks like for different workflows. You'll help translate those expectations into measurable tests and actionable engineering improvements.
Because Bask operates in healthcare-related environments, AI evaluation must account for accuracy, privacy, appropriate permissions, and the consequences of unreliable responses. You'll help identify situations where AI systems produce unsupported information, expose restricted data, attempt unauthorized actions, or operate outside approved clinical and operational boundaries.
This position emphasizes practical implementation and continuous improvement. You'll contribute to evaluation methodologies and engineering standards while working with senior engineers on broader reliability strategies and more complex technical decisions.
We're looking for an engineer who enjoys investigating how AI systems behave, can turn ambiguous quality problems into measurable tests, and understands that reliable AI products require ongoing evaluation—not just successful demonstrations.
What You'll Do
Requirements
Nice to Have
Something wrong with this job? Report it · This flag looks wrong

MCG Health · Remote · US only
$168k–$235k/yr
StrongChecked open todayPosted 16 days ago

Ethos Life · Remote · US only
$156k–$275k/yrFull-time
StrongChecked open todayPosted 17 days ago

Care Access · Remote · US only
$140k–$190k/yrFull-time
StrongChecked open todayPosted 1 month ago

Trace · Remote · US only
$185k–$245k/yrFull-time
StrongChecked open todayPosted 1 month ago

Block · Remote · US only
$229k–$343k/yr
StrongChecked open todayPosted 8 days ago

Instacart · Remote · US only
$207k–$219k/yr
StrongChecked open todayPosted 22 days ago