Data Scientist jobs

Senior Data Scientist, Applied AI

Definitive Healthcare, USMA (Framingham); Remote +1 placeHybridPosted 25 days ago

$136k–$206k/yr listed by the employer

Key facts

Where
MA (Framingham); Remote · Framingham, MA · hybrid
Experience
5+ years
Degree
Bachelor's degree

Strong: looks real and checked open today.

On Definitive Healthcare, US’s own careers site (Greenhouse).

  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Build, test, and improve LLM, RAG, and tool-using agent workflows for an assigned use case.
  • Apply the team's evaluation framework, select evaluation criteria and datasets, and maintain test cases, benchmarks, and regression checks.
  • Compare models, embeddings, and retrieval methods, then document quality, reliability, latency, and cost tradeoffs.
  • Diagnose workflow and retrieval issues, validate fixes, and monitor and improve production performance for owned workflows.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 5+ years of relevant experience in data science, machine learning, applied AI, software engineering, or a related field
  • Hands-on experience building and evaluating LLM applications
  • Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Lakebase, Lakeflow Jobs, and MLflow, for building and deploying scalable, production-grade data and AI solutions
  • Experience with agent frameworks and AI evaluation platforms
  • Experience with healthcare data (preferred)

Education

  • Bachelor's degree
  • Master's degree in a quantitative or technical field (preferred)

Skills

  • Strong knowledge of LLMs, embeddings, semantic search, retrieval systems, and RAG architectures
  • Ability to design representative evaluations for an assigned use case, analyze errors, and use results to improve a system

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Medical coverage
Dental & vision
Dental and vision coverage
Retirement plan
401(k) plan with employer contribution; the company also describes this as a 401(k) match
Paid time off
Flexible paid time off
Bonus
Depending on the position, employees may be eligible for a company bonus or commission plan

Full job description

From Definitive Healthcare, US’s careers site

About Definitive Healthcare:

At Definitive Healthcare, our mission is simple: to connect with the real people who make healthcare happen. With real data on real people, our customers get the Definitive picture of the Healthcare market to move their businesses and organizations forward.

We’re committed to delivering the industry’s most reliable, actionable, and differentiated insights and empowering the innovators and organizations transforming healthcare. Because when our customers succeed, healthcare improves—for everyone.

Show full descriptionShow less

Since our founding in 2011, we’ve grown into a global company headquartered just outside Boston, Massachusetts, supporting more than 2,100 customers around the world. Along the way, we’ve built a culture centered on purposeful work, collaboration, curiosity, and meaningful impact.

We’re passionate about the work we do and the people we do it with. Through programs like Definitive Cares and our employee-led affinity groups, we create opportunities for our teams to connect and give back to the communities where we live and work.

About the position:

This role independently owns the build and evaluation of AI solutions for an assigned use case, operating within the team's established evaluation framework and practices. The Senior Data Scientist exercises professional judgment on technical approach, issue diagnosis, and implementation within their assigned project, escalating decisions that would affect the team's overall evaluation strategy, span multiple projects, or carry material risk. Its impact is measured by the quality and reliability of the systems and evidence it delivers for its assigned use case.

What you’ll do:

  • Own assigned workflows: Independently build, test, and improve LLM, RAG, and tool-using agent workflows for an assigned use case, using maintainable, tested Python code.
  • Apply the evaluation framework: Select and apply evaluation criteria, baselines, and test datasets within the team's established evaluation approach; does not set that approach for the team.
  • Select technical approaches: Compare models, embeddings, and retrieval methods for the assigned use case using evidence on quality, reliability, latency, and cost; document recommendations and tradeoffs for that project.
  • Diagnose and resolve issues: Investigate retrieval misses, incorrect answers, and workflow failures within the assigned project; independently determine root cause and implement and validate the fix.
  • Maintain and extend test assets: Build and update test cases, benchmark datasets, and regression checks for the assigned use case.
  • Support production reliability: Monitor and investigate performance changes for workflows they own, and recommend and implement improvements within their project.
  • Collaborate on delivery: Communicate findings and technical tradeoffs on the assigned project to immediate engineering, product, and domain partners.

What you'll need:

Education and experience

  • Bachelor's degree required; master's degree in a quantitative or technical field preferred.
  • 5+ years of relevant experience in data science, machine learning, applied AI, software engineering, or a related field.
  • Hands-on experience building and evaluating LLM applications.

Technical and professional skills

  • Strong Python programming, software engineering and testing, and analytical problem-solving skills.
  • Strong knowledge of LLMs, embeddings, semantic search, retrieval systems, and RAG architectures.
  • Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Lakebase, Lakeflow Jobs, and MLflow, for building and deploying scalable, production-grade data and AI solutions.
  • Ability to design representative evaluations for an assigned use case, analyze errors, and use results to improve a system.
  • Ability to weigh quality, reliability, latency, and cost when recommending an approach for their own project.
  • Clear communication and effective collaboration with technical and nontechnical partners.
  • Experience with agent frameworks and AI evaluation platforms.
  • Experience with healthcare data is preferred, but not required.

Autonomy, decisions, and scope

  • This is an individual contributor role with no people-management responsibilities.
  • Operates independently on an assigned project within the team's established evaluation framework and practices.
  • Exercises professional judgment on technical approach, root-cause diagnosis, and issue resolution within their assigned project.
  • Escalates decisions involving changes to the team's evaluation approach, significant business risk, sensitive data, material cost commitments, or production release approval to the Manager or appropriate owner.

Compensation and Benefits:

The salary range for this position is $136,000 – $206,000 per year, which represents the base pay the company reasonably and in good faith expects to pay for this role. Actual pay within this range will be determined based on factors such as relevant experience, skills, and qualifications.

Depending on the position, employees may also be eligible to participate in a company bonus or commission plan. All employees are eligible for a comprehensive benefits package, including medical, dental, and vision coverage, flexible paid time off, and participation in the company’s 401(k) plan with employer contribution.

Why we love Definitive Healthcare, and why you will too!

At Definitive Healthcare, our values shape how we work, how we treat one another, and how we deliver for our customers.

  • We’re obsessed with data. Great companies are built on data customers can rely on. As responsible stewards, we validate rigorously, question assumptions, and use data to make better decisions.
  • We’re accountable. We take ownership of results, not just tasks. When something needs doing, we step up. When things break, we fix them. We follow things through until the job is done.
  • We care deeply. About our teammates, our customers, and the impact of what we build. We assume good intent, communicate openly, and support each other through challenges. We always bring maximum energy to everything we do.

We're also committed to creating an environment where our people feel supported in their work, their wellbeing, and their financial future.

  • We invest in our people. We offer a competitive benefits package, including comprehensive healthcare benefits and a 401(k) match.
  • We make room for connection and impact. Definitive Cares is our 100% employee-driven program that creates opportunities to connect with colleagues through affinity groups and make a positive impact on our communities.
  • We’re a great place to work. In 2024 and 2025, we earned multiple workplace honors, including Built In’s 100 Best Places to Work in Boston (both years), a Stevie Bronze Award for Great Employers, and recognition as a Great Place to Work in India.

What our Employees are saying about us on Glassdoor:

“Great Work atmosphere, great work life balance, excellent company to work for, amazing top notch product, incredible customer service, lots of tools to help you succeed.”

-Business Development Manager

“Great team. Amazing growth. Employees are treated very well.”

-Research Analyst

“I have waited 36 years to work at a dream job for a dream company, and I am so happy to have finally got there.”

-Profile Analyst

If you don’t fit all of these qualifications, but believe you’re still a great fit, feel free to apply and tell us why in your cover letter.

If you are a California, Colorado, New York City or Washington resident and this role is a remote role, you can receive additional information about the compensation and benefits for this role, which we will provide upon request.

Definitive Hiring Philosophy

Definitive Healthcare is an equal opportunity employer that celebrates diversity and is committed to creating an inclusive workplace with equal opportunity for all applicants and teammates. Our goal is to recruit the most talented people from a diverse candidate pool regardless of race, color, religion, age, gender, gender identity, sexual orientation or any other status. If you’re interested in working in a fast growing, exciting working environment – we encourage you to apply!

Something wrong with this job? Report it

Similar jobs nearby

Data Scientist, Applied AI

Definitive Healthcare, US · Framingham, MA

$111k–$167k/yrHybrid

StrongChecked open todayPosted 25 days ago

Senior Data Scientist

CarGurus · Boston, MA

$142k–$177k/yrHybrid

StrongChecked open todayPosted 8 days ago

Senior Data Scientist

Zoox · Boston, MA

$225k–$307k/yrFull-timeHybrid

StrongChecked open todayPosted 24 days ago

Part-Time Data Scientist

Harvard University · Boston, MA

Part-timeHybrid

StrongPay not listedChecked open todayPosted 1 month ago

See more like this