Build benchmarks and evaluation pipelines for model accuracy, hallucinations, retrieval quality, latency, and cost.
Create dashboards to track system performance.
Turn research prototypes into production retrieval, drafting, document, and agent workflows.
Develop backend services, APIs, and internal tools for testing and releases.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Experience
At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems
Hands-on cloud deployment experience
Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems
Experience with APIs, databases, backend services, deployment pipelines, monitoring, and reliable cloud operations
Experience designing dashboards or monitoring systems
Interest or experience in LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation
Full-stack experience (preferred)
Skills
Strong Python skills
Experience with FastAPI, Docker, React, Next.js, Postgres, and vector databases (preferred)
Full job description
From Clera’s careers site
ABOUT THE ROLE
Join a healthtech team building dependable AI products for legal work. You will work across AI research and product, creating the evaluations, services, and features that bring applied AI into production.
WHAT YOU'LL DO
Build repeatable benchmarks and evaluation pipelines for model accuracy, hallucinations, retrieval quality, latency, and cost.
Create dashboards that help the team track changes in system performance.
Turn research prototypes into production retrieval, drafting, document, and agent workflows.
Develop backend services, APIs, and internal tools to support testing and releases.
Show full descriptionShow less
Deploy and operate cloud infrastructure, including monitoring, databases, and delivery pipelines.
Partner with AI research while staying connected to product and user needs.
WHAT WE'RE LOOKING FOR
At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems.
Strong Python skills and hands-on cloud deployment experience.
Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems.
Experience with APIs, databases, backend services, deployment pipelines, monitoring, and reliable cloud operations.
Ability to turn experimental code and ambiguous ideas into usable, maintainable products, with experience designing dashboards or monitoring systems.
Interest or experience in LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation. Full-stack experience is a plus.
Helpful technologies include FastAPI, Docker, React, Next.js, Postgres, and vector databases.
COMPENSATION & BENEFITS
Annual base salary: $180,000 to $260,000 USD. Visa sponsorship is not available.