Machine Learning Engineer jobs

AI Engineer, Model Quality and Performance

Cerebras SystemsSunnyvale, CAFull-timeOn-site

Pay not listed

Looks real. 2 things to check before you apply.

On Cerebras Systems’ own careers site (Ashby), checked open today.

  • To check: Posted by the employer 6 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listed, though one is likely required in CAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: No reposts foundAshby board
  • Trust score 70 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Design model evaluation suites for releases, including advanced, basic, long-context, and customer-specific tests.
  • Use AI agents to mine customer workload trajectories and synthesize representative evaluation sets.
  • Automate evaluation execution and release qualification using Docker, Git, and CI pipelines.
  • Build tools to forecast and benchmark customer workload performance on Cerebras in production.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience building AI agents and shipping real systems with Claude or equivalent
  • Shipped tooling that a non-engineer used
  • Performance-tuning experience on custom silicon, GPUs, or FPGAs (preferred)
  • Experience designing evals for agentic, coding, long-context, or multimodal use cases (preferred)
  • Experience building AI agents (preferred)

Skills

  • Strong math/stats background
  • Comfort with Docker, Git, and the standard automation stack
  • Familiarity with open-source eval frameworks such as EvalScope or lm-eval-harness (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Cerebras Systems’ careers site

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Show full descriptionShow less

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership https://openai.com/index/cerebras-partnership/ with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

ABOUT THE ROLE

You'll own model quality and performance for Cerebras' inference offerings. You will define what "good" looks like across the models we serve, building AI-driven systems to  measure it at scale, and translating those signals into artifacts our customers and product team actually use.

You'll use AI agents to spin up custom eval suites per customer use case, mine trajectories for representative test data,  automate the repetitive parts of release qual, and help build performance datasets and benchmarking workflows for customer use cases. We want someone whose first instinct is "how do I get an AI agent to do this on a loop."

You'll sit between engineering, product, and customer-facing teams.

What You'll Do

  • Design eval suites with AI agents in the loop. For every model release, curate a thoughtful mix of advanced, basic, long-context, and customer-use-case-specific evals. Use Claude to generate, validate, and prune candidate test cases at speed.
  • Build custom evals for target customers by orchestrating AI agents to mine trajectories from their workloads and synthesize representative eval sets.
  • Automate eval execution end-to-end with AI-driven pipelines on top of standard tooling (Docker, Git, CI). The goal is a system that runs itself between releases, not a script you re-run by hand.
  • Build automations to forecast and benchmark model performance on Cerebras for our top customers, including modeling how fast customer-specific workloads will run in production.
  • Build product-quality tooling that synthesizes quality + performance data into a single, easy-to-use view.

SKILLS & QUALIFICATIONS

  • Experience building AI agents. You ship real systems with Claude (or equivalent) as a force multiplier. You've built things that would have been infeasible solo without AI agents in the loop.
  • Strong math/stats background..
  • Comfort with Docker, Git, and the standard automation stack
  • A taste for tooling design. You've shipped something that a non-engineer used without complaining. Bonus if AI helped you ship it.

ASSETS

  • Performance-tuning experience on custom silicon, GPUs, or FPGAs.
  • Experience designing evals for agentic / coding / long-context / multimodal use cases.
  • Familiarity with open-source eval frameworks (EvalScope, lm-eval-harness, etc.).
  • Experience building AI agents.

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

1. Build a breakthrough AI platform beyond the constraints of the GPU.

2. Publish and open source their cutting-edge AI research.

3. Work on one of the fastest AI supercomputers in the world.

4. Enjoy job stability with startup vitality.

5. Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here https://www.cerebras.ai/join-us!

Apply today and become part of the forefront of groundbreaking advancements in AI!

This website or its third-party tools process personal data. For more details, click here https://www.cerebras.net/privacy/ to review our CCPA disclosure notice.

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

See more like this