DevOps, SRE & Cloud Engineer jobs

Principal Engineer - AI Platform & Operations

Serko LtdCalifornia City, CA +1 placeFull-time

$168k–$230k/yr listed by the employer

Key facts

Where
California City, CA · Seattle, WA
Experience
12+ years

This job is closed.

The employer took it down 3 days ago, after 18 days open. Here are similar open jobs.

  • To check: Posted by the employer 3 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteWorkable board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundWorkable board
  • Note: Last seen open 19 days agoLive check
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

Similar open jobs

Platform Engineer

Pulley · San Francisco, CA

$200k–$250k/yrFull-timeOn-site

StrongChecked open todayPosted 11 days ago

Lead Platform Engineer

Stitch Fix · Remote · US only

$113k–$189k/yr

StrongChecked open todayPosted 8 days ago

Senior Platform Engineer

Doma Technology LLC · Remote · US only

$160k–$190k/yrFull-time

StrongChecked open todayPosted 9 days ago

See more like this

What you’ll do

  • Define the long-term technical roadmap for the AI platform, including model serving, feature stores, experiment tracking, and ML CI/CD.
  • Set standards for deployment, versioning, A/B testing, and automated rollbacks.
  • Improve GPU and compute efficiency, cost, and LLM inference performance at scale.
  • Design monitoring and alerting for production AI workloads, and drive platform stability with application teams.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 12+ years of engineering experience
  • At least 4 years at a Principal or Distinguished level
  • Deep experience with Kubernetes and cloud ecosystems (AWS, GCP, or Azure)
  • Proven experience with MLOps tools such as MLflow, Weights & Biases, or Kubeflow
  • Hands-on experience operating LLM inference at scale
  • Track record of building internal platforms that treat engineers as the primary customer and improve engineering velocity

Skills

  • Expert-level knowledge of model serving, such as Triton, vLLM, or Ray Serve
  • High proficiency in Python
  • Systems-thinking approach to Docker, Helm, and containerization
  • Deep understanding of throughput and latency trade-offs

Other requirements

  • Remote role based in Washington or California

Benefits

Health insurance
Medical benefits
Bonus
Discretionary incentive plan based on individual and company performance
Learning & tuition
Access to a learning and development platform and the opportunity to own your career pathways
Flexible schedule
Flexible work policy

Full job description

From Serko Ltd’s careers site

With offices in New Zealand, Australia, North America, and China, we are thrilled to be expanding our global footprint, landing our new hub in Bengaluru, India. With a rapid growth plan in place, we’re hiring people from different backgrounds, experiences, abilities, and perspectives to help us build a world-class team and product.

We are looking for a Principal Engineer to serve as the technical expert for our AI Platform & Operations. This isn’t just a role about maintaining infrastructure; it’s about owning the technical vision for the foundational systems that will power every AI product team across the company.

Remote Role - can be based in either Washington or California State.

Show full descriptionShow less

Requirements

By building robust, self-serve internal developer platforms, you’ll enable our engineers to deploy, monitor, and scale AI models with unprecedented efficiency and safety. Your work ensures that our "Agentic" future is reliable, cost-effective, and cutting-edge.

What You’ll Be Doing

  • Architect the Future: Define the long-term technical roadmap for our AI platform, covering everything from model serving and feature stores to experiment tracking and CI/CD for ML.
  • Set the Gold Standard: Establish engineering benchmarks for deployment, versioning, A/B testing, and automated rollbacks.
  • Optimize & Scale: Lead strategies for GPU/compute efficiency and cost optimization while managing the complexities of LLM inference (quantization, batching, and latency) at scale.
  • Enhance Observability: Design sophisticated monitoring and alerting systems specifically tailored for AI workloads in production.
  • Champion Reliability: Drive platform stability and partner with application teams to ensure our infrastructure meets evolving product needs.
  • Technical Leadership: Mentor Senior engineers, lead architecture reviews, and evaluate the next generation of cloud services and ML frameworks.

What You’ll Bring

We are looking for a heavy-hitter in the ML infrastructure space who thrives on solving complex, distributed systems problems.

  • Senior Expertise: 12+ years of engineering experience, with at least 4 years at a Principal or Distinguished level.
  • ML Infrastructure Mastery: Expert-level knowledge of model serving (e.g., Triton, vLLM, Ray Serve) and deep experience with Kubernetes and cloud ecosystems (AWS/GCP/Azure).
  • The MLOps Toolkit: Proven experience with tools like MLflow, Weights & Biases, or Kubeflow.
  • Coding & Systems: High proficiency in Python and a "systems-thinking" approach to Docker, Helm, and containerization.
  • AI Specialization: Hands-on experience operating LLM inference at scale and a deep understanding of the trade-offs between throughput and latency.
  • Platform Mindset: A track record of building internal platforms that treat other engineers as the primary customer, drastically improving engineering velocity.

Benefits

At Serko, we aim to create a place where people can come and do their best work. This means you’ll be operating in an environment with great tools and support to enable you to perform at the highest level of your abilities, producing high-quality and delivering innovative and efficient results. Our people are fully engaged, continuously improving, and encouraged to make an impact.

Some of the benefits of working at Serko are:

  • A competitive base pay
  • Medical Benefits
  • Discretionary incentive plan based on individual and company performance
  • Focus on development: Access to a learning & development platform and opportunity for you to own your career pathways
  • Flexible work policy
  • The pay range is between $168,000 - $230,000 USD as a base salary offering annually.

Serko is a cutting-edge tech platform in global business travel & expense technology. When you join Serko, you become part of a team of passionate travellers and technologists bringing people together, using the world’s leading business travel marketplace. We are proud to be an equal opportunity employer, and we embrace the richness of diversity, showing up authentically to create a positive impact. There's an exciting road ahead of us, where travel needs real, impactful change.

Something wrong with this job? Report it · This flag looks wrong