Software Engineer jobs

Senior Staff Software Engineer - AI/ML Inference Engineering

ServiceNowSan Diego, CAFull-timeHybridPosted 16 days ago

$181k–$317k/yr listed by the employer

About the typical $250k a year for staff-level Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 704 staff-level Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Key facts

Experience
8+ years
Degree
Bachelor's degree

Strong: looks real and checked open today.

On ServiceNow’s own careers site (SmartRecruiters).

  • Checked: On the company's own careers siteSmartRecruiters board
  • Checked: Checked open todaySmartRecruiters board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundSmartRecruiters board
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Lead the architecture, optimization, and operation of the AI inference platform.
  • Own the inference lifecycle, from onboarding models to deploying optimized inference engines across backends on Kubernetes.
  • Build an Envoy and ext_proc gateway layer for access control, observability, and request routing.
  • Build and evolve the AI platform and partner with teams on AI-powered products and work experiences.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Model-serving and runtime experience, such as vLLM, TensorRT-LLM, or Triton Inference Server
  • Exposure to LLM APIs or ML-serving systems, or a clear ability to ramp up quickly
  • Experience building new products that use challenging algorithms
  • 8+ years of backend software engineering experience
  • 4+ years of designing and operating distributed systems
  • Deploying, scaling, and operating services in production Kubernetes environments, including Helm deployments and CI/CD pipelines (preferred)
  • Owning observability, including metrics, logs, tracing, and customer-impact alerts (preferred)
  • Independently resolving production incidents, participating in on-call, running root-cause analysis, and operating against service level objectives (preferred)

Education

  • Bachelor’s degree in computer science, software engineering, or a closely related technical field

Skills

  • Expertise in Go or Python, OOP, design patterns, and time- and space-efficient algorithms
  • Expertise in coding efficient, object-oriented, modularized, quality software
  • Knowledge of core AI/ML techniques and algorithms
  • Knowledge of unit testing, profiling, and code tuning
  • Experienced proficiency in AI strategy
  • Confident use of AI coding assistants such as GitHub Copilot or Cursor, and rigorous review of AI-generated code
  • AI-assisted debugging and trace analysis, and understanding of data privacy rules for prompts

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Health plans, including flexible spending accounts
Retirement plan
401(k) plan with company match
Paid time off
Flexible time away plan
Parental leave
Family leave programs
Equity
Equity when applicable
Bonus
Variable/incentive compensation
Other
Employee stock purchase plan (ESPP), Matching donations

Full job description

From ServiceNow’s careers site

Company Description

It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.

Join us to put AI to work for people.

Job Description

Show full descriptionShow less

What you get to do in this role:

About the team - The AI Services Platform Group at ServiceNow is a customer-focused innovation group building intelligent software and smart user experiences using existing and latest advanced technologies to enable end-to-end, industry-leading work experiences for customers. We are a group of researchers, applied scientists, engineers, and product managers with a dual mission. We build and evolve the AI platform, and partner with teams to build products and end-to-end AI-powered work experiences. In equal measure, we lay the foundations, research, experiment, and de-risk AI technologies that unlock new work experiences in the future.

We are seeking a Senior Staff Software Engineer - AI/ML Inference Engineering to lead the architecture, optimization, and operational excellence of our AI inference platform. You will own the end-to-end inference lifecycle—from onboarding cutting-edge models to deploying optimized inference engines in production across multiple backends on Kubernetes infrastructure. You'll also architect the intelligent gateway layer using Envoy and ext_proc to enforce access control, provide observability, and enable advanced request routing. This role combines deep technical expertise in GPU compute, LLM APIs, inference frameworks, containerization, orchestration, and API gateway architecture with a bias toward pragmatic engineering and measurable performance impact.

Qualifications

To be successful in this role you have:

  • Expertise in Go or Python, OOP, Design Patterns, time and space-efficient algorithms
  • Model-serving and runtime experience, such as vLLM, TensorRT-LLM, Triton Inference Server.
  • Exposure to LLM APIs or ML-serving systems, or a clear ability to ramp up quickly
  • Experience building new products that use challenging algorithms
  • Expertise in coding efficient, object-oriented, modularized and quality software
  • Knowledge of core AI/ML techniques and algorithms
  • Knowledge of unit testing, profiling, and code tuning

AI skills

Artificial intelligence strategy is a critical skill at Experienced proficiency for IC5 — it applies to how you build and to what you build.

  • Confident use of AI coding assistants such as GitHub Copilot or Cursor, paired with the critical eye to review AI-generated code as rigorously as any other — catching logic errors, security anti-patterns, and missed edge cases rather than treating model output as production-ready.
  • AI-assisted debugging and trace analysis, and a clear understanding of the data privacy rules governing what goes into a prompt.

Mandatory minimum

  • 8+ years of Backend software engineering experience
  • 4+ years of designing and operating distributed systems
  • Bachelor’s degree in computer science, software engineering, or a closely related technical field required.
  • A master’s degree may offset up to one year of the experience minimum. Equivalent practical experience is considered where technical depth is clearly demonstrable.

Desired skills:

  • Deploy, scale, and operate services in production Kubernetes environments, including Helm-based deployments and CI/CD pipelines that make releases repeatable and safe to roll back.
  • Own observability for what you build — meaningful metrics, useful logs, real tracing, and alerts that fire on customer impact rather than on noise.
  • Debug and resolve production incidents independently, participate in on-call, run root-cause analysis, and operate against defined service level objectives.

For positions in this location, we offer a base pay of $181,200 - $317,100, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location.

Additional Information

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

Accommodations

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.

From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

Equal Opportunity Employer

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.

We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact globaltalentss@servicenow.com for assistance.

Something wrong with this job? Report it

Similar jobs nearby

Senior Software Engineer

RIVO Holdings, LLC · San Diego, CA

$160k–$220k/yrFull-timeHybrid

StrongChecked open todayPosted 14 days ago

Staff Software Engineer

ServiceNow · San Diego, CA

$150k–$262k/yrFull-timeHybrid

StrongChecked open todayPosted 1 month ago

See more like this