Software Engineer jobs

Software Engineer, Inference (AI Data Engineering)

SpaceXPalo Alto, CAHybrid

$135k–$175k/yr listed by the employer

Below the typical $210k a year for Software Engineer jobs in California (all levels)How we compare

How we compare. Typical is the median yearly pay of 3,397 Software Engineer jobs in California (all levels) that list pay, from the employers' own postings. About means within 5%.

Key facts

Experience
1+ years
Degree
Bachelor's degree

Looks real. 1 thing to check before you apply.

On SpaceX’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 3 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Develop reliable, high-throughput AI inference systems for internal SpaceX use.
  • Design and operate distributed model-serving infrastructure, including routing, scaling, scheduling, and caching.
  • Optimize inference latency and throughput, including low-level GPU and model acceleration work.
  • Build tools for tracing, replaying, debugging, benchmarking, and monitoring inference systems.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience designing, implementing, and maintaining reliable, horizontally scalable distributed systems
  • 1+ years of experience in full-stack or backend development with production systems
  • 1+ years of experience with Rust or C++
  • Experience with LLM inference engines and serving frameworks such as SGLang, vLLM, Triton, or TensorRT-LLM (preferred)
  • Experience with large-scale, high-concurrency production serving systems (preferred)
  • Experience operating PostgreSQL, ClickHouse, or MongoDB (preferred)
  • Experience designing or building with agent SDKs and agent orchestration frameworks (preferred)
  • Experience with Docker, Kubernetes, and containerized applications (preferred)
  • Programming experience in Python, Go, or similar languages (preferred)
  • Experience with version control, continuous integration, continuous delivery, build systems, and monitoring (preferred)

Education

  • Bachelor’s degree in computer science, engineering, math, or a scientific discipline, or 2+ years of professional experience building software in lieu of a degree

Skills

  • Low-level systems programming and optimization, including GPU kernels, code generation, batching, caching, parallelism, quantization, and speculative decoding (preferred)
  • Expert knowledge of gRPC, including unary, response streaming, bi-directional streaming, and REST mapping (preferred)
  • Expertise in profiling and improving application performance (preferred)

Other requirements

  • Work onsite in Palo Alto; remote and hybrid work are not considered
  • Meet ITAR eligibility requirements: qualifying U.S. citizenship or immigration status, or eligibility to obtain required U.S. Department of State authorizations

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Comprehensive medical coverage
Dental & vision
Dental and vision coverage
Retirement plan
Access to a 401(k) retirement plan
Paid time off
May accrue 3 weeks of paid vacation; eligible for 10 or more paid holidays per year; paid sick leave under Company policy
Parental leave
Paid parental leave
Equity
May be eligible for company stock or long-term cash awards and may purchase additional stock at a discount through an Employee Stock Purchase Plan
Bonus
Potential discretionary bonuses
Life & disability insurance
Short- and long-term disability insurance and life insurance
Other
Various discounts and perks

Full job description

From SpaceX’s careers site

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.

SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING)

Show full descriptionShow less

The application software team is the central nervous system of SpaceX – we create mission critical applications that are used throughout SpaceX to accelerate launch vehicle production and flight as well as systems that allow Starlink to grow into a worldwide fast, reliable Internet service. We are looking for engineers who treat fellow teammates with fairness, respect, and support.

Our team maintains a high-performance AI inference platform that serves the best models internally at SpaceX to accelerate our most ambitious engineering goals. As part of this effort in Palo Alto, you will design and optimize large-scale model serving systems end-to-end, owning everything from distributed infrastructure to deep low-level optimizations. You will work on systems that deliver reliable, high-throughput inference to power SpaceX’s mission-critical applications while maintaining the highest standards of performance and availability.

Aerospace experience is not required to be successful here - rather we look for smart, motivated, respectful, collaborative engineers who love solving problems and want to make an impact on a super inspiring mission. You will have full ownership of challenging problems, working with a team of enthusiastic engineers with diverse perspectives to design and produce solutions that enable SpaceX to achieve its loftiest engineering goals at a rapid pace. The success of the missions at SpaceX depends on the software that you and your team produce.

This role will report through SpaceX Internal AI Infrastructure, as we'll also be providing support for training workloads.

RESPONSIBILITIES:

  • Develop highly reliable, high-throughput inference systems that serve the best AI models internally across SpaceX
  • Architect and implement scalable distributed infrastructure for model serving, including load balancing, auto-scaling, batch scheduling, global KV cache, and continuous batching
  • Optimize latency and throughput of model inference under real production workloads, including low-level GPU kernel work, quantization, speculative decoding, and other acceleration techniques
  • Build reliable, high-concurrency serving systems with 100% uptime, low tail latency, and excellent observability
  • Own end-to-end components such as request routing, SDK development, rate limiting, and efficient scaling for internal SpaceX AI inference platforms
  • Benchmark, fine-tune, and accelerate inference engines (e.g., SGLang, vLLM, TensorRT-LLM)
  • Develop custom tools for tracing, replaying, and resolving issues across the full stack — from orchestration down to GPU kernels
  • Create robust CI/CD infrastructure for seamless endpoint deployment, image publishing, and inference engine updates
  • Collaborate across SpaceXAI teams to integrate inference capabilities into broader systems and workflows

BASIC QUALIFICATIONS:

  • Bachelor's degree in computer science, engineering, math, or scientific discipline; OR 2+ years of professional experience building software in lieu of a degree
  • Experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems
  • 1+ years of experience in full stack development or backend development with production systems
  • 1+ years of experience with Rust or C++

PREFERRED SKILLS AND EXPERIENCE:

  • Experience with LLM inference engines and serving frameworks (e.g., SGLang, vLLM, Triton, TensorRT-LLM)
  • Deep low-level systems programming and optimizations: GPU kernels, code generation, batching, caching, parallelism, quantization, and speculative decoding
  • Experience with large-scale, high-concurrency production serving systems
  • Knowledge of service observability and reliability best practices
  • Experience operating commonly used databases such as PostgreSQL, ClickHouse, or MongoDB
  • Experience designing or building with agent SDKs and agent orchestration frameworks
  • Experience with Docker, Kubernetes, and containerized applications
  • Expert knowledge of gRPC (unary, response streaming, bi-directional streaming, REST mapping)
  • Programming experience in Python, Go, or similar languages
  • Experience with version control, continuous integration, continuous delivery, build systems, and monitoring
  • Expertise in profiling and improving application performance

ADDITIONAL REQUIREMENTS:

  • You may be asked to work extended hours/weekends dependent on launch cadence and platform demands
  • This role requires you to be onsite in Palo Alto. Remote and/or hybrid work will not be considered

COMPENSATION AND BENEFITS:

Pay Range: Level 1: $135,000.00 - $175,000.00 Level 2: $155,000.00 - $210,000.00

Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.

Base salary is just one part of your total rewards package at SpaceX. You may also be eligible for long-term incentives, in the form of company stock or long-term cash awards, as well as potential discretionary bonuses and the ability to purchase additional stock at a discount through an Employee Stock Purchase Plan. You will also receive access to comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short and long-term disability insurance, life insurance, paid parental leave, and various other discounts and perks. You may also accrue 3 weeks of paid vacation and will be eligible for 10 or more paid holidays per year. Employees accrue paid sick leave pursuant to Company policy which satisfies or exceeds the accrual, carryover, and use requirements of the law.

ITAR REQUIREMENTS:

  • To conform to U.S. Government export regulations, applicant must be a (i) U.S. citizen or national, (ii) U.S. lawful, permanent resident (aka green card holder), (iii) Refugee under 8 U.S.C. § 1157, or (iv) Asylee under 8 U.S.C. § 1158, or be eligible to obtain the required authorizations from the U.S. Department of State. Learn more about the ITAR here.

SpaceX is an Equal Opportunity Employer; employment with SpaceX is governed on the basis of merit, competence and qualifications and will not be influenced in any manner by race, color, religion, gender, national origin/ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, mental or physical disability or any other legally protected status.

Applicants wishing to view a copy of SpaceX’s Affirmative Action Plan for veterans and individuals with disabilities, or applicants requiring reasonable accommodation to the application/interview process should reach out to EEOCompliance@spacex.com.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

Staff Software Engineer

LinkedIn · Mountain View, CA

$156k–$255k/yrFull-timeHybrid

StrongChecked open todayPosted 5 days ago

See more like this