Software Engineer jobs

Member of Technical Staff (Software Engineer, Data Platform)

PerplexitySan Francisco, CA +2 placesFull-time

$220k–$405k/yr listed by the employer

Key facts

Where
San Francisco, CA · Palo Alto, CA · New York City, NY
Experience
8+ years

Looks real. 1 thing to check before you apply.

On Perplexity’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 5 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Design and operate large-scale batch and streaming pipelines for product features, AI workflows, analytics, and experimentation.
  • Lead data orchestration and establish reliability, freshness, correctness, lineage, and recovery guarantees.
  • Build self-serve data platform capabilities and improve developer workflows through abstractions, standards, and tooling.
  • Set technical direction for data architecture and mentor engineers through design reviews, documentation, and collaboration.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 5+ years of software engineering experience for Senior, or 8+ years for Staff
  • Strong experience building production data infrastructure systems
  • Hands-on experience with batch and/or streaming data processing at scale
  • Experience supporting ML/AI workflows, training pipelines, or evaluation systems
  • Prior ownership of internal platforms used by many teams

Skills

  • Deep familiarity with data orchestration systems such as Airflow or Dagster
  • Proficiency in Python and at least one additional backend language
  • Familiarity with data quality, lineage, observability, and governance tooling

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Perplexity’s careers site

ABOUT THE ROLE

The Data Platform team owns the end-to-end data lifecycle at Perplexity, from ingestion through processing, storage, and serving, powering product features, analytics, experimentation, AI workloads, and the company’s data lake.

The team defines the architecture for batch and streaming systems, the orchestration and observability stack, and a self-serve data platform, while thoughtfully combining platforms such as Databricks and Snowflake with open-source technologies including Spark, Kafka, Flink, Airflow, Dagster, dbt, Iceberg, Delta Lake, and ClickHouse.

Show full descriptionShow less

In this senior/staff role, you will shape architecture, set standards, and drive the long-term technical direction of Perplexity’s data ecosystem.

KEY RESPONSIBILITIES

  • Design and operate large-scale batch and streaming data pipelines that directly power Perplexity product features, AI training and evaluation workflows, analytics, and experimentation.
  • Build event-driven and streaming systems (Kafka, Kinesis, PubSub, or similar) for real-time ingestion, transformation, and delivery, alongside batch frameworks for backfills, aggregations, and offline computation.
  • Lead the architecture of data orchestration using tools like Airflow or Dagster, owning scheduling, dependency management, retries, SLAs, and end-to-end observability for critical data flows.
  • Set and enforce guarantees for data correctness, freshness, lineage, and recoverability, designing systems that handle rapid scale growth, partial failures, and evolving schemas without disrupting AI workloads or product experiences.
  • Build self-serve data platforms that let engineers, data scientists, and analysts safely discover data, define contracts, and create and operate their own pipelines with minimal friction.
  • Improve developer experience through better abstractions, opinionated paved paths, and standards for data modeling, testing, validation, and deployment, treating the data platform as a product used by many teams.
  • Drive architectural decisions across storage, compute, orchestration, and data APIs, partnering closely with product engineering and data science to align the data ecosystem with Perplexity’s roadmap.
  • Mentor engineers, review designs, and raise the technical bar for data infrastructure through thoughtful feedback, documentation, and hands-on collaboration.

QUALIFICATIONS

  • 5+ years (Senior) or 8+ years (Staff) of software engineering experience.
  • Strong experience building production data infrastructure systems.
  • Hands-on experience with batch and/or streaming data processing at scale.
  • Deep familiarity with data orchestration systems (Airflow, Dagster, or similar).
  • Proficiency in Python and at least one additional backend language (Go, TypeScript, etc.).
  • Strong systems thinking around reliability, latency, cost, and complexity tradeoffs.
  • Experience supporting ML/AI workflows, training pipelines, or evaluation systems.
  • Familiarity with data quality, lineage, observability, and governance tooling.
  • Prior ownership of internal platforms used by many teams.

If you’re excited about this role, we encourage you to apply even if your experience doesn’t match every qualification listed above.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer

talentpluto · San Francisco, CA

$180k–$220k/yrFull-timeOn-site

StrongChecked open todayPosted yesterday

See more like this