Data Engineer jobs

Data Engineer - Flight Data

PivotalPalo Alto, CAContractOn-sitePosted 3 months ago

$60–$70/hr listed by the employer

Key facts

Pay per year
≈ $125k–$146k
Below the typical $160k a year for mid-level Data Engineer jobs in CaliforniaHow we compare

How we compare. ≈ $125k–$146k assumes full-time hours, 2,080 a year. Typical is the median yearly pay of 35 mid-level Data Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Experience
3+ years
Degree
Bachelor's degree

Strong: looks real and checked open today.

On Pivotal’s own careers site (Lever).

  • Checked: On the company's own careers siteLever board
  • Checked: Checked open todayLever board
  • Checked: Pay range listedJob posting
  • Checked: No reposts foundLever board
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Build and maintain pipelines that ingest aircraft telemetry from S3 into the flight data warehouse, including schema evolution as firmware logging changes.
  • Design and maintain SQL data marts for flight runs, component flight hours, vehicle modes, and battery flight features.
  • Operate Python services that run flight health checks and send alerts to engineering and customer-facing channels through SNS and Slack.
  • Own data quality checks, build fleet monitoring dashboards and query interfaces, and turn recurring analyses into supported datasets.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3+ years of professional data engineering experience building and operating production pipelines
  • Hands-on experience with the AWS data stack: S3, Glue, Athena, Lambda, SNS, CloudWatch, and IAM
  • Familiarity or experience with one or more of aerospace, automotive, or robotics telemetry; embedded logging formats and raw device log decoding; FAA certification or continued airworthiness processes
  • 5+ years of relevant data engineering experience, including ownership of an on-call or operationally critical data system (preferred)
  • High-volume time-series or sensor telemetry and observability tooling, including alert design that avoids alarm fatigue (preferred)

Education

  • Bachelor’s degree in Computer Science, Computer/Electrical Engineering, or a related technical discipline

Skills

  • Strong SQL, including window functions and query tuning on a distributed, columnar engine
  • Proficient in Python for production services, including packaging, dependency management, unit tests, and code review
  • Dimensional modeling and warehouse design, including partitioning strategy for large tables
  • Infrastructure as code with Terraform and deployment pipelines in GitLab CI or equivalent (preferred)
  • Transformation frameworks such as dbt and data quality/testing frameworks (preferred)

Other requirements

  • Eligible for employment in the United States
  • Willing to work onsite at the Palo Alto, CA HQ office
  • Interest in RC planes, quadcopters, or aviation (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Medical plan
Dental & vision
Dental and vision plans
Retirement plan
401(k) plan

Full job description

From Pivotal’s careers site

Pivotal is the leader in the emerging market of electric Vertical Takeoff and Landing (eVTOL) aircraft. We design, develop, and manufacture light eVTOL aircraft and are renowned for the BlackFly aircraft the world's first light eVTOL to fly manned missions and enter the consumer market.

Efficient, compact, and simple, Pivotal aircraft are designed for a wide range of consumer, public service, and defense applications. Our distinctive tilt-aircraft architecture and scalable platform have been flying for over 10 years. Last year we announced our next-generation aircraft, the Helix, which is rapidly progressing toward general release and scalable production in 2026.

Show full descriptionShow less

Mobility is one of the most highly-valued areas of modern technology investments. This is the right company, in the right space, the right strategy, at the right time. If you are ready for adventure, we invite you to join our amazing team and grow with us.

Pivotal is seeking a Data Engineer to build and operate the flight data warehouse — the system of record for telemetry off every aircraft in the fleet. Flight logs land continuously from customer and test aircraft; you will turn them into curated datasets, automated fleet health alerts, and dashboards that the firmware, GNC, battery, flight operations, and MRO teams rely on to make airworthiness and design decisions. This is a small team building production infrastructure, so you will own pipelines end to end: the data model, the services that run on it, the infrastructure as code that deploys them, and the monitoring that tells us when they break.

Responsibilities

  • Pipeline development:  Build and maintain the ingest and transformation pipelines that land aircraft telemetry from S3 into the flight data warehouse (AWS Glue, Athena), including schema evolution as firmware logging changes. - Data modeling:  Design and maintain curated marts — flight runs, component flight hours, vehicle modes, battery flight features — in SQL, with clear grain, documented lineage, and idempotent incremental refresh. - Fleet alerting services:  Develop and operate the Python services that evaluate flight-by-flight health checks and deliver alerts to engineering and customer-facing channels via SNS and Slack. - Data quality:  Own the automated quality gates — mart freshness, source-to-mart reconciliation, and watermark integrity — and block deploys that would publish incorrect fleet data. - Analytics enablement:  Build the dashboards and query interfaces engineering teams use to monitor the fleet, and convert repeated one-off analyses into supported datasets. - Collaboration:  Work directly with firmware, GNC, battery, systems engineering, flight operations, and MRO to define what gets logged, what gets alerted on, and what “good” looks like for each signal.

Qualifications

  • Bachelor’s degree in Computer Science, Computer/Electrical Engineering, or a related technical discipline - 3+ years of professional data engineering experience building and operating production pipelines - Strong SQL, including window functions and query tuning on a distributed, columnar engine (Athena/Trino/Presto, Spark, Snowflake, or BigQuery) - Proficient in Python for production services — not just notebooks: packaging, dependency management, unit tests, and code review - Hands-on experience with the AWS data stack: S3, Glue, Athena, Lambda, SNS, CloudWatch, and IAM - Dimensional modeling and warehouse design, including partitioning strategy for large tables - Excellent analytical and written communication skills, with the ability to work across multidisciplinary teams

Preferred Qualifications

  • 5+ years of relevant data engineering experience, including ownership of an on-call or operationally critical data system - Infrastructure as code with Terraform, and building deployment pipelines in GitLab CI or equivalent - Transformation frameworks such as dbt, and data quality/testing frameworks - High-volume time-series or sensor telemetry, and observability tooling (Grafana, CloudWatch, or similar), including alert design that avoids alarm fatigue

Familiarity/experience with one or more of the following

  • Aerospace, automotive, or robotics telemetry and flight/vehicle test data - Embedded logging formats and decoding raw device logs (CAN, serial, or proprietary binary packet formats) - FAA aircraft certification or continued airworthiness processes - Interest in RC planes, quadcopters, or aviation

Applicants must be eligible for employment in the United States and willing to work onsite at our HQ office in Palo Alto, CA.

Pivotal offers a comprehensive benefits package, including medical, dental, vision, and 401k plans.

Pivotal is an Equal Opportunity Employer. Pivotal does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

Something wrong with this job? Report it

Similar jobs nearby

Senior Data Engineer

Gatik AI · Santa Clara, CA

$180k–$260k/yrHybrid

StrongChecked open todayPosted 8 days ago

Senior Data Engineer

BitGo · Palo Alto, CA +1 place

$180k–$220k/yrFull-timeOn-site

StrongChecked open todayPosted 1 month ago

Software Engineer - Data

PlusAI · Santa Clara, CA

$135k–$180k/yrFull-timeHybrid

StrongChecked open todayPosted 5 months ago

Founding Data Engineer

Gridmatic Inc · Cupertino, CA

$180k–$220k/yr

StrongOpen 3 monthsChecked open todayPosted 3 months ago

Data DevOps Engineer

Versa Networks · Santa Clara, CA

$200k–$220k/yrFull-timeHybrid

StrongOpen 4 monthsChecked open todayPosted 4 months ago

Sr. Data Engineer

Versa Networks · Santa Clara, CA

$150k–$220k/yrFull-timeHybrid

StrongOpen 4 monthsChecked open todayPosted 4 months ago

See more like this