Data Engineer jobs

Staff Data Platform Engineer

Reality DefenderRemote · US onlyFull-timePosted 1 month ago

$210k–$260k/yr listed by the employer

This job is closed.

The employer took it down yesterday, after 19 days open. Here are similar open jobs.

  • Checked: On the company's own careers siteAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Note: Last seen open yesterdayLive check
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

Similar open jobs

Staff Data Engineer

Fanatics Betting & Gaming · Remote · US only

$181k–$238k/yrFull-time

StrongChecked open todayPosted 16 days ago

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Data Engineer

Mindex · Remote · US only

$90k–$140k/yrFull-time

StrongChecked open todayPosted 7 days ago

Data Integration Engineer

D.A. Davidson · Remote · US only

$74k–$106k/yrFull-time

StrongChecked open todayPosted 10 days ago

See more like this

What you’ll do

  • Own the end-to-end platform for ingesting, preprocessing, governing, and exporting high-volume image, video, audio, and text data.
  • Scale the Databricks lakehouse and distributed processing stack, and build reusable infrastructure for synthetic media generation.
  • Make datasets reproducible and traceable through versioning, lineage, metadata, quality checks, and stable train/evaluation splits.
  • Own pipeline reliability, observability, and processing costs; partner with ML researchers to build self-serve data tools.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 8+ years building data platforms or data infrastructure
  • Staff- or lead-level ownership of production pipelines that generate, ingest, or deliver data at high volume
  • Hands-on experience with distributed processing (Spark, Ray, or similar) and lakehouse platforms on cloud object storage (S3, GCS, or Azure Blob)
  • Production experience with Databricks, Unity Catalog, Delta Lake, and Spark on AWS, including performance tuning, access controls, and operational troubleshooting
  • Experience working with large unstructured media such as video, audio, or images, including large files, decoding and transcoding, and metadata at scale
  • Track record of building reproducible ML datasets with versioning, lineage, data quality validation, and orchestration
  • Experience owning infrastructure and deployment automation using Terraform and CI/CD, including AWS storage, IAM, compute, Databricks resources, and distributed processing environments
  • Experience building synthetic data generation pipelines or running generative models (diffusion, voice cloning/TTS, video generation) at scale (preferred)
  • Background supporting ML research teams with training and evaluation data, especially for multimodal models (preferred)
  • Experience in security, fraud, trust and safety, another adversarial domain, or at a Series A or B startup (preferred)

Skills

  • Strong Python and SQL

Benefits

Health insurance
Healthcare plans with 100% premium coverage for employees and partial coverage available for dependents, FSA/HSA programs
Dental & vision
Dental and vision plans with 100% premium coverage for employees and their dependents
Retirement plan
401(k) program
Paid time off
20 days of PTO per year
Parental leave
12 weeks of parental leave
Equity
Equity compensation
Learning & tuition
Learning and Development budget
Wellness & mental health
Monthly wellness benefits
Flexible schedule
Remote Fridays for employees working from the NYC HQ
Life & disability insurance
Short- and long-term disability and life insurance with 100% premium coverage for employees
Commuter benefits
Commuter benefits for employees working from the NYC HQ
Meals
Daily in-office lunch through UberEats for employees working from the NYC HQ
Other
Annual company-sponsored offsite, Happy hours and other local events for employees working from the NYC HQ

Full job description

From Reality Defender’s careers site

STAFF DATA PLATFORM ENGINEER

Location: NYC HQ or Remote (U.S.)| Full-time | Engineering

WHO WE ARE.

Reality Defender is an award-winning AI company that develops models to help enterprises and governments tell what’s real from what’s AI-generated. Our multi-model platform detects AI-generated video, audio, and images in real time, and stays robust against new generative tools as they emerge.

The question our customers are asking is changing. It’s no longer only “is this a deepfake?” It’s “is this real, and is it who it claims to be?” Every day, organizations ask us:

  • “Is the voice on this call a real person?”
  • “Is that video of our CEO real?”
  • “Is everyone in this meeting who they say they are?”
Show full descriptionShow less

We answer those questions in real time, across video, audio, images, and text, so security teams can act before the damage is done.

Reality Defender is backed by world-class investors including DCVC, Illuminate Financial, Y Combinator, Booz Allen Hamilton, IBM, Accenture, Rackhouse, and Argon VC. We work with leading enterprises, financial institutions, and government agencies to make sure AI-generated media can’t be used to deceive.

Youtube: Reality Defender Wins RSA Most Innovative Startup https://www.youtube.com/watch?v=TKOZmwyNUNM

THE STAFF DATA PLATFORM ENGINEER ROLE.

Reality Defender's detection models are only as strong as the data behind them, and every new generative tool raises the bar on the volume and variety of media we need to train and evaluate against. The Staff Data Platform Engineer will own the shared AI data platform behind our vision, audio, and multimodal research, turning acquired and internally generated image, video, audio, and text data into reliable, reproducible datasets, from continuous ingestion through processing, governance, and export. This is a senior, hands-on role where you'll complete our Databricks and distributed processing platform and build the reusable infrastructure behind our in-house synthetic data generation, including producing the very deepfakes our models learn to catch. This is a full-time role, reporting to our Director of Data. Responsibilities include:

  • Own the end-to-end data platform for AI research: continuous ingestion, preprocessing, governance, and export of image, video, audio, and text data at high volume.
  • Complete and scale our Databricks lakehouse and distributed processing stack (Spark, Ray, or similar), making architecture and build-vs-buy decisions that hold up as data volume grows.
  • Build reusable infrastructure for in-house synthetic data generation, so researchers can produce new deepfake variants across modalities on demand instead of one-off.
  • Make every dataset reproducible and traceable through versioning, lineage, metadata, quality checks, and stable train/eval splits, so any model result can be tied back to the exact data behind it.
  • Own pipeline reliability, observability, and processing cost per dataset as core metrics of the platform.
  • Partner with ML researchers to understand their data needs and turn them into self-serve tools that speed up model iteration.
  • Mentor engineers and raise the bar on data engineering practices: code review, testing, documentation, and runbooks.
  • Work with Security and compliance stakeholders to make sure data handling, licensing, and access controls meet the standards our enterprise and government clients expect.
  • Help shape the long-term data platform roadmap with engineering and research leadership.

WHO YOU ARE.

  • 8+ years building data platforms or data infrastructure, including staff- or lead-level ownership of production pipelines that generate, ingest, or deliver data at high volume.
  • Deep hands-on experience with distributed processing (Spark, Ray, or similar) and lakehouse platforms, ideally Databricks, on top of cloud object storage (S3, GCS, or Azure Blob).
  • Production experience with Databricks, Unity Catalog, Delta Lake, and Spark on AWS, including performance tuning, access controls, and operational troubleshooting.
  • Experience working with large unstructured media such as video, audio, or images, including the realities of large files, decoding and transcoding, and metadata at scale.
  • A track record of building reproducible ML datasets: versioning, lineage, data quality validation, and orchestration (Airflow, Dagster, Databricks Workflows, or similar).
  • Strong Python and SQL, and the judgment to own ambiguous platform problems end-to-end on a lean team.
  • Own infrastructure and deployment automation using Terraform and CI/CD, including AWS storage, IAM, compute, Databricks resources, and distributed processing environments.
  • Experience building synthetic data generation pipelines or running generative models (diffusion, voice cloning/TTS, video generation) at scale. (nice to have)
  • Background supporting ML research teams with training and evaluation data, especially for multimodal models. (nice to have)
  • Experience in security, fraud, trust & safety, or another adversarial domain, or at a Series A or B startup where scope regularly outpaces headcount. (nice to have)

WITHIN 12 MONTHS, YOU'LL…

  • Own a mature, self-serve data platform that researchers use to create, version, and export datasets without waiting on platform support.
  • Have scaled synthetic data generation across vision, audio, and multimodal research, broadening our detection coverage of new generative techniques.
  • Deliver reproducible evaluation datasets that let the company compare model versions with confidence.
  • Be setting the multi-year data platform roadmap and leading high-leverage initiatives beyond the original scope.

WHAT WE OFFER.

Reality Defender offers the following benefits to all our employees, regardless of location:

  • Healthcare plans with 100% premium coverage for employees and partial coverage available for dependents
  • Dental and Vision plans with 100% premium coverage for employees and their dependents
  • Short/Long-term disability and life insurance plans with 100% premium coverage for employees
  • FSA/HSA and 401k programs
  • Equity compensation
  • 20 days of PTO per year
  • 12 weeks of Parental Leave
  • Learning and Development budget
  • Monthly wellness benefits
  • Annual company-sponsored offsite

For employees working from Reality Defender's HQ in NYC, we offer the following benefits:

  • Daily in-office lunch through UberEats
  • Commuter benefits
  • Remote Fridays
  • Happy Hours and other local events

Base salary range: 210,000 - 260,000, based on experience, level, and location. Role includes equity.

Something wrong with this job? Report it · This flag looks wrong