Data Engineer jobs

Staff Data Engineer, Core Migrations

MachinifyRemote · US only8+ years experience

$230k–$260k/yr listed by the employer

Looks real. 1 thing to check before you apply.

On Machinify’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 4 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Analyze legacy systems, reconstruct embedded business logic, and document lineage, mappings, and risks.
  • Design and build migration pipelines using Airflow and Spark, from ingestion through reconciliation and handoff.
  • Create automated reconciliation frameworks to verify migrated output against source data.
  • Own migration delivery from kickoff through go-live and hypercare, coordinating stakeholders and driving UAT to sign-off.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 8+ years as a hands-on Data Engineer or Software Engineer
  • Demonstrated experience independently owning complex, multi-stakeholder technical projects from start to finish
  • Ability to reconstruct intent from legacy ETL code and translate it faithfully into a modern stack
  • Experience designing automated data validation and reconciliation frameworks that prove migrated data matches source systems
  • Proven ability to drive alignment across engineering, operations, and client-facing teams simultaneously
  • Deep experience building automated reconciliation frameworks to ensure data fidelity between legacy and modern systems

Skills

  • Strong Python and SQL, including fluency with complex, unfamiliar legacy code
  • Deep understanding of Apache Spark distributed processing, performance tuning, partitioning, and debugging at scale
  • Advanced Apache Airflow skills, including designing and authoring production DAG architectures from scratch
  • Actively uses AI coding agents in daily engineering work and can evaluate AI-generated output critically
  • Proficient with AWS S3 and cloud-native data patterns, including partitioned object storage, secure cross-account access, and cost/performance trade-offs
  • Ability to write discovery specs, architecture docs, and stakeholder updates that are accurate, concise, and actionable for technical and non-technical audiences

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Full medical coverage for employees and their families.
Dental & vision
Full dental and vision coverage for employees and their families.
Retirement plan
401(k) with employer match.
Paid time off
Unlimited FTO.
Equity
Equity.
Other
Work from anywhere in the US; digital-first.

Full job description

From Machinify’s careers site

Machinify is a leading healthcare intelligence company with expertise across the payment continuum, delivering unmatched value, transparency, and efficiency to health plan clients across the country. Deployed by over 85 health plans, including many of the top 20, and representing more than 270 million lives, Machinify brings together a fully configurable and content-rich, AI-powered platform along with best-in-class expertise. We’re constantly reimagining what’s possible in our industry, creating disruptively simple, powerfully clear ways to maximize financial outcomes and drive down healthcare costs.

Show full descriptionShow less

As a Staff Data Engineer on the Migrations team, you are the end-to-end technical and operational owner of client migrations. You will drive the full lifecycle, from deep-dive legacy analysis to production deployment, while orchestrating collaboration across Operations, Client Success, Product, Data Science and Platform Engineering. You don't just implement; you own the outcome.

This is a high-trust, high-autonomy role for someone who can think like an architect, execute like a senior engineer, and coordinate like a program manager — all on the same project. You'll own the problem space from discovery to go-live, making the defining architectural decisions and writing the code that brings them to life.

What You’ll Do

  • Lead discovery & technical due diligence — get to the bottom of poorly documented legacy systems (ETL, stored procedures, reporting layers, file feeds), reconstruct the business logic, and capture it in the lineage maps, mapping specs, and risk analyses everyone builds from.
  • Reverse-engineer complex legacy systems using agents— you will be responsible for reverse-engineering complex, undocumented legacy systems (SSIS packages, stored procedures) where business logic is embedded, not documented. You must be able to reconstruct the intent of these systems to build modern, stable equivalents.
  • Drive ambiguity to resolution — spot the unknowns early, own the open questions, and pull answers from clients, SMEs, and Operations instead of waiting to be unblocked.
  • Architect & build the migration pipelines — turn intricate legacy logic into production-grade Airflow DAGs and Spark jobs on the Machinify platform, edge cases, payer-specific carve-outs, and business-rule exceptions included, owning the full flow from ingestion through reconciliation to steady-state handoff.
  • Make and document the hard architectural calls — own the decisions that matter (pipeline design, partitioning strategy, validation approach) and leave a clear trail of the reasoning so others can learn from and build on it.
  • Prove correctness at scale — build automated reconciliation frameworks that confirm, with confidence, that migrated output matches the source down to the row.
  • Own the program end to end — be the single technical owner from kickoff through go-live and hypercare: scope, sequence, and track the work, surface risks before they bite, align Operations, Client Success, Platform Engineering, SMEs, and the client, and drive UAT through to sign-off.
  • Raise the bar for the practice — Institutionalize migration knowledge by codifying runbooks and retrospectives, mentor L3/L4 engineers to build independent capability, and turn recurring migration pain points into scalable, reusable tooling.

What You Bring

  • 8+ years as a hands-on Data Engineer or Software Engineer, with demonstrated experience independently owning complex, multi-stakeholder technical projects from start to finish.
  • Strong Python and SQL — fluent with complex, unfamiliar legacy code, not just greenfield work.
  • Apache Spark — deep understanding of distributed processing, performance tuning, partitioning, and debugging at scale.
  • Apache Airflow — advanced; comfortable designing and authoring production DAG architectures from scratch.
  • AI-assisted development — actively uses coding agents (Claude, Copilot, Cursor, or equivalent) as a force multiplier in daily engineering work. Comfortable prompt-engineering for code generation, debugging, and documentation, and able to evaluate and trust AI output critically.
  • Legacy ETL stack — able to reconstruct intent from code and translate it faithfully into a modern stack (e.g., From SSIS, SQL Server stored procedures, T-SQL, or equivalent).
  • Data validation & reconciliation at scale — experience designing automated frameworks that prove migrated data matches source systems with high confidence.
  • AWS — proficient with S3, solid grasp of cloud-native data patterns such as partitioned object storage, secure cross-account access, and cost/performance trade-offs.
  • Cross-functional coordination — proven ability to drive alignment across engineering, operations, and client-facing teams simultaneously, without losing velocity.
  • Clear technical communication — able to write discovery specs, architecture docs, and stakeholder updates that are accurate, concise, and actionable for both technical and non-technical audiences.
  • Data-first mindset & fidelity — a rigorous, data-first mindset, with deep experience in building automated reconciliation frameworks that guarantee 100% data fidelity between legacy and modern systems.

🌱 Why Join Us

  • Full ownership — you own the whole arc of a migration, from first look to go-live. No fragmented handoffs — just the autonomy and context to do it well.
  • Immediate business impact — every migration you land enables a health plan to process claims more accurately and efficiently.
  • Technical depth + breadth — you'll work across legacy systems, modern orchestration, distributed compute, cloud infra, and client-facing delivery in every project.
  • Pivotal moment — we're scaling the migrations capability for a fast-growing platform; the standards and patterns you set will shape how dozens of future migrations run

What We Offer

  • Work from anywhere in the US! Machinify is digital-first.
  • Full Medical/Dental/Vision for employees & their families
  • Flexible and trusting environment where you’ll feel empowered to do your best work
  • Unlimited FTO
  • Competitive salary, equity, 401(k) including employer match

The salary for this position is based on an array of factors unique to each candidate: Such as years and depth of experience, set skills, certifications, etc. The base salary range for this role is $230k-$260k. We are hiring for different levels, and our Recruiting team will let you know if you qualify for a different role/range. Salary is one component of the total compensation package, which includes meaningful equity, excellent healthcare, flexible time off, and other benefits and perks.

Equal Employment Opportunity at Machinify

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace. Machinify is an employment at will employer. We participate in E-Verify as required by applicable law. In accordance with applicable state laws, we do not inquire about salary history during the recruitment process. If you require a reasonable accommodation to complete any part of the application or recruitment process, please let our recruiters know. See our Candidate Privacy Notice at: https://www.machinify.com/candidate-privacy-notice/

Something wrong with this job? Report it · This flag looks wrong

Similar remote jobs

Staff Data Engineer

Fanatics Betting & Gaming · Remote · US only

$181k–$238k/yrFull-time

StrongChecked open todayPosted 16 days ago

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted today

Data Engineer

Mindex · Remote · US only

$90k–$140k/yrFull-time

StrongChecked open todayPosted 7 days ago

Data Integration Engineer

D.A. Davidson · Remote · US only

$74k–$106k/yrFull-time

StrongChecked open todayPosted 9 days ago

Principal Data Engineer

Constant Contact · Remote · US, Canada

$138k–$172k/yrFull-time

StrongChecked open todayPosted 11 days ago

See more like this