Data Engineer jobs

Chief Architect - Data Engineering (Databricks Practice)

Unison GroupCalifornia City, CAFull-time12+ years experience

Pay not listed

Looks real. 2 things to check before you apply.

On Unison Group’s own careers site (Workable), checked open today.

  • To check: Posted by the employer 3 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listed, though one is likely required in CAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteWorkable board
  • Checked: Checked open todayWorkable board
  • Checked: No reposts foundWorkable board
  • Trust score 80 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Own architecture and design decisions for Databricks engagements and lead delivery of production-grade data platforms.
  • Lead migrations from legacy data warehouses, ETL, Hadoop, and on-premises estates to Databricks on Azure, AWS, or GCP.
  • Tune performance, debug pipelines, review code and designs, and set engineering standards.
  • Lead presales discovery, solution design, estimation, proofs of concept, RFPs, and proposals; defend designs with executives and architecture boards.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Licenses and certifications

  • Databricks Data Engineer Professional or Solution Architect accreditation (preferred)

Experience

  • 12+ years in data engineering or architecture
  • 3+ years on Databricks at enterprise scale
  • Led large-scale migration and transformation programs
  • Presales experience across discovery, solutioning, estimation, PoCs, RFPs, and proposals
  • Experience integrating ML/AI, including MLflow or LLM APIs
  • Microsoft Fabric exposure (preferred)

Skills

  • Deep Spark expertise in architecture, performance tuning, streaming, and debugging
  • Lakehouse fluency, including Medallion architecture, Delta Lake, Unity Catalog, governance, and orchestration
  • Strong Python, SQL, and Scala
  • CI/CD for data platforms

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Unison Group’s careers site

We are building a fast-growing Databricks practice delivering enterprise data and AI solutions across APAC. As Lead Solution Architect – Data Engineering, you will be the technical anchor of the practice: leading solution design on client engagements, owning and defending enterprise architectures in presales, and driving large-scale migration and cloud transformation programs. This is a hands-on leadership role for a builder who can equally command a whiteboard in front of a CTO and a Spark UI when a pipeline misbehaves. You will also shape the practice itself — mentoring engineers, creating accelerators and reusable assets, and converting delivery success into case studies and go-to-market offerings.

Show full descriptionShow less

Architecture & Delivery

  • Own end-to-end architecture and design decisions on Databricks engagements, ensuring solutions are secure, scalable, performant, and aligned with Lakehouse best practices.
  • Lead delivery of production-grade data platforms — ingestion, transformation, orchestration, governance through Unity Catalog, and downstream BI/ML enablement.
  • Lead large-scale migrations (legacy DW/ETL, Hadoop, on-prem estates) and cloud transformation projects to Databricks on Azure/AWS/GCP, including assessment, wave planning, and cutover.
  • Stay hands-on: performance tuning, debugging, code and design reviews, and setting engineering standards for the team.

Presales & Stakeholder Management

  • Own and defend enterprise solution designs in front of architecture boards, CIOs, and CTOs — and enjoy it.
  • Drive presales end-to-end: discovery, solutioning, estimation, PoCs, RFPs, and proposals that convert.
  • Translate hard technical trade-offs into decisions executives can act on — from engineer to boardroom without changing gears.

Who Thrives Here

  • A builder at heart — 12+ years in data engineering/architecture, 3+ on Databricks at enterprise scale, and still happiest when hands are on the keyboard.
  • Deep Spark expertise — architecture, performance tuning, streaming, debugging, the advanced stuff that separates architects from diagram-drawers.
  • Lakehouse fluency — Medallion architecture, Delta Lake, Unity Catalog, governance, orchestration (Workflows, DLT/Lakeflow, Airflow, ADF); Microsoft Fabric exposure a bonus.
  • Battle-tested in migrations — you've led large transformation programs and have the scars and success stories to show for it.
  • Presales instinct — you don't just design solutions; you sell them, price them, and defend them under fire.
  • Modern edge — strong Python/SQL/Scala, CI/CD for data platforms, and comfort integrating ML/AI (MLflow, LLM APIs like OpenAI and Anthropic) into what you build.
  • Certified credibility — Databricks Data Engineer Professional / SA accreditations strongly preferred.
  • Founder energy — curiosity, adaptability, and the drive to build offerings, not just deliver projects

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Manager, Data Engineering

Fanatics Commerce · Redwood City, CA

$200k–$230k/yrHybrid

StrongChecked open todayPosted 9 days ago

See more like this