Data Engineer jobs

Lead Data Engineer (Lakehouse / Databricks)

Stafford GrayLansing, MIContractHybridPosted 8 days ago

Pay not listed

Key facts

Experience
4+ years
Degree
Bachelor's degree

This job is closed.

The employer took it down 2 days ago, after 6 days open. Here are similar open jobs.

  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteWorkable board
  • Checked: No reposts foundWorkable board
  • Note: Last seen open 5 days agoLive check
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

Similar open jobs

Sr. Data Engineer

Mariana Minerals · Ann Arbor, MI +1 place

$140k–$200k/yrFull-timeOn-site

Looks goodOpen 5 monthsChecked open todayPosted 5 months ago

Senior Data Engineer

Hearst · Troy, MI

Pay not listedHybrid

Looks good2 to checkChecked open todayPosted 3 months ago

See more like this

What you’ll do

  • Design, build, and maintain pipelines ingesting relational, semi-structured, and unstructured data into a cloud data lake.
  • Transform lake datasets through a Medallion architecture into traceable, Parquet-based data products.
  • Enforce data-sharing and access policies and design star-schema data stores for BI reporting.
  • Establish data quality, monitoring, validation, and governance standards.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 4+ years of hands-on experience building extract-and-load pipelines into an enterprise data lake on a major cloud provider
  • 4+ years of hands-on experience transforming data lake datasets into data products with traceability to the systems of record
  • 2+ years of experience enforcing data sharing or access policies on data products
  • 4+ years of programming in Python, PySpark, and SQL, including SQL tuning and loading data from databases, flat files, CSV, JSON, and APIs into Parquet
  • Experience designing star-schema data stores for BI reporting
  • Experience with cloud-native data governance and security tooling (preferred)
  • Experience with NoSQL and graph databases, and with ML pipelines (preferred)
  • A track record of championing data engineering standards across a developer community (preferred)

Education

  • Bachelor’s degree in Computer Science, Data Science, Information Systems, or a related field

Skills

  • Experience with Databricks, Spark, DBT, Glue, Redshift Spectrum, and SageMaker (preferred)
  • Experience with Kafka, Kubernetes, and Docker (preferred)
  • Experience with DevOps and infrastructure-as-code, including GitHub, Jenkins, Terraform, YAML, and Airflow DAGs (preferred)

Other requirements

  • Must live within 90 miles of Lansing, MI at the time of submission and be able to work a hybrid onsite schedule

Full job description

From Stafford Gray’s careers site

Stafford Gray is looking for a hands-on Lead Data Engineer to architect and build a modern cloud data lakehouse for a large public-sector organization. You’ll be the technical lead for data engineering. You’ll design and build the pipelines that feed the enterprise data lake, turn raw data into governed data products, and coach the in-house data engineers on standards and best practices. You’ll work alongside data scientists, analysts, and an external research team. This role is for someone who still builds every day and also sets direction for the team.

What you’ll do

Show full descriptionShow less
  • Design, build, and maintain pipelines that ingest relational, semi-structured, and unstructured data into a cloud data lake on AWS, Azure, or GCP.
  • Transform lake datasets through a Medallion (bronze/silver/gold) architecture into Parquet-based data products, with every attribute traceable back to its source system.
  • Enforce data sharing and access policies so each subscriber sees only the version of a data product they’re entitled to.
  • Design star-schema operational data stores that feed Power BI and Tableau reporting.
  • Set data quality, monitoring, validation, and governance standards.
  • Lead and mentor data engineers through design reviews, code reviews, and hands-on training.
  • Partner with data scientists, analysts, product teams, and business stakeholders to deliver data and ML solutions.

Requirements

Required

  • Bachelor’s degree in Computer Science, Data Science, Information Systems, or a related field.
  • 4+ years of hands-on experience building extract-and-load pipelines into an enterprise data lake on a major cloud provider.
  • 4+ years of hands-on experience transforming data lake datasets into data products with traceability to the systems of record.
  • 2+ years of experience enforcing data sharing or access policies on data products.
  • 4+ years of programming in Python, PySpark, and SQL, including SQL tuning and loading data from databases, flat files, CSV, JSON, and APIs into Parquet.
  • Experience designing star-schema data stores for BI reporting.
  • Must live within 90 miles of Lansing, MI at the time of submission and be able to work a hybrid onsite schedule.

Preferred

  • Databricks, Spark, DBT, Glue, Redshift Spectrum, and SageMaker.
  • Kafka, Kubernetes, and Docker.
  • DevOps and infrastructure-as-code: GitHub, Jenkins, Terraform, YAML, and Airflow DAGs.
  • Cloud-native data governance and security tooling.
  • Experience with NoSQL and graph databases, and with ML pipelines.
  • A track record of championing data engineering standards across a developer community.

Something wrong with this job? Report it · This flag looks wrong