Data Engineer jobs

AWS Databricks Developer

SAICCollege Park, MDHybridPosted 1 month ago

Pay not listed

Key facts

Experience
5+ years
Degree
Master's degree

Looks real. 1 thing to check before you apply.

On SAIC’s own careers site (Oracle Recruiting), checked open today.

  • To check: No pay range listed, though one is likely required in MDAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteOracle Recruiting board
  • Checked: Checked open todayOracle Recruiting board
  • Checked: No reposts foundOracle Recruiting board
  • Trust score 90 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Develop and maintain batch and incremental data pipelines on AWS using Databricks, PySpark, Spark SQL, and Delta Lake.
  • Build Bronze, Silver, and Gold data layers; ingest and transform data from databases, APIs, and files; implement data quality checks.
  • Optimize Spark jobs and Delta tables, and publish curated datasets to Amazon Redshift for reporting.
  • Orchestrate, monitor, and troubleshoot production pipelines using Databricks Workflows, Apache Airflow, and AWS monitoring services.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Licenses and certifications

  • Databricks Certified Data Engineer Associate certification (preferred)
  • AWS Certified Data Engineer Associate certification (preferred)

Experience

  • 5+ years of overall technology experience
  • 3+ years of AWS engineering experience
  • Hands-on experience with PySpark, Databricks, and Delta Lake
  • Experience building data pipelines on AWS, particularly with Amazon S3, AWS Glue, and Amazon Redshift
  • Experience with Git, CI/CD workflows, and Agile delivery
  • Experience with Databricks Auto Loader, Unity Catalog, and AWS Glue Data Catalog (preferred)
  • Experience supporting manufacturing, supply chain, quality, or operational analytics (preferred)

Education

  • Master's degree in a technical domain

Skills

  • Strong Python and SQL skills
  • Knowledge of incremental loading, dimensional data modeling, data quality practices, and Spark performance tuning

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From SAIC’s careers site

Position Overview

We are seeking a AWS Databricks Developer to build and maintain scalable data pipelines on AWS. This role will turn data from databases, APIs, and files into reliable datasets for analytics and business reporting.

Responsibilities:

- Develop batch and incremental ETL/ELT pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.

- Build and maintain Bronze, Silver, and Gold data layers using Medallion Architecture.

- Ingest and transform structured and semi-structured data from sources such as Oracle, SQL Server, REST APIs, and Amazon S3.

- Implement data quality checks, including schema validation, deduplication, reconciliation, and business rule enforcement.

Show full descriptionShow less

- Optimize Spark jobs and Delta tables to improve processing time and control cloud resource use.

- Publish curated datasets to Amazon Redshift and support reporting in Power BI, Tableau, or Amazon QuickSight.

- Orchestrate, monitor, and troubleshoot production pipelines using Databricks Workflows, Apache Airflow, and AWS monitoring services.

- Collaborate with analysts, architects, QA, and DevOps teams on requirements, releases, and production support.

Required Qualifications:

- Master's Degree in technical domain required.

- 5+ years of overall technology experience.

- 3+ years of AWS engineering experience.

- Strong Python and SQL skills, with hands-on experience in PySpark, Databricks, and Delta Lake.

- Experience building data pipelines on AWS, particularly with Amazon S3, AWS Glue, and Amazon Redshift.

- Knowledge of incremental loading, dimensional data modeling, data quality practices, and Spark performance tuning.

- Experience with Git, CI/CD workflows, and Agile delivery.

Preferred Qualifications:

- Experience with Databricks Auto Loader, Unity Catalog, and AWS Glue Data Catalog.

- Experience supporting manufacturing, supply chain, quality, or operational analytics.

- Databricks Certified Data Engineer Associate and AWS Certified Data Engineer Associate certification.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Medicaid Data Lead

Abt Global · Rockville, MD +3 places

$110k–$155k/yr

StrongChecked open todayPosted 8 days ago

AWS Databricks Engineer

Credence · McLean, VA

$155k–$185k/yrFull-time

StrongLast seen open yesterdayPosted 16 days ago

ETL Developer

GRVTY · McLean, VA

$150k–$250k/yr

StrongChecked open todayPosted 10 days ago

ETL Developer - SME

Accenture Federal Services · Chantilly, VA

$106k–$221k/yr · see posting

Wide pay rangeChecked open todayPosted 1 month ago

SQL Data Engineer

OpenDataJobs · Washington, DC

$120k–$140k/yrFull-timeHybrid

StrongChecked open todayPosted 8 days ago

See more like this