Data Engineer jobs

Data Engineering Lead

Ignite ITSuitland-Silver Hill, MDFull-time

Pay not listed

Key facts

Experience
8+ years
Clearance
Security clearance required

Looks real. 2 things to check before you apply.

On Ignite IT’s own careers site (Workable), checked open today.

  • To check: Posted by the employer 8 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listed, though one is likely required in MDAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteWorkable board
  • Checked: Checked open todayWorkable board
  • Checked: No reposts foundWorkable board
  • Trust score 70 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Document legacy file storage, SAS dataset dependencies, subsystem data flows, and manual handoffs.
  • Design and implement AWS cloud-native data models, ingestion pipelines, transformations, and validation workflows.
  • Build Python-based data processing frameworks and automated checks for migration accuracy and downstream compatibility.
  • Create dashboards and reports for data accuracy, pipeline health, and variance detection.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 8+ years of experience in data engineering or data architecture
  • Demonstrated experience transforming legacy file-based systems into cloud-native data architectures
  • Experience developing data models for high-volume, data-intensive applications
  • Deep experience with AWS data services, including Glue, Lambda, S3, Aurora/Postgres, and EventBridge
  • Experience designing scalable ETL/ELT pipelines
  • Experience building analytical dashboards, such as QuickSight or equivalent
  • Experience implementing automated data validation and quality controls
  • Experience working in Agile Scrum Teams
  • Experience modernizing SAS-based data environments (preferred)
  • Experience supporting system-of-systems integration programs (preferred)
  • Experience implementing data lineage and metadata management (preferred)
  • Experience operating in regulated or federal environments (preferred)

Skills

  • Expert-level proficiency in Python for data engineering

Other requirements

  • U.S. citizenship

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Health insurance with 3 plans to select from, Health savings account and flexible spending account
Dental & vision
Dental insurance and vision insurance
Retirement plan
401(k) with matching; 100% vested
Learning & tuition
Professional development assistance, training, and tuition reimbursement
Life & disability insurance
Life insurance, short-term disability, long-term disability, and AD&D
Other
Referral program and paid legal plan

Also: paid time off, flexible schedule

Full job description

From Ignite IT’s careers site

Position Overview

The Data Engineering Lead is responsible for designing and implementing modern, scalable data architectures to support migration of legacy, file-based analytical systems to AWS Cloud Native environments.

This role leads the transformation of legacy SAS-based data storage models—including flat files, batch outputs, and subsystem-specific data artifacts—into structured, governed, and scalable data models optimized for cloud-native processing.

Show full descriptionShow less

The Data Engineering Lead will ensure data integrity, performance, and visibility across a system-of-systems modernization initiative, while providing technical leadership for data modeling, ingestion patterns, validation frameworks, and transparency reporting.

Expert-level proficiency in Python and strong experience designing AWS-based data architectures are required.

Key Responsibilities

Legacy Data Discovery & Data Model Transformation

  • Participate in structured system inventory efforts to document:
  • Legacy file-based storage structures
  • SAS dataset dependencies
  • Subsystem data flows
  • Manual gating and handoff processes
  • Analyze legacy storage models and design target-state data models aligned to AWS Cloud Native architecture.
  • Replace file-driven batch dependencies with:
  • API-based ingestion
  • Event-driven workflows
  • Database-backed storage (e.g., Aurora/Postgres)
  • Define canonical data schemas and transformation standards.

Cloud-Native Data Architecture Design

  • Architect scalable AWS data pipelines using services such as:
  • S3
  • Glue
  • Lambda
  • EventBridge
  • SNS/SQS
  • Aurora/Postgres
  • Batch
  • Athena
  • Design data ingestion, staging, transformation, and validation workflows.
  • Establish schema management, versioning, and data lineage practices.
  • Optimize data storage for performance, scalability, and cost efficiency.
  • Support serverless and containerized data processing architectures.

Expert Python-Based Data Engineering

  • Develop advanced Python-based data transformation and validation pipelines.
  • Implement modular, reusable data processing components.
  • Optimize large-scale data manipulation for distributed execution.
  • Develop high-performance ETL/ELT frameworks.
  • Embed automated validation checks directly into data pipelines.

Expert-level Python proficiency is required, particularly for:

  • High-volume data processing
  • Data validation logic
  • Modular data engineering frameworks

Data Accuracy, Validation & Visibility

  • Design and implement automated data validation frameworks to ensure:
  • Functional equivalence during migration
  • Record-level and aggregate-level consistency
  • Downstream compatibility across subsystems
  • Develop dashboards and reporting mechanisms providing:
  • Data accuracy metrics
  • Pipeline health indicators
  • Variance detection summaries
  • Enable transparency into data transformation impacts across modernization phases.
  • Support regression validation through golden datasets and automated comparisons.

System-of-Systems Data Coordination

  • Coordinate with Senior Developers and Requirements Engineers to align data models with application modernization.
  • Ensure upstream/downstream data contract stability.
  • Prevent data thrashing during phased migration.
  • Support orchestration of gated workflows through automated triggers rather than manual file exchanges.
  • Collaborate across workstreams to establish shared data standards.

DevSecOps & Governance Alignment

  • Integrate data pipelines into CI/CD frameworks.
  • Support infrastructure-as-code alignment (Terraform/CloudFormation collaboration).
  • Ensure compliance with security controls (IAM, encryption, key management).
  • Produce documentation supporting:
  • Architecture review boards
  • Interface control documents
  • Data flow diagrams
  • Support ATO-related data validation evidence.

Requirements

Required Qualifications

  • 8+ years of experience in data engineering or data architecture.
  • Expert-level proficiency in Python for data engineering.
  • Demonstrated experience transforming legacy file-based systems into cloud-native data architectures.
  • Experience developing data models for high-volume, data-intensive applications.
  • Deep experience with AWS data services (Glue, Lambda, S3, Aurora/Postgres, EventBridge, etc.).
  • Experience designing scalable ETL/ELT pipelines.
  • Experience building analytical dashboards (e.g., QuickSight or equivalent).
  • Experience implementing automated data validation and quality controls.
  • Experience working in Agile Scrum Teams.
  • U.S. Citizenship required.

Preferred Qualifications

  • Experience modernizing SAS-based data environments.
  • Experience supporting system-of-systems integration programs.
  • Experience implementing data lineage and metadata management.
  • Experience operating in regulated or federal environments.

Key Competencies

  • Systems-level thinking across data ecosystems
  • Strong schema design and normalization expertise
  • Data accuracy and integrity focus
  • Automation-first mindset
  • Cross-workstream coordination capability

Benefits

  • 401(k) with matching and 100% Vested
  • Health Insurance - 3 plans to select from
  • Dental insurance
  • Vision Insurance
  • Health savings account
  • Life insurance
  • Short Term Disability
  • Long Term Disability
  • AD&D
  • Paid time off
  • Professional development assistance
  • Training
  • Tuition reimbursement
  • Flexible schedule
  • Flexible spending account
  • Referral program
  • Paid Legal Plan
  • and more....

Applicants selected may be required to possess and maintain a government clearance

US CITIZENSHIP REQUIRED

Ignite IT is an Equal Employment Opportunity/Affirmative Action Employer. We evaluate qualified applicants without regard to race, color, religion, sex, national origin, disability, Veteran status, sexual orientation, or other protected characteristic. In accordance with EO 13665 Final Rule, Ignite IT will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs in Maryland

Medicaid Data Lead

Abt Global · Rockville, MD +3 places

$110k–$155k/yr

StrongChecked open todayPosted 9 days ago

Data Engineer Lead

Analytica · Bethesda, MD

Full-timeHybrid

StrongPay not listedChecked open todayPosted 20 days ago

Lead Data Engineer

Blend360 · Remote · US only

$125k–$160k/yrFull-time

StrongOpen 3 monthsChecked open todayPosted 3 months ago

Lead Data Engineer

Black Canyon Consulting · Remote · US only

Looks goodPay not listedChecked open todayPosted 1 month ago

Data Architect

T-Rex Solutions · Suitland, MD

$150k–$195k/yrHybrid

StrongChecked open todayPosted 23 days ago

Data Engineer

GIGATEC Engineering · Annapolis Junction, MD

Full-time

StrongPay not listedChecked open todayPosted 20 days ago

See more like this