Data Engineer jobs

Data Platform Architect

Hatch ITFalls Church, VAFull-timeOn-sitePosted 3 months ago

Pay not listed

Key facts

Experience
5+ years
Clearance
TOP SECRET clearance required

Looks real. 1 thing to check before you apply.

On Hatch IT’s own careers site (Lever), checked open today.

  • To check: No pay range listed, though one is likely required in VAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteLever board
  • Checked: Checked open todayLever board
  • Checked: No reposts foundLever board
  • Trust score 90 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Guide teams building data pipelines, data products, analytics workflows, and AI/ML solutions on Databricks and Palantir Foundry.
  • Establish architecture standards, reusable patterns, and production practices for deployment, monitoring, governance, and data quality.
  • Advise on platform integrations, performance, security, and the transition of prototypes into reliable production workflows.
  • Collaborate with engineering, data science, analytics, platform, security, and mission teams, and maintain technical documentation.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 5+ years of technical experience
  • 3+ years designing or implementing production solutions on Databricks, Palantir Foundry, or similar modern data platforms
  • Experience with Palantir Foundry or comparable enterprise analytics platforms, including pipeline development, governed data delivery, lineage, and operational analytics
  • Experience designing and operationalizing data pipelines, transformation workflows, and data products supporting structured and unstructured data
  • Experience troubleshooting architecture, integration, performance, and operational issues across distributed data platforms
  • Ability to establish technical standards, guide architecture and implementation decisions, and communicate technical concepts to technical and non-technical stakeholders
  • Experience implementing solutions in Palantir Foundry, including data-pipeline organization, governed data assets, operational workflows, and integrations (preferred)
  • Experience with Git-based CI/CD pipelines, infrastructure and deployment tooling, and cloud-native platform services (preferred)
  • Experience supporting the ML lifecycle, including model packaging, registration, deployment, monitoring, and inference-workflow integration (preferred)
  • Experience with Advana/MAVEN Smart System (Palantir Foundry) or similar DoD enterprise analytics environments (preferred)
  • Prior experience supporting Department of Defense, Intelligence Community, or other Federal mission environments (preferred)

Skills

  • Strong experience with Python, SQL, PySpark, and Spark SQL for scalable data-processing workflows
  • Hands-on knowledge of Databricks platform capabilities such as Delta Lake, Workflows, MLflow, Unity Catalog, or similar platform-native services
  • Familiarity with DataOps, DevOps, and MLOps practices, including CI/CD, version control, testing, deployment, monitoring, and operational support
  • Strong understanding of data quality, metadata management, lineage, access control, and governance within secure or regulated environments
  • Deep Databricks expertise, including medallion architecture, Delta optimization, workload tuning, cluster and job strategy, and production ML enablement (preferred)
  • Knowledge of enterprise data integration, API-based data exchange, and secure cross-platform interoperability (preferred)

Other requirements

  • Secret or Top Secret clearance

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
PPO and HDHP medical insurance
Dental & vision
Dental and vision insurance
Retirement plan
401k matching
Paid time off
Generous PTO and holiday leave
Learning & tuition
Education reimbursement
Wellness & mental health
Onsite office gym access
Life & disability insurance
Complimentary life insurance
Commuter benefits
Commuter Benefits Plan

Full job description

From Hatch IT’s careers site

hatch I.T. is partnering with Expression to find a Data Platform Engineer. See details below: About The Role: Expression is seeking an experienced Data Platform Architect to provide architectural guidance, technical standards, and operational support for teams delivering secure, scalable data, analytics, and AI/ML solutions in mission environments. The Data Platform Architect will work across engineering, data science, analytics, platform, and mission teams to guide implementation in Databricks and Palantir Foundry. This role will help delivery teams structure data pipelines, data products, analytics and ML workflows, and platform assets so solutions are consistent, reusable, governed, supportable, and production-ready. The successful candidate will provide hands-on guidance spanning data integration, DataOps, DevOps, MLOps, governance, security, compliance, performance optimization, and platform operations while helping teams move solutions from prototypes into reliable production environments. Location and Clearance: Clearance: Secret/Top Secret clearance required Location: Falls Church, VA About the Company: Founded in 1997 and headquartered in Washington DC, Expression provides data fusion, data analytics, software engineering, information technology, and electromagnetic spectrum management solutions to the U.S. Department of Defense, Department of State, and national security community. Expression’s “Perpetual Innovation” culture focuses on creating immediate and sustainable value for their clients via agile delivery of tailored solutions built through constant engagement with their clients. Expression was ranked #1 on the Washington Technology 2018's Fast 50 list of fastest growing small business Government contractors and a Top 20 Big Data Solutions Provider by CIO Review.

Show full descriptionShow less

Responsibilities:

  • Provide hands-on architectural guidance to teams implementing data pipelines, analytics workflows, data products, and AI/ML capabilities in Databricks and Palantir Foundry. - Guide selection and implementation of platform-native capabilities for data ingestion, transformation, orchestration, model execution, analytics, and data-product delivery. - Advise teams on appropriate use of Databricks, Foundry, and integrated cross-platform architectures. - Guide the transition of prototypes and notebook-based solutions into reliable, maintainable production workflows. - Establish and maintain technical standards for project structure, code organization, pipeline design, workflow orchestration, testing, metadata, lineage, documentation, and platform implementation. - Develop reusable templates, reference architectures, and implementation patterns that improve consistency and accelerate delivery. - Promote scalable approaches including medallion architecture, governed data publishing, reusable transformation logic, and shared analytics and ML components. - Conduct technical reviews and provide actionable guidance to improve scalability, maintainability, reliability, and supportability. - Guide CI/CD implementation for jobs, pipelines, notebooks, packaged code, models, and data products. - Establish operational practices for deployment, environment promotion, monitoring, alerting, rollback, release management, observability, lineage, and data-quality validation. - Promote reproducible MLOps practices for model training, validation, packaging, registration, deployment, monitoring, batch inference, and lifecycle management using MLflow, Databricks workflows, and related capabilities. - Design scalable ML inference approaches supporting production workloads and establish monitoring for model performance, data drift, and system health. - Support self-service ML capabilities that enable data scientists to efficiently deploy and monitor models. - Define integration patterns for onboarding data sources, managing schema evolution, and connecting Databricks and Foundry with enterprise systems, applications, data warehouses, streaming platforms, APIs, and BI tools. - Guide implementation of secure access controls, governed data sharing, metadata management, data catalogs, lineage, traceability, and audit-ready workflows. - Establish data-quality standards and automated testing approaches for analytical and ML workloads. - Partner with stakeholders to define data definitions, business logic, governance requirements, and compliant handling of structured and unstructured data. - Advise teams on Spark optimization, workload design, workflow dependencies, storage and compute utilization, and other platform-performance considerations. - Identify and help resolve architecture, integration, reliability, and performance issues affecting production jobs, data products, and operational analytics. - Design data models supporting machine learning, analytics, and business intelligence requirements, including integrations with Tableau, Power BI, and Qlik Sense. - Build and support integrations with MAVEN Smart Systems/Palantir Foundry environments and other enterprise systems. - Collaborate with engineers, data scientists, BI analysts, product managers, platform and security teams, and mission stakeholders to align architecture decisions with delivery priorities. - Participate in design sessions, technical reviews, sprint activities, demonstrations, and cross-team problem solving. - Maintain technical documentation supporting implementation consistency, reuse, operational handoff, and long-term supportability.

Qualifications:

  • 5+ years of technical experience, including 3+ years designing or implementing production solutions on Databricks, Palantir Foundry, or similar modern data platforms. - Strong experience with Python, SQL, PySpark, and Spark SQL for scalable data-processing workflows. - Experience with Palantir Foundry or comparable enterprise analytics platforms, including pipeline development, governed data delivery, lineage, and operational analytics. - Experience designing and operationalizing data pipelines, transformation workflows, and data products supporting structured and unstructured data. - Hands-on knowledge of Databricks platform capabilities such as Delta Lake, Workflows, MLflow, Unity Catalog, or similar platform-native services. - Familiarity with DataOps, DevOps, and MLOps practices, including CI/CD, version control, testing, deployment, monitoring, and operational support. - Strong understanding of data quality, metadata management, lineage, access control, and governance within secure or regulated environments. - Experience troubleshooting architecture, integration, performance, and operational issues across distributed data platforms. - Ability to establish technical standards, guide architecture and implementation decisions, and clearly communicate technical concepts to technical and non-technical stakeholders.

Preferred Qualifications:

  • Deep Databricks expertise, including medallion architecture, Delta optimization, workload tuning, cluster and job strategy, and production ML enablement. - Experience implementing solutions in Palantir Foundry, including data-pipeline organization, governed data assets, operational workflows, and integrations. - Experience with Git-based CI/CD pipelines, infrastructure and deployment tooling, and cloud-native platform services. - Experience supporting the ML lifecycle, including model packaging, registration, deployment, monitoring, and inference-workflow integration. - Knowledge of enterprise data integration, API-based data exchange, and secure cross-platform interoperability. - Experience with Advana/MAVEN Smart System (Palantir Foundry) or similar DoD enterprise analytics environments. - Prior experience supporting Department of Defense, Intelligence Community, or other Federal mission environments.

Benefits: Expression offers competitive salaries and benefits, such as: 401k matching PPO and HDHP medical/dental/vision insurance Education reimbursement Complimentary life insurance Generous PTO and holiday leave Onsite office gym access Commuter Benefits Plan

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Principal Data Architect

Hatch IT · Reston, VA

$220k–$250k/yrFull-timeHybrid

StrongChecked open todayPosted 17 days ago

Data Architect (DataOps) - SME

Accenture Federal Services · Chantilly, VA

$110k–$224k/yr · see postingHybrid

Wide pay rangeChecked open todayPosted 1 month ago

Data Engineer

West 4th Strategy · Arlington, VA

$150k–$160k/yrFull-timeHybrid

StrongChecked open todayPosted 20 days ago

Data Integration Engineer

Red Arch Solutions · Reston, VA

$160k–$185k/yrFull-timeHybrid

StrongChecked open todayPosted 20 days ago

ETL Developer

GRVTY · McLean, VA

$150k–$250k/yr

StrongChecked open todayPosted 11 days ago

See more like this