Data Engineer jobs

Data Engineer

J5 ConsultingMcLean, VAFull-timeOn-siteFirst seen 20 days ago

Pay not listed

Key facts

Schedule
PRN
Clearance
Security clearance required

Looks real. 1 thing to check before you apply.

On J5 Consulting’s own careers site (JazzHR), checked open today.

  • To check: No pay range listed, though one is likely required in VAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteJazzHR board
  • Checked: Checked open todayJazzHR board
  • Checked: No reposts foundJazzHR board
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

What you’ll do

  • Build and maintain production-scale data pipelines and ETL/ELT workflows.
  • Process distributed data with Spark and PySpark, and orchestrate workflows in cloud environments.
  • Design and tune database schemas and SQL queries for analytical workloads.
  • Apply data security, privacy, governance, and compliance principles to data systems.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Demonstrated experience with Agile/Scrum development methodologies
  • Demonstrated experience working in high-performing, cross-functional teams with multiple concurrent projects
  • Demonstrated experience gathering stakeholder requirements and translating them into technical solutions with minimal oversight
  • Demonstrated experience with self-directed work, code quality, testing, and documentation
  • Demonstrated experience context-switching between projects and systems
  • Demonstrated experience building production data pipelines and ETL/ELT workflows at scale
  • Demonstrated experience with Apache Spark and PySpark for distributed data processing
  • Demonstrated experience with advanced Python programming, including Pandas, NumPy, and data engineering best practices
  • Demonstrated experience with data security, privacy, governance, and compliance principles
  • Demonstrated experience with workflow orchestration tools such as Step Functions and Airflow
  • Demonstrated experience with Docker or Podman and deploying data applications in cloud environments
  • Demonstrated experience with AWS services, particularly S3, Lambda, and Step Functions
  • Demonstrated production experience with PostgreSQL and MySQL, including performance tuning and schema design
  • Demonstrated experience with SQL and query optimization for complex analytical workloads
  • Demonstrated experience with Git and CI/CD practices for data pipelines
  • Demonstrated experience with data lakehouse architectures using Apache Iceberg (preferred)
  • Demonstrated experience configuring, deploying, and integrating Apache Ranger, Trino, data catalogs such as Unity Catalog OSS or Apache Polaris, and Apache Superset (preferred)
  • Demonstrated experience with Bash scripting for automation and data processing (preferred)
  • Demonstrated experience with Infrastructure as Code using Terraform or CloudFormation (preferred)
  • Demonstrated experience with data lineage tooling such as OpenLineage (preferred)
  • Demonstrated experience with Java (preferred)
  • Demonstrated experience with data quality frameworks, testing methodologies, and validation strategies (preferred)
  • Demonstrated experience with large-scale data migrations or platform modernization (preferred)
  • Demonstrated experience integrating AI/ML services and models, LLMs, and RAG pipelines (preferred)
  • Demonstrated experience with geospatial data processing such as H3 or PostGIS (preferred)
  • Demonstrated experience contributing to data engineering documentation, best practices, or design patterns (preferred)
  • Demonstrated experience with NoSQL databases such as DynamoDB (preferred)
  • Demonstrated experience communicating with technical and non-technical audiences (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From J5 Consulting’s careers site

J5 Consulting is a Maryland based company established in 2006 to provide computing and consulting services for government and commercial entities. Our services improve Information System networking performance and compliance and protect electronic assets from loss and compromise. We welcome your application to receive consideration for the following position.

Show full descriptionShow less

Introduction The Sponsor’s office is architecting and creating a coherent secure data ecosystem that is compatible and synchronized with the overall Sponsor’s data strategy and broader mission capabilities. These solutions and capabilities include a platform to conduct enterprise search, digital forensics, and data analytics. The Sponsor fuses modern, data-centric tradecraft and capabilities with other components in pursuit of extracting maximum value from existing data.

Required Skills and Demonstrated Experience:

  • Demonstrated experience with Agile/Scrum development methodologies in a fast-paced, collaborative team environment.
  • Demonstrated experience working effectively in high-performing, cross-functional teams with multiple concurrent projects.
  • Demonstrated experience working directly with stakeholders to gather requirements, understand needs, and translate them into technical solutions with minimal oversight.
  • Demonstrated experience in self-directed work with a strong ownership mentality and commitment to code quality, testing, and documentation.
  • Demonstrated experience context-switching between projects and systems as priorities demand
  • Data Engineering
  • Demonstrated experience building production data pipelines and ETL/ELT workflows at scale
  • Demonstrated experience with Apache Spark and PySpark for distributed data processing
  • Demonstrated experience with advanced Python programming skills including data manipulation libraries (Pandas, NumPy) and data engineering best practices.
  • Demonstrated experience understanding data security, privacy, governance, and compliance principles.
  • Demonstrated experience with workflow orchestration tools such as Step Functions and Airflow
  • Demonstrated experience with containerization such as Docker or Podman, and deploying data applications in cloud environments.
  • Demonstrated experience with AWS services (in particular S3, Lambda, and Step Functions)
  • Demonstrated experience with PostgreSQL and MySQL in production environments, including performance tuning and schema design.
  • Demonstrated experience with SQL and query optimization for complex analytical workloads
  • Demonstrated experience with version control (Git) and CI/CD practices for data pipelines
  • Demonstrated experience working with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight.
  • Demonstrated experience with strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks.

Highly Desired Skills and Demonstrated Experience:

  • Data Engineering
  • Demonstrated experience with data lakehouse architectures using Apache Iceberg.
  • Demonstrated experience configuring, deploying, and integrating data platform components: Apache Ranger (access control and data governance); Trino (distributed SQL query engine); Data catalogs (Unity Catalog OSS, Apache Polaris, etc.); Apache Superset (data visualization and dashboarding).
  • Demonstrated experience with Bash scripting for automation and data processing tasks
  • Demonstrated experience with Infrastructure as Code (Terraform or CloudFormation) for data infrastructure.
  • Demonstrated experience with tracking data lineage and associated tooling such as OpenLineage.
  • Demonstrated experience with Java.
  • Demonstrated experience with data quality frameworks, testing methodologies, and validation strategies.
  • Demonstrated experience or background with large-scale data migrations or platform modernization efforts.
  • Demonstrated experience integrating AI/ML services and models (translation, OCR, speech-to-text, NLP, language detection, topic modeling), LLMs, and RAG (retrieval-augmented generation) pipelines.
  • Demonstrated experience with geospatial data processing (H3, PostGIS, or similar).
  • Demonstrated experience contributing to data engineering documentation, best practices, or design patterns.
  • Demonstrated experience with NoSQL databases (DynamoDB, etc.).
  • Demonstrated experience with excellent written and verbal communication skills with both technical and non-technical audiences.

__________________________________________________________________________________

US Citizenship:

  • This position requires US Citizenship. Verification of US Citizenship to meet federal government security requirements will be confirmed.

Security Clearance:

  • The successful candidate must have an active U.S. Government Top Secret Security Clearance with a Full Scope Polygraph.
  • Clearance Verification: This position requires successful verification of the stated security clearance to meet federal government customer requirements. You will be asked to provide clearance verification information prior to an offer of employment.

Travel:

  • This position is expected to be onsite. The position will be located within the Washington Metropolitan Area (WMA). Local travel/POV will be on an as needed basis, within the local place of performance.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Data Engineer

West 4th Strategy · Arlington, VA

$150k–$160k/yrFull-timeHybrid

StrongChecked open todayPosted 20 days ago

Data Integration Engineer

Red Arch Solutions · Reston, VA

$160k–$185k/yrFull-timeHybrid

StrongChecked open todayPosted 20 days ago

Principal Data Architect

Hatch IT · Reston, VA

$220k–$250k/yrFull-timeHybrid

StrongChecked open todayPosted 17 days ago

Senior Analytics Engineer

BetterUp · Austin, TX +3 places

$158k–$220k/yrFull-timeHybrid

StrongChecked open todayPosted 1 month ago

See more like this