Data Engineer jobs

Data Engineer- SME

SOSiHuntsville, ALFull-time

Pay not listed

Key facts

Experience
7+ years
Degree
Bachelor's degree
Clearance
TOP SECRET clearance required

Looks real. 2 things to check before you apply.

On SOSi’s own careers site (SmartRecruiters), checked open today.

  • To check: Posted by the employer 4 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteSmartRecruiters board
  • Checked: Checked open todaySmartRecruiters board
  • Checked: No reposts foundSmartRecruiters board
  • Trust score 85 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Build and maintain data pipelines, ETL processes, and storage systems; design end-to-end data architectures and infrastructure.
  • Lead teams developing complex data pipelines and machine-learning systems, and build services that support machine-learning workflows.
  • Integrate software components into functional data systems; write maintainable code and implement CI/CD pipelines and DevSecOps practices.
  • Analyze petabyte-scale data and automate manual workflows in collaboration with data scientists.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • At least 7 years of experience as a Data Engineer/Scientist or in an advanced analytical role
  • Experience in data engineering and/or software development
  • Experience developing back-end systems and services
  • Significant experience with petabyte-scale data sets (preferred)
  • Significant experience with large-scale, multi-INT analytics (preferred)

Education

  • BS or MS in Computer Science, Statistics, Mathematics, Physics, or a quantitative field (preferred)

Skills

  • Expertise with Python, GIT, YAML, Docker, and SQL
  • Knowledge of CI/CD and Agile methodologies
  • Understanding of software design and system integration

Other requirements

  • Top Secret security clearance with SCI eligibility

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From SOSi’s careers site

Company Description

Founded in 1989, SOSi is among the largest private, founder-owned technology and services integrators in the defense and government services industry. We deliver tailored solutions, tested leadership, and trusted results to enable national security missions worldwide.

Job Description

Overview

SOSi is seeking an expert Data Engineer to join our analytics team working on an innovative MLOps workload leveraging cutting-edge technologies and supporting a government customer in Huntsville, Alabama. This role will be responsible for delivering automation to key national security missions interacting with petabyte-scale data on supercomputing resources.

Show full descriptionShow less

In this role, you will construct data analytical infrastructure, data engineering, data mining, exploratory analysis, predictive analysis, and statistical analysis. You will leverage scientific techniques to transform petabyte-scale data into insightful data products to enable data-driven decisions. You will partner with Data Scientists to refactor manual workflows to produce highly automated MLOPs based workloads. You will perform using Scrumban techniques and be embedded with end users.

The team will work with technologies including:

  • Open source, commercial, and government software packages such as PyTorch, TensorFlow, GitLab, Atlassian Suite, Linux, and Microsoft Suite
  • SQL and NOSQL databases such as PostgreSQL, Wevaiate, Neo4j, and MongoDB
  • Microservice architecture and containerization with Docker and Kubernetes
  • Apache products such as Kafka, Airflow, and Spark
  • Leverage GitOps patterns and CI/CD with tools like GitLab, Argo, and Harness

Essential Job Duties

  • Build and maintain data pipelines, ETL processes, and storage systems
  • Design end-to-end data architectures and infrastructure
  • Lead teams building complex data pipelines and ML systems
  • Develop services and extend infrastructure to enable machine learning workflows
  • Integrate software components into functional data systems
  • Write clean, testable, maintainable code in Python and other languages
  • Implement CI/CD pipelines and DevSecOps best practices
  • Create technical documentation for software systems
  • Collaborate across teams to share knowledge and leading practices

Qualifications

  • Top Secret Security Clearance with SCI eligibility
  • At least 7 years of experience as a Data Engineer/Scientist or advanced analytical role
  • Experience in data engineering and/or software development
  • Expertise with Python, GIT, YAML, Docker, and SQL
  • Knowledge of CI/CD and Agile methodologies
  • Experience developing back-end systems and services
  • Understanding of software design and system integration

Preferred Qualifications

  • Significant Experience with Petabyte scale data sets
  • Significant Experience with large-scale, multi-INT analytics
  • BS or MS in Computer Science, Statistics, Mathematics, Physics or a quantitative field

Additional Information

Work Environment

  • Working conditions are normal for an office environment.
  • Fast paced, deadline-oriented environment.
  • May require periods of non-traditional working hours including consecutive nights or weekends (if applicable).

Working at SOSi

All interested individuals will receive consideration and will not be discriminated against for any reason.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Senior Data Engineer

AIR Communities · Denver, CO

$125k–$145k/yrFull-timeOn-site

StrongChecked open todayPosted 2 days ago

Lead Data Engineer

AIR Communities · Denver, CO

$135k–$160k/yrFull-timeOn-site

StrongChecked open todayPosted 2 days ago

Sr. Data Engineer

NBCUniversal · New York, NY

$115k–$145k/yrFull-timeHybrid

StrongChecked open todayPosted 2 days ago

Data Engineer

Mindex · Remote · US only

$90k–$140k/yrFull-time

StrongChecked open todayPosted 7 days ago

See more like this