Design, develop, and optimize data pipelines, ETL mappings, and data architectures in the DON Jupiter environment and AWS GovCloud.
Build and maintain Informatica extraction and transformation workflows and Databricks loading workflows.
Write and optimize SQL and Python scripts for database schemas, data loading, migration, and table and view manipulation.
Develop APIs to connect data sources and streamline secure data ingestion.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Licenses and certifications
Active CompTIA Security+ certification; may be required within 90 days of onboarding (preferred)
Experience
Experience applying modern data engineering methodologies, pipeline design patterns, and enterprise data architecture practices, especially cloud-based frameworks
Hands-on experience with AWS cloud-native storage, compute, and analytics services
Experience migrating databases from legacy on-premises environments to AWS
Direct experience supporting NAVAIR IT applications, programs, or projects within Navy-approved networks (preferred)
Education
BS/BA degree and 3 years of related experience, or AA/AS degree and 7 years of related experience, or high school education and 9 years of related experience
Skills
Strong proficiency in Informatica and Databricks for enterprise-level ETL/ELT pipelines
Mastery of SQL
Strong proficiency in data analysis and MS Excel for data manipulation and validation
Strong working knowledge of RESTful API development, JSON data structures, and secure data exchange protocols
Proficiency in Python for Databricks, JavaScript, and legacy Visual Basic (VB) (preferred)
Familiarity with TOAD for Oracle (preferred)
Other requirements
Must be eligible to obtain a Secret clearance
U.S. citizenship is required to obtain a clearance
Active Secret clearance; interim Secret clearance is acceptable to start (preferred)
Benefits
Health insurance
Employer-paid health care plans for employees and family
Retirement plan
401(k) and IRA
Paid time off
Paid vacation, sick leave, and public holidays
Equity
Stock option benefit
Learning & tuition
Training and development
Wellness & mental health
Wellness resources
Life & disability insurance
Basic and voluntary life insurance, AD&D, short-term disability, and long-term disability
Full job description
From Saalex’s careers site
Spalding, a Saalex Company is seeking a Data Engineer/ETL Developer in Lexington Park, MD. Spalding, a Saalex Company is a professional services company delivering cutting-edge solutions to the Department of War. Our expert-level solutions include software development, information technology, program management, financial management and business intelligence services.
Position Type: Full-time
Salary: $90k-$125k annually (depending upon experience)
Work Location: Hybrid remote/in-office (see onsite requirements below).
**Onsite Requirements: Position may require on-site work at PAX approximately 1 day per week for meetings, collaboration, and technical tasking.
Essential Functions:
Show full descriptionShow less
Design, develop, and optimize data pipelines, ETL mappings, and data architectures within the Department of the Navy (DON) Jupiter enterprise data environment and the AWS Gov Cloud ecosystem.
Build and maintain scalable extraction, transformation in Informatica; and loading workflows using modern cloud-native data processing in Databricks.
Author, refine, and optimize advanced SQL and python scripts to support schema creation, data population, truncation, migration, and complex manipulation of tables, views, and materialized views.
Architect and deploy custom Application Programming Interfaces (APIs) to securely connect disparate data sources and streamline data ingestion pipelines.
Proactively identify, diagnose, and resolve technical issues, errors, and performance bottlenecks within the cloud data warehouse and associated ETL frameworks.
Perform comprehensive data collection, pattern analysis, validation testing, and quality troubleshooting across large, complex datasets.
Other duties as assigned.
Requirements
Required:
Proven experience applying modern data engineering methodologies, pipeline design patterns, and enterprise data architecture practices (with an emphasis on cloud-based frameworks).
Strong technical proficiency in Informatica and Databricks for orchestrating complex, enterprise-level ETL/ELT pipelines.
Hands-on experience working with cloud-native storage, compute, and analytics services within AWS, alongside a proven track record of executing database migrations from legacy on-premises environments to AWS.
Mastery of SQL is required.
Strong proficiency in data analysis techniques and tooling, including MS Excel for rapid data manipulation and validation is required.
Strong working knowledge of RESTful API development, JSON data structures, and secure data exchange protocols is required.
Desired:
Proficiency in Python (for Databricks), JavaScript, and legacy Visual Basic (VB) is highly preferred to support legacy systems and custom automation.
Familiarity with TOAD for Oracle is preferred.
Direct experience supporting NAVAIR IT applications, programs, or projects within Navy-approved networks is highly desired.
Possession of an active CompTIA Security+ certification is preferred to satisfy DoD 8570/8140 compliance requirements for elevated privilege roles. May be required to obtain within 90 days upon onboarding.
Education:
BS/BA degree and 3 years related experience OR AA/AS degree and 7 years related experience OR HS and 9 years related experience.
Security Clearance:
Must be eligible to obtain a Secret clearance. Active Secret clearance desired, interim Secret acceptable to start. Requirements to obtain a clearance include US Citizenship, security investigation, etc.
Benefits
Employer Paid Health Care Plans for Employees & Family