Data Engineer jobs

Senior Apache NiFi/Data Integration Engineer

Red Arch SolutionsRemote · US onlyFull-timeFirst seen 21 days ago

$185k–$215k/yr listed by the employer

Above the typical $155k a year for senior remote Data Engineer jobsHow we compare

How we compare. Typical is the median yearly pay of 139 senior remote Data Engineer jobs that list pay, from the employers' own postings. About means within 5%.

Key facts

Experience
12+ years
Degree
Bachelor's degree
Clearance
TS SCI clearance required

Strong: looks real and checked open today.

On Red Arch Solutions’ own careers site (JazzHR).

  • Checked: On the company's own careers siteJazzHR board
  • Checked: Checked open todayJazzHR board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundJazzHR board
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Design, develop, test, deploy, and maintain Apache NiFi flows for enterprise data onboarding and integration.
  • Build custom NiFi processors, controller services, reporting tasks, and reusable components using Java.
  • Integrate enterprise systems and develop secure, scalable ingestion and routing pipelines.
  • Implement metadata collection, tagging, enrichment, validation, and governance capabilities in onboarding workflows.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Licenses and certifications

  • Active TS/SCI clearance

Experience

  • 12+ years of experience working with users to define database use, data analytics, and the data user experience
  • 12+ years of data integration, ETL, or enterprise middleware experience
  • 8+ years of hands-on Apache NiFi development experience
  • Experience designing and supporting large-scale enterprise data ingestion architectures
  • Experience onboarding new data sources and integrating complex systems
  • Experience developing custom Java-based NiFi processors, controller services, reporting tasks, custom APIs, schema validation components, metadata extraction processors, content parsing processors, or
  • Experience supporting DIA, NSA, NGA, or other Intelligence Community customers (preferred)
  • Experience integrating with Data Catalog platforms and metadata repositories (preferred)
  • Experience with ontology, taxonomy, and semantic tagging implementations (preferred)
  • Familiarity with Cloudera DataFlow, Hortonworks DataFlow, or large-scale NiFi deployments (preferred)
  • Experience developing automated onboarding workflows (preferred)
  • Experience operating in highly regulated or classified environments (preferred)

Education

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or a related technical discipline (preferred)

Skills

  • Demonstrated expertise in NiFi flow design, process groups, remote process groups, Site-to-Site communications, controller services, parameter contexts, flow versioning, NiFi Registry, clustereddeploy
  • Demonstrated expertise in clustered deployments, provenance tracking, back-pressure management, flow performance tuning, and secure flow design
  • Strong experience with Java, Spring Framework, JSON, XML, Avro, Parquet, REST APIs, SQL, PostgreSQL, Elasticsearch, Kafka, Git, Docker, Kubernetes, and Linux
  • Understanding of Zero Trust Architecture, data-centric security, PKI, TLS, identity and access management, data governance, metadata management, and enterprise architecture principles
  • Knowledge of enterprise data governance and stewardship processes (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Red Arch Solutions’ careers site

Apache NiFi Engineer / Data Integration Engineer

Show full descriptionShow less

Position Overview Red Arch Solutions is seeking a highly skilled Apache NiFi Engineer to support enterprise data onboarding, integration, and transformation initiatives within a Zero Trust environment. The successful candidate will design, develop, deploy, and maintain complex Apache NiFi data flows that enable secure, scalable, and reliable movement of mission and enterprise data across disparate systems. This role requires deep expertise in Apache NiFi architecture, custom processor development, enterprise integration patterns, metadata management, data transformation, and workflow automation. The engineer will work closely with Data Stewards, Enterprise Architects, Zero Trust Core Services teams, Data Catalog personnel, system owners, and mission stakeholders to onboard new data sources and ensure compliance with enterprise data standards and security requirements.

KEY RESPONSIBILITIES Apache NiFi Development & Engineering

  • Design, develop, test, deploy, and maintain complex Apache NiFi data flows supporting enterprise data onboarding and integration requirements.
  • Engineer scalable and fault-tolerant ingestion pipelines capable of processing structured, semi-structured, and unstructured data.
  • Develop reusable flow frameworks and integration patterns to accelerate onboarding activities.
  • Optimize flow performance, throughput, latency, and resource utilization across clustered environments.
  • Troubleshoot and resolve complex data movement, transformation, and processing issues.

Advanced Processor Development

  • Develop custom Apache NiFi processors, controller services, reporting tasks, and extensions using Java.
  • Create specialized processors supporting:
  • Metadata extraction
  • Schema validation
  • Data tagging
  • Attribute enrichment
  • Security classification enforcement
  • Data quality validation
  • API integrations
  • Workflow automation
  • Extend NiFi capabilities to support mission-specific onboarding requirements.
  • Develop shared processor libraries and reusable components.

Enterprise Data Integration

  • Integrate enterprise systems using:
  • REST APIs
  • SOAP Services
  • JDBC/ODBC Connections
  • Message Queues
  • Kafka
  • File-Based Transfers
  • Cloud Storage Services
  • Design data ingestion and routing strategies across multiple environments.
  • Support onboarding of mission and enterprise data assets into approved repositories and data services.

Metadata & Data Governance

  • Implement metadata collection, tagging, and enrichment capabilities within data onboarding workflows.
  • Support enterprise data catalog and governance initiatives.
  • Ensure onboarding workflows comply with metadata standards, taxonomy requirements, and stewardship processes.
  • Collaborate with Data Stewards and Data Owners to improve data quality and discoverability.

Zero Trust & Security Integration

  • Implement secure data movement patterns aligned with Zero Trust principles.
  • Integrate authentication, authorization, encryption, and auditing capabilities into data pipelines.
  • Coordinate with cybersecurity and Zero Trust teams to ensure compliance with enterprise security requirements.
  • Support Attribute-Based Access Control (ABAC) and policy-driven data access models.

REQUIRED QUALIFICATIONS Experience

  • 12+ years experience. Experience working with users to help define their database use, data analytics, and the data user experience.
  • 12+ years of data integration, ETL, or enterprise middleware experience.
  • 8+ years of hands-on Apache NiFi development experience.
  • Experience designing and supporting large-scale enterprise data ingestion architectures.
  • Experience onboarding new data sources and integrating complex systems.

Advanced Apache NiFi Skills Demonstrated expertise with:

  • NiFi Flow Design
  • Process Groups
  • Remote Process Groups
  • Site-to-Site Communications
  • Controller Services
  • Parameter Contexts
  • Flow Versioning
  • NiFi Registry
  • Clustered Deployments
  • Provenance Tracking
  • Back-Pressure Management
  • Flow Performance Tuning
  • Secure Flow Design

Exceptional Processor Development Skills Experience developing custom:

  • Java-based NiFi Processors
  • Controller Services
  • Reporting Tasks
  • Custom APIs
  • Schema Validation Components
  • Metadata Extraction Processors
  • Content Parsing Processors
  • Security Enforcement Processors
  • Data Quality Validation Processors

Technical Expertise Strong experience with:

  • Java
  • Spring Framework
  • JSON
  • XML
  • Avro
  • Parquet
  • REST APIs
  • SQL
  • PostgreSQL
  • Elasticsearch
  • Kafka
  • Git
  • Docker
  • Kubernetes
  • Linux

Security & Architecture Understanding of:

  • Zero Trust Architecture
  • Data-Centric Security
  • PKI
  • TLS
  • Identity and Access Management
  • Data Governance
  • Metadata Management
  • Enterprise Architecture Principles

Clearance

  • Active TS/SCI clearance required.

Education (Desired)

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related technical discipline.

DESIRED QUALIFICATIONS

  • Experience supporting DIA, NSA, NGA, or other Intelligence Community customers.
  • Experience integrating with Data Catalog platforms and metadata repositories.
  • Experience with ontology, taxonomy, and semantic tagging implementations.
  • Familiarity with Cloudera DataFlow, Hortonworks DataFlow, or large-scale NiFi deployments.
  • Experience developing automated onboarding workflows.
  • Knowledge of enterprise data governance and stewardship processes.
  • Experience operating in highly regulated or classified environments.

Ideal Candidate The ideal candidate is not simply a NiFi user, but a NiFi architect and developer who can build custom processors from scratch, solve complex integration challenges, optimize enterprise-scale data flows, and lead onboarding efforts across multiple systems and organizations. This individual should be the technical expert that other engineers rely upon for advanced flow design, custom processor development, and enterprise data integration solution

Salary Range for this opening $185-215K #CJ

Something wrong with this job? Report it

Similar remote jobs

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Data Integration Engineer

D.A. Davidson · Remote · US only

$74k–$106k/yrFull-time

StrongChecked open todayPosted 10 days ago

Senior Data Engineer

Machinify · Remote · US only

$180k–$220k/yr

StrongChecked open todayPosted 18 days ago

Senior Data Engineer

ReSource Pro · Remote · US only

$97k–$164k/yrFull-time

StrongChecked open todayPosted 18 days ago

See more like this