Data Engineer jobs

Director of Technology, Enterprise Data Engineering

JobgetherRemote · US onlyFull-timePosted 23 days ago

$120k–$186k/yr listed by the employer

Key facts

Experience
10+ years
Degree
Bachelor's degree or equivalent
US visa
No US visa sponsorship

This job is closed.

The employer took it down 21 days ago, after 0 days open. Here are similar open jobs.

  • Checked: On the company's own careers siteLever board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundLever board
  • Note: Last seen open 21 days agoLive check
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

Similar jobs

Manager, Data Engineering

Fanatics Commerce · Redwood City, CA

$200k–$230k/yrHybrid

StrongChecked open todayPosted 8 days ago

Head of Data

Rocket Lawyer · Remote · US only

$205k–$361k/yr

StrongChecked open todayPosted 7 days ago

See more like this

What you’ll do

  • Lead and develop data engineering staff, including performance management, staffing, workload distribution, and career development.
  • Modernize legacy data platforms by migrating data lakes and curated stores to Databricks, and lead data architecture, modeling, ingestion, and pipeline reliability.
  • Develop semantic data assets, certified datasets, reusable engineering templates, and automated tooling for analytics and self-service pipeline development.
  • Establish AI-assisted engineering practices and standards, including tools for development, testing, documentation, and code review.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • At least 10 years of experience in data engineering or a related specialized technology field
  • At least three years of team leadership or management experience
  • Demonstrated experience leading legacy-to-cloud data platform migrations, managing enterprise data integrations, and working with vendor-provided SaaS solutions and internally developed systems
  • Experience working with large governed datasets
  • Experience building certified datasets and semantic models for self-service analytics or AI-assisted natural-language querying
  • Practical experience using AI tools such as Claude, Copilot, ChatGPT, or Gemini to improve engineering productivity and decision-making
  • Experience designing or governing AI-assisted software development workflows, including specification-driven development, autonomous coding agents, automated code review, and testing pipelines
  • Experience collaborating with Information Security and applying data privacy, access control, and regulatory requirements
  • Experience with Lakebase (preferred)
  • Experience developing internal platforms or self-service infrastructure for distributed engineering teams (preferred)
  • Experience in insurance or another regulated industry (preferred)
  • Formal mentoring and coaching experience (preferred)

Education

  • Bachelor's degree in Computer Science, Information Systems, or a related discipline, or equivalent professional experience

Skills

  • Strong hands-on knowledge of Databricks, including Unity Catalog, Delta Lake, medallion architecture, and Databricks Asset Bundles or YAML-based configurations
  • Advanced SQL and PySpark skills
  • Strong understanding of dimensional modeling, semantic layers, domain-driven design, and data lifecycle management
  • Familiarity with data quality frameworks, automated testing, reconciliation, and historical data management
  • Working knowledge of CI/CD practices for data pipelines, version control, governed deployment environments, and automated testing
  • Understanding of AI output validation, responsible AI principles, and AI governance
  • Familiarity with insurance regulations, including NAIC guidelines and state insurance requirements (preferred)
  • Familiarity with AWS-based data platforms, IBM DataStage, PostgreSQL, Oracle source systems, Lakebase, Agent Bricks, or MLflow (preferred)
  • Knowledge of agile methodologies, project management tools, Atlassian products, Lucidchart, and Microsoft Office (preferred)

Benefits

Learning & tuition
Career development through leading an enterprise data modernization initiative and expanding expertise in cloud data platforms, AI-assisted engineering, and enterprise architecture.
Flexible schedule
Fully remote work from within the United States.
Other
Access to a range of employee benefits; specific coverage and plan details are available through the employer's benefits information., Opportunity to build and develop a data engineering team, shape technical strategy, and influence engineering standards across distributed teams.

Full job description

From Jobgether’s careers site

Accountabilities

Show full descriptionShow less
  • Data Engineering Leadership: Lead, coach, and develop data engineering professionals, managing performance, staffing, workload distribution, and career development. Establish consistent standards for employees, contractors, vendors, and engineers working within cross-functional teams. - Platform Modernization: Lead the migration of legacy data lakes and curated data stores to Databricks, coordinating domain-by-domain delivery and resolving differences across development, testing, and production environments. - Data Architecture and Modeling: Partner with Enterprise Architecture to translate strategic direction into production-ready data pipelines, data models, platform designs, and consistent engineering practices. - Pipeline Development and Reliability: Own data ingestion and medallion architecture standards across bronze, silver, and gold layers. Maintain the availability, accuracy, performance, and scalability of existing pipelines while delivering new data integrations and supporting evolving business products. - Semantic Data and Analytics Enablement: Develop and maintain the semantic data layer, Unity Catalog objects, and curated datasets in collaboration with Enterprise Data and Analytics Operations. Ensure consistent business definitions and reliable data for analytics, governance, and AI-assisted querying. - Self-Service Engineering Enablement: Establish reusable pipeline templates, scaffolding, reference architectures, and automated tooling that allow autonomous teams to develop and operate compliant data pipelines with minimal centralized support. - AI-Driven Engineering: Integrate AI tools and agentic development practices into daily workflows, including code generation, testing, documentation, and automated reviews. Define standards for AI-assisted development and measure its impact on productivity, quality, cost, and delivery speed. - Governance, Security, and Risk Management: Ensure engineering deliverables meet data quality, lineage, documentation, privacy, and regulatory requirements. Collaborate with Information Security to support audits, remediate vulnerabilities, manage sensitive data appropriately, and implement automated compliance guardrails. - Vendor and Stakeholder Management: Manage relationships with system integration partners and platform vendors, taking ownership of architectural decisions and technical deliverables. Communicate progress, risks, dependencies, and recommendations clearly to senior leaders and business stakeholders. - Performance and Continuous Improvement: Define and monitor service-level agreements, operational KPIs, platform consumption costs, and data quality metrics. Lead complex troubleshooting efforts, maintain technical documentation and runbooks, and continuously evaluate emerging technologies such as Lakebase, Agent Bricks, and MLflow. Requirements - Professional Experience: At least 10 years of experience in data engineering or a related specialized technology field, including at least three years of team leadership or management experience. - Education: A bachelor's degree in Computer Science, Information Systems, or a related discipline, or equivalent professional experience. - Platform Modernization: Demonstrated experience leading legacy-to-cloud data platform migrations, managing enterprise data integrations, and working with both vendor-provided SaaS solutions and internally developed systems. - Databricks Expertise: Strong hands-on knowledge of Databricks, including Unity Catalog, Delta Lake, medallion architecture, and Databricks Asset Bundles or YAML-based configurations. Experience with Lakebase is an advantage. - Data Engineering and Modeling: Advanced SQL and PySpark skills, experience working with large governed datasets, and a strong understanding of dimensional modeling, semantic layers, domain-driven design, and data lifecycle management. - Data Quality and Analytics: Experience building certified datasets and semantic models for self-service analytics or AI-assisted natural-language querying. Familiarity with data quality frameworks, automated testing, reconciliation, and historical data management is essential. - Engineering Standards and Automation: Working knowledge of CI/CD practices for data pipelines, version control, governed deployment environments, and automated testing. Experience developing internal platforms or self-service infrastructure for distributed engineering teams is highly desirable. - AI and Automation Skills: Practical experience using tools such as Claude, Copilot, ChatGPT, or Gemini to improve engineering productivity and decision-making. Understanding of AI output validation, responsible AI principles, and AI governance is required, along with the ability to coach teams on effective adoption. - Agentic Development Practices: Experience designing or governing AI-assisted software development workflows, including specification-driven development, autonomous coding agents, automated code review, and testing pipelines. - Security and Compliance: Experience collaborating with Information Security and applying data privacy, access control, and regulatory requirements. Familiarity with insurance regulations, including NAIC guidelines and state insurance requirements, is beneficial. - Project and Vendor Management: Experience planning and prioritizing technical initiatives, managing resources and budgets, coordinating external vendors, and taking ownership of technical decisions and delivery outcomes. - Communication and Leadership: Strong analytical, organizational, and problem-solving skills, with the ability to translate complex technical concepts into business-friendly language. Demonstrated ability to influence senior stakeholders, hold teams accountable, challenge existing approaches constructively, and raise risks early. - Preferred Technical Experience: Familiarity with AWS-based data platforms, IBM DataStage, PostgreSQL, Oracle source systems, Lakebase, Agent Bricks, or MLflow is an advantage. - Additional Qualifications: Experience in insurance or another regulated industry, formal mentoring and coaching, and knowledge of agile methodologies, project management tools, Atlassian products, Lucidchart, and Microsoft Office are beneficial. - Work Environment: Candidates must currently reside in the United States and be authorized to work without sponsorship. The position is fully remote and requires a suitable private, quiet workspace. Occasional travel may be necessary for meetings or other business activities. Benefits - Competitive Salary: Annual salary range of $120,000–$186,000 , depending on qualifications, experience, and other relevant factors. - Comprehensive Benefits Package: Access to a range of employee benefits. Specific coverage and plan details are available through the employer's benefits information. - Remote Flexibility: Work remotely from within the United States. - Career Development: Lead a major enterprise data modernization initiative while expanding your expertise in cloud data platforms, AI-assisted engineering, and enterprise architecture. - Leadership Opportunities: Build and develop a data engineering team, shape technical strategy, and influence engineering standards across distributed teams. - Innovation and Impact: Work with modern data technologies and emerging AI capabilities to improve platform performance, scalability, governance, and delivery efficiency. - Collaborative Environment: Partner with senior technology leaders, enterprise architects, analytics specialists, security teams, and external technology providers. - Meaningful Business Contribution: Help strengthen data capabilities that support reliable operations and better decision-making in a regulated industry.

How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Why Apply Through Jobgether?

#LI-CL1

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Something wrong with this job? Report it