Data Engineer jobs

Data Engineer

American Bureau of ShippingKnoxville, TN8+ years experiencePosted 1 month ago

Pay not listed

Looks real. 1 thing to check before you apply.

On American Bureau of Shipping’s own careers site (Oracle Recruiting), checked open today.

  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteOracle Recruiting board
  • Checked: Checked open todayOracle Recruiting board
  • Checked: No reposts foundOracle Recruiting board
  • Trust score 95 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Design, build, test, and maintain scalable data pipelines, models, and lakehouse or warehouse structures for analytics, reporting, and AI/ML.
  • Prepare and integrate data from multiple sources, including batch and near-real-time data, and support datasets for feature engineering, model training, and inference.
  • Implement data quality controls, validation, monitoring, observability, and performance improvements.
  • Support data governance through lineage, cataloging, access management, and documentation.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Licenses and certifications

  • Databricks certification (preferred)

Experience

  • 8+ years of relevant experience in data engineering or a closely related discipline
  • Significant experience building and maintaining cloud-based data pipelines and architectures
  • Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud
  • Experience designing, implementing, and supporting data warehouse or Lakehouse architectures
  • Experience implementing data quality checks, validation frameworks, monitoring, and performance optimization
  • Experience with real-time or streaming data technologies such as Kafka or Kinesis (preferred)

Education

  • Degree in a technical field or equivalent combination of education and experience

Skills

  • Strong knowledge of data modeling, data integration, ETL/ELT design, and pipeline orchestration
  • Strong programming skills in Python and SQL
  • Knowledge of distributed data processing frameworks and tools such as Spark or equivalent technologies
  • Ability to work with structured, semi-structured, and unstructured data from multiple sources
  • Knowledge of data governance, lineage, metadata management, and cataloging concepts and tools
  • Familiarity with data infrastructure for AI/ML workflows, including feature engineering, data preparation, and embedding pipelines
  • Familiarity with containerization and deployment tools such as Docker or Kubernetes (preferred)

Other requirements

  • Ability to manage multiple priorities, meet deadlines, and maintain quality and accuracy

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From American Bureau of Shipping’s careers site

The Data Engineer designs, builds, and maintains scalable data architecture, pipelines, and platforms that support analytics, reporting, and AI/ML solutions across the organization. This role is responsible for preparing, integrating, governing, and optimizing data from multiple sources to ensure reliable, accessible, and high-quality data assets for business and technical use. The Data Engineer works closely with data scientists, software engineers, analysts, and business stakeholders to deliver cloud-based data solutions that support operational goals, innovation, and emerging AI capabilities.

What You Will Do:

Show full descriptionShow less
  • Design, develop, and maintain scalable data pipelines, data models, and lakehouse or data warehouse structures to support analytics, reporting, and AI/ML workloads.
  • Build, test, and optimize ETL/ELT workflows that ingest, transform, and deliver data from multiple structured, semi-structured, and unstructured sources.
  • Support AI/ML initiatives by preparing and managing datasets for feature engineering, model training, inference, and other AI-enabled applications.
  • Implement and maintain data quality controls, validation processes, monitoring, and observability practices to improve reliability, accuracy, and performance of data pipelines.
  • Manage data integration processes across internal and external systems to ensure timely, secure, and efficient data availability.
  • Support data governance practices, including lineage, cataloging, access management, and documentation, to promote trusted and well-controlled data assets.
  • Develop and deploy cloud-based data engineering solutions using modern platforms, distributed processing tools, and containerized environments where applicable.
  • Build and maintain batch and near real-time data pipelines to meet business, reporting, and application requirements.
  • Collaborate with cross-functional teams to gather requirements, translate business needs into technical solutions, and support enterprise data initiatives.
  • Troubleshoot, enhance, and continuously improve data infrastructure, workflows, and related tools to increase scalability, efficiency, and business value.
  • Remain current with developments in data engineering, cloud platforms, and AI-enabling technologies and apply practical improvements where beneficial.
  • Comply with applicable ABS Health, Safety, Quality, and Environmental Management System requirements and other internal policies and procedures.

What You Will Need:

Education and Experience

  • Degree in a technical field or equivalent combination of education and experience
  • 8+ years of relevant experience in data engineering or a closely related discipline, including significant experience building and maintaining cloud-based data pipelines and architectures.
  • Databricks certification (preferred)

Knowledge, Skills, and Abilities

- Strong knowledge of data engineering concepts, including data modeling, data integration, ETL/ELT design, and pipeline orchestration.

- Strong programming skills in Python and SQL, with the ability to build, test, and maintain production-grade data workflows.

- Experience working with cloud-based data platforms such as AWS, Azure, or Google Cloud.

- Experience designing, implementing, and supporting data warehouse or Lakehouse architectures such as Databricks, Snowflake, Redshift, or similar technologies.

- Knowledge of distributed data processing frameworks and tools, such as Spark or equivalent technologies.

- Ability to work with structured, semi-structured, and unstructured data from multiple data sources.

- Experience implementing data quality checks, validation frameworks, monitoring, and performance optimization practices.

- Knowledge of data governance, lineage, metadata management, and cataloging concepts and tools.

- Familiarity with data infrastructure requirements that support AI/ML workflows, including feature engineering, data preparation, and embedding pipelines.

- Experience with real-time or streaming data technologies such as Kafka, Kinesis, or similar tools is preferred.

- Familiarity with containerization and deployment tools such as Docker, Kubernetes, or similar technologies is preferred.

- Ability to analyze technical requirements, solve complex data problems, and deliver practical solutions in a fast-paced environment.

- Strong collaboration and communication skills, with the ability to work effectively across technical and business teams.

- Ability to manage multiple priorities, meet deadlines, and maintain a high standard of quality and accuracy.

- Working knowledge of the ABS Health, Safety, Quality, and Environmental Management System.

Reporting Relationships:

Reports directly to the Chief Data Scientist in Global Technology or other management or executive level position.

Working Conditions:

Work is primarily sedentary; exerting up to 10 pounds of force occasionally and/or a negligible amount of force frequently or constantly to lift, carry, push, pull or otherwise move object.

Notice: This role has been opened for a future need expected within three months of the original posting date of this position. Potential candidates may not receive communication until the open headcount is confirmed.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs in Tennessee

Data Engineer

Unlock Health · Chicago, IL +1 place

Hybrid

StrongPay not listedChecked open todayPosted 29 days ago

See more like this