Data Engineer jobs

AWS Data Engineer

QodeRemote · US onlyFull-time

Pay not listed

Key facts

Experience
10+ years
Degree
Master's degree

This job is closed.

The employer took it down 8 days ago, after 13 days open. Here are similar open jobs.

  • To check: Posted by the employer 9 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteWorkable board
  • Checked: No reposts foundWorkable board
  • Note: Last seen open 9 days agoLive check
  • Trust score 75 / 100 · Looks good
See all 6 checksShow fewer
How we check

Similar open jobs

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Data Engineer

Mindex · Remote · US only

$90k–$140k/yrFull-time

StrongChecked open todayPosted 8 days ago

Data Integration Engineer

D.A. Davidson · Remote · US only

$74k–$106k/yrFull-time

StrongChecked open todayPosted 10 days ago

Principal Data Engineer

Constant Contact · Remote · US, Canada

$138k–$172k/yrFull-time

StrongChecked open todayPosted 12 days ago

Staff Data Engineer

Consumer Edge · Remote · US, Ireland

$175k–$210k/yr

StrongChecked open todayPosted 13 days ago

Lead Data Engineer

Oddball · Remote · location not stated

$110k–$145k/yr

StrongChecked open todayPosted 16 days ago

See more like this

What you’ll do

  • Lead and support data platform modernization projects.
  • Design, build, and optimize AWS data pipelines and ETL processes.
  • Migrate on-premises workflows to AWS and validate data quality before and after migration.
  • Automate data integrations and resolve data inconsistencies and quality issues.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 10+ years of data engineering experience leveraging AWS native technologies
  • Experience designing and developing robust, scalable data pipelines using AWS native services
  • Experience with streaming and batch data pipeline architectures
  • Hands-on experience with Databricks and willingness to grow capabilities
  • Experience with data engineering and storage solutions including AWS Glue, EMR, Lambda, Redshift, and S3

Education

  • Graduate or postgraduate degree in Computer Science or a related field

Skills

  • Proficiency using Snowflake for data transformations, ETL optimization, and scalable data processing
  • Familiarity with DataOps concepts and tooling for source control and AWS CI/CD pipelines
  • Knowledge of Dataiku

Full job description

From Qode’s careers site

Job Brief

As an AWS Data Engineer, your role will be to design, develop, and maintain scalable data pipelines on AWS. You will work closely with technical analysts, client stakeholders, data scientists, and other team members to ensure data quality and integrity while optimizing data storage solutions for performance and cost-efficiency. This role requires leveraging AWS native technologies and Databricks for data transformations and scalable data processing.

Responsibilities

  • Lead and support the delivery of data platform modernization projects.
  • Design and develop robust and scalable data pipelines leveraging AWS native services.
  • Optimize ETL processes, ensuring efficient data transformation.
Show full descriptionShow less
  • Migrate workflows from on-premise to AWS cloud, ensuring data quality and consistency.
  • Design automations and integrations to resolve data inconsistencies and quality issues
  • Perform system testing and validation to ensure successful integration and functionality.
  • Implement security and compliance controls in the cloud environment.
  • Ensure data quality pre- and post-migration through validation checks and addressing issues regarding completeness, consistency, and accuracy of data sets.
  • Collaborate with data architects and lead developers to identify and document manual data movement workflows and design automation strategies.

Skills and Requirements

· 10+ years’ experience with a core data engineering skillset leveraging AWS native technologies (AWS Glue, Python, Snowflake, S3, Redshift).

· Experience in the design and development of robust and scalable data pipelines leveraging AWS native services.

· Proficiency in leveraging Snowflake for data transformations, optimization of ETL pipelines, and scalable data processing.

· Experience with streaming and batch data pipeline/engineering architectures.

· Familiarity with DataOps concepts and tooling for source control and setting up CI/CD pipelines on AWS.

· Hands-on experience with Databricks and a willingness to grow capabilities.

· Experience with data engineering and storage solutions (AWS Glue, EMR, Lambda, Redshift, S3).

· Strong problem-solving and analytical skills.

· Knowledge of Dataiku is needed

· Graduate/Post-Graduate degree in Computer Science or a related field.

· AWS S3 (data storage, export, recall)

· Athena (querying data lakes)

· Data pipelines (batch & near-real-time)

· Integration with external systems (FHIR)

· Secure data handling (KMS, Macie)

· Cloud-native analytics

· Multi-account, multi-region data architecture

· BI integrations: Power BI, Tableau, QuickSight

Something wrong with this job? Report it · This flag looks wrong