Data Engineer jobs

AWS Data Engineer - US Only

ScalepexRemote · US onlyFull-time5+ years experience

Pay not listed

Looks real. 2 things to check before you apply.

On Scalepex’s own careers site (Workable), checked open today.

  • To check: Posted by the employer 23 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteWorkable board
  • Checked: Checked open todayWorkable board
  • Checked: No reposts foundWorkable board
  • Trust score 70 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Design, build, and optimize AWS data pipelines for large datasets from utility systems.
  • Orchestrate data workflows and implement ETL/ELT processes to integrate and transform data from multiple sources.
  • Develop serverless data-processing solutions using AWS Lambda and model data for analytics use cases.
  • Monitor pipeline performance and improve latency, throughput, scalability, and availability.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Minimum of 5 years of experience in data engineering
  • Hands-on experience with distributed systems and scalable architectures
  • Strong experience in AWS data engineering
  • Familiarity with utilities-specific datasets, such as smart meters and energy grids (preferred)

Skills

  • Proficiency in AWS Step Functions, Lambda, Glue, S3, DynamoDB, and Redshift
  • Strong programming skills in Python, including PySpark and Pandas for large-scale data processing
  • Knowledge of ETL/ELT processes for integrating diverse datasets into centralized systems
  • Strong analytical skills and ability to work with unstructured datasets
  • Knowledge of data governance practices for data accuracy, consistency, and security
  • Experience with Airflow (preferred)

Other requirements

  • Ability to obtain and maintain the required clearance for the role

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Scalepex’s careers site

❋ Why Scalepex?

Scalepex is a dynamic services firm specializing in providing solutions for premium brands like Nike, Pepsi, Toyota, Virgin and Walgreens. Our mission is to connect prominent market leaders with top-tier professionals from around the world, fostering collaboration, efficiency, and growth.

❋ Take your portfolio to the next level by working with one of our fastest growing clients.

Join the Innovation Frontier at Scalepex!

About the Role

Show full descriptionShow less

We are seeking an experienced AWS Data Engineer with a strong background in building scalable data solutions and expertise in utilities-related datasets. The ideal candidate will have at least 5 years of experience in data engineering, a deep understanding of distributed systems, and proficiency with AWS services and tools like Step Functions, Lambda, Glue, and Redshift. This role will focus on designing, developing, and optimizing data pipelines to support analytics and decision-making in the utilities industry.

Key Responsibilities

  • Design and Build Data Pipelines: Develop scalable, reliable data pipelines using AWS services (e.g., Glue, S3, Redshift) to process and transform large datasets from utility systems like smart meters or energy grids.
  • Workflow Orchestration: Use AWS Step Functions to orchestrate workflows across data pipelines; experience with Airflow is acceptable but Step Functions is preferred.
  • Data Integration and Transformation: Implement ETL/ELT processes using PySpark, Python, and Pandas to clean, transform, and integrate data from multiple sources into unified datasets.
  • Distributed Systems Expertise: Leverage experience with complex distributed systems to ensure reliability, scalability, and performance in handling large-scale utility data.
  • Serverless Application Development: Use AWS Lambda functions to build serverless solutions for automating data processing tasks.
  • Data Modeling for Analytics: Design data models tailored for utilities use cases (e.g., energy consumption forecasting) to enable advanced analytics
  • Optimize Data Pipelines: Continuously monitor and improve the performance of data pipelines to reduce latency, enhance throughput, and ensure high availability.
  • Ensure Data Security and Compliance: Implement robust security measures to protect sensitive utility data and ensure compliance with industry regulations.

Requirements

Required Qualifications

  • Minimum of 5 years of experience in data engineering
  • Proficiency in AWS services such as Step Functions, Lambda, Glue, S3, DynamoDB, and Redshift.
  • Strong programming skills in Python with experience using PySpark and Pandas for large-scale data processing.
  • Hands-on experience with distributed systems and scalable architectures.
  • Knowledge of ETL/ELT processes for integrating diverse datasets into centralized systems.
  • Familiarity with utilities-specific datasets (e.g., smart meters, energy grids) is highly desirable.
  • Strong analytical skills with the ability to work on unstructured datasets.
  • Knowledge of data governance practices to ensure accuracy, consistency, and security of data.
  • Strong experience in AWS data engineering
  • Ability to work independently
  • Ability to work with a cross-functional teams, including interfacing and communicating with business stakeholders
  • Professional oral and written communication skills
  • Strong problem solving and troubleshooting skills with experience exercising mature judgement
  • Excellent teamwork and interpersonal skills
  • Ability to obtain and maintain the required clearance for this role

Something wrong with this job? Report it · This flag looks wrong

Similar remote jobs

Data Engineer

Mindex · Remote · US only

$90k–$140k/yrFull-time

StrongChecked open todayPosted 8 days ago

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Data Integration Engineer

D.A. Davidson · Remote · US only

$74k–$106k/yrFull-time

StrongChecked open todayPosted 10 days ago

Principal Data Engineer

Constant Contact · Remote · US, Canada

$138k–$172k/yrFull-time

StrongChecked open todayPosted 11 days ago

Lead Data Engineer

Oddball · Remote · location not stated

$110k–$145k/yr

StrongChecked open todayPosted 15 days ago

See more like this