Data Engineer jobs

Big Data Engineer

HexawareUnited StatesPosted 2 months ago

Pay not listed

Key facts

Experience
8+ years
Degree
Bachelor's degree

This job is closed.

The employer took it down 17 days ago, after 3 days open. Here are similar open jobs.

  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteOracle Recruiting board
  • Checked: No reposts foundOracle Recruiting board
  • Note: Last seen open 21 days agoLive check
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

Similar open jobs

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Senior Data Engineer

AIR Communities · Denver, CO

$125k–$145k/yrFull-timeOn-site

StrongChecked open todayPosted 2 days ago

Lead Data Engineer

AIR Communities · Denver, CO

$135k–$160k/yrFull-timeOn-site

StrongChecked open todayPosted 2 days ago

Sr. Data Engineer

NBCUniversal · New York, NY

$115k–$145k/yrFull-timeHybrid

StrongChecked open todayPosted 2 days ago

Data Engineer

Mindex · Remote · US only

$90k–$140k/yrFull-time

StrongChecked open todayPosted 8 days ago

Senior Data Engineer

Gatik AI · Santa Clara, CA

$180k–$260k/yrHybrid

StrongChecked open todayPosted 8 days ago

See more like this

What you’ll do

  • Build and maintain ETL pipelines using Python and PySpark on AWS Glue and related platforms.
  • Orchestrate workflows and implement messaging and event-driven integrations.
  • Design and optimize storage and querying solutions, and write SQL for transformations, validation, and reporting.
  • Integrate API data, process structured and semi-structured JSON, and implement data quality checks, monitoring, and operational support.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 8 years of software development experience
  • Experience with ETL/data pipeline development and orchestration using AWS Step Functions or Airflow
  • Experience with Athena, EMR, Kinesis, DynamoDB, or RDS
  • Experience with GitLab, Terraform or similar tools, and CI/CD workflows
  • Exposure to enterprise data lake or cloud migration initiatives

Education

  • Bachelor’s degree in Information Technology, Computer Science, Business Administration, or a related field

Skills

  • Strong hands-on experience with Python, PySpark, APIs, and SQL
  • Working knowledge of AWS Glue, Lambda, Step Functions, Redshift, S3, SNS, and SQS
  • Good knowledge of CloudWatch, logging, and production support
  • Understanding of data warehousing, data lakes, lakehouse architecture, and query optimization
  • Good understanding of AI tools such as GitHub Copilot for code productivity
  • Good understanding of performance engineering for code pipelines and near-real-time systems
  • Good understanding of agents and MCP

Full job description

From Hexaware’s careers site

Build and maintain ETL pipelines using Python and PySpark on AWS Glue and related platforms.

Orchestrate workflows using AWS Step Functions and Lambda. - Implement messaging and event-driven integrations using SNS and SQS. Design and optimize storage and querying solutions in Amazon Redshift, RDS, Oracle and S3-based architectures.

Write efficient SQL for transformations, validation, and reporting. - Integrate data from APIs and process structured and semi-structured JSON data. - Implement data quality checks, monitoring, and operational support processes.

Participate in CI/CD and version control practices for deployment and release management.

Show full descriptionShow less

Collaborate with cross-functional teams to translate business requirements into technical solutions.

8 years of software development experience across the appropriate platform.

Strong hands-on experience with Python, PySpark, API’s and SQL.

Experience with ETL/data pipeline development and Orchestration using Step functions / AirFlow .

Working knowledge of AWS services including Glue, Lambda, Step Functions, Redshift, S3, SNS, and SQS.

Experience with Athena, EMR, Kinesis, DynamoDB, or RDS. - Good Knowledge on CloudWatch, logging, and production support.

Understanding of data warehousing, data lakes, Lake House and query optimization.

Experience with GitLab/Terraform or similar and CI/CD workflows.

Good understanding of using AI tools like Github Copilot or similar for code productivity .

Exposure to enterprise data lake or cloud migration initiatives.

Have an eye to solving complex problems, great communication with stakeholders .

Have a good understanding of performance engineering of code pipelines and near real time systems - Good understanding on Agents and MCP".

A Bachelor’s Degree in Information Technology, Computer Science, Business Administration, or a related field is required.

Something wrong with this job? Report it · This flag looks wrong