Data Engineer jobs

DATA ENGINEERING SR MANAGER

Dollar GeneralUnited StatesOn-sitePosted 24 days ago

Pay not listed

Key facts

Experience
4+ years
Degree
Bachelor's degree

This job is closed.

The employer took it down 9 days ago, after 11 days open. Here are similar open jobs.

  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteOracle Recruiting board
  • Checked: No reposts foundOracle Recruiting board
  • Note: Last seen open 10 days agoLive check
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

Similar jobs

Manager, Data Engineering

Fanatics Commerce · Redwood City, CA

$200k–$230k/yrHybrid

StrongChecked open todayPosted 8 days ago

Sr AI Manager

Honeywell · Charlotte, NC +4 places

$159k–$199k/yrHybrid

StrongChecked open todayPosted 22 days ago

See more like this

What you’ll do

  • Manage data engineers and third-party resources, and lead architecture and design work.
  • Build and maintain systems across the data lifecycle, including data collection, storage, access, and delivery.
  • Improve data infrastructure for scalability, optimize data delivery, and automate manual processes.
  • Analyze data, identify trends and patterns, conduct complex analyses, and report results.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Licenses and certifications

  • Vendor-specific certification
  • Data engineering certification, such as IBM Certified Data Engineer (preferred)

Experience

  • 4+ years of Python or Java development experience
  • 4+ years of SQL experience
  • 4+ years of experience with schema design and dimensional data modeling
  • Hands-on experience with SQL database design
  • Experience designing, building, and maintaining data processing systems
  • Experience working with a cloud platform such as Snowflake, Azure, or Databricks
  • Experience with big data tools such as Hadoop, Spark, and Kafka
  • Experience with relational SQL databases, including Postgres
  • Experience with data pipeline and workflow management tools such as Azkaban, Luigi, and Airflow
  • Experience with cloud services including EC2, EMR, RDS, and Redshift
  • Experience with stream-processing systems such as Storm and Spark Streaming
  • Experience with object-oriented or object-functional scripting languages such as Python, Java, C++, and Scala
  • Ability to manage and communicate data warehouse plans to internal clients
  • NoSQL experience, including Cassandra (preferred)

Education

  • Degree in Computer Science, IT, or a related technical field
  • Master's degree (preferred)

Full job description

From Dollar General’s careers site

The Data Engineering Sr Manager will be responsible for managing data engineering deliverables to support our technology and product engineering teams as well as the needs of our data scientists and business analysts. This role will be responsible for employing techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field.

Job Responsibility

Show full descriptionShow less
  • Manage team of data engineers (both full-time associates and/or third-party resources).
  • Lead and participate in architecture and design efforts.
  • Lead the building of systems for all parts of the data lifecycle: collection, storage, accessibility, insights, and business action.
  • Identify, design, and implement internal process improvements including re-designing infrastructure for scalability, optimizing data delivery, and automating manual processes.
  • Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using Snowflake/Azure and SQL technologies.
  • Analyze and organize raw data.
  • Build data systems and pipelines.
  • Evaluate business needs and objectives.
  • Interpret trends and patterns.
  • Conduct complex data analysis and report on results.
  • Prepare data for prescriptive and predictive modeling.
  • Build algorithms and prototypes.

Job Qualifications

  • Must be able to communicate ideas and analysis results effectively both verbally and in writing to both internal and external clients.
  • Responsible for executing analytical projects, leading project development for data analysis and decision support tools.
  • Coordinate closely with the Business Intelligence and DWH team for data integration and alignment.
  • Knowledge of programming languages (e.g., Java and Python).
  • Hands-on experience with SQL database design.
  • Great numerical and analytical skills.
  • Degree in Computer Science, IT, or similar field; Master's preferred.
  • Data engineering certification (e.g., IBM Certified Data Engineer) is a plus.
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases including Postgres and Cassandra.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with Snowflake/Azure cloud services: EC2, EMR, RDS, Redshift.
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

Education/Experience Degree in information technology or computer science with additional vendor-specific certification. BS or MS degree in Computer Science or a related technical field. 4+ years of Python or Java development experience. 4+ years of SQL experience (No-SQL experience is a plus). 4+ years of experience with schema design and dimensional data modeling. Ability to manage and communicate data warehouse plans to internal clients. Experience designing, building, and maintaining data processing systems. Experience working with a cloud platform such as Snowflake / Azure or Databricks.

Something wrong with this job? Report it · This flag looks wrong