Data Engineer jobs

Core Data Engineer

Flow TradersNew York, NYPosted 1 month ago

$165k–$210k/yr listed by the employer

About the typical $190k a year for Data Engineer jobs in New York (all levels)How we compare

How we compare. Typical is the median yearly pay of 127 Data Engineer jobs in New York (all levels) that list pay, from the employers' own postings. About means within 5%.

Be careful: this posting has signs of a scam.

On Flow Traders’ own careers site (Greenhouse), checked open today.

  • Scam sign: Asks the candidate to pay to startWhy: “All resumes, and any other information identifying potential candidates, submitted to any employee at Flow Traders via-email, the Internet…”Never pay to get a job. Real employers pay for training and checks.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 100 / 100 · Strong
See all 6 checksShow fewer
How we check

What you’ll do

  • Turn research questions into aligned, adjusted, point-in-time-correct, documented, and reproducible datasets in collaboration with quants.
  • Build and own data products and pipelines, including quality checks, operational issue resolution, and automation of manual processing.
  • Create data quality checks and alerts that identify issues affecting strategies while avoiding noisy alerts.
  • Develop shared foundations for reference data, instrument identifiers, corporate actions, and vendor feeds.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Analytics or data engineering experience
  • Demonstrated ability to work with large datasets and familiarity with big data solutions
  • Owned something in production, not only built it
  • Experience at a startup or scale-up through a growth phase (preferred)
  • Experience with financial data, such as prices, market data, transactions, or instruments (preferred)
  • Experience with a modern cloud data stack, such as Spark or Databricks, dbt, a cloud warehouse, and orchestration (preferred)
  • Experience with Airflow, Kafka, and GCP, especially GKE, Dataproc, and BigQuery (preferred)
  • Experience with Polars, Pandas, Spark, Apache Beam, or Apache NiFi (preferred)
  • Experience at a trading firm, systematic fund, brokerage, crypto exchange, or market data company (preferred)
  • On-call or incident response experience (preferred)

Skills

  • Strong data modelling and data quality practice, including tests, contracts, lineage, and production observability
  • Strong proficiency in Python
  • Working proficiency with SQL, relational databases, and version control systems
  • Familiarity with another statically typed language (preferred)
  • Familiarity with point-in-time data, look-ahead bias, and survivorship bias (preferred)

Other requirements

  • Ability to work directly with the people who use your data
  • Ability to balance individual stakeholder requirements with data quality, consistency, and broad applicability

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Bonus
Annual discretionary variable remuneration, allocated based on company, group, and individual performance and contribution.

Full job description

From Flow Traders’ careers site

Flow Traders is looking for a Core Data Engineer to own the end-to-end lifecycle of our most fundamental data products, including our Security Master; our reconciled ETF Compositions; high-resolution historical market data; and records of our trades, orders, quotes, and inquiries. High-quality data is the cornerstone of Flow Traders' strategic direction - beyond reducing complexity and BAU for stakeholders across the organization, quality data is a key requirement for our growth of quantitative trading styles.​

Show full descriptionShow less

Specifically, you will craft and execute the blueprint for these products, leveraging our Data Platform to build and monitor automated pipelines which ensure that users across the organization have reliable data at their fingertips when they need it. Further, you will become an expert in these data sets, leveraging that knowledge to optimize our use of the data we have and explore new sources for additional value. Finally, you will constantly collaborate with teams across the organization to ensure that our in-house systems are designed with data in mind, streamline additional data-related workflows, and work with stakeholders to maximize the value they extract from our data.​

As the architect and guardian of our most valuable data, you will have a unique opportunity to make your mark on Flow Traders. You will be accountable for delivering these data products at an exceptional level of quality, ensuring that they are not only timely and pristine, but powerful enough to drive Flow Traders' future growth. Ultimately, your work will not only provide highly visible benefits that every division feels every day, but it will also deliver one of the most important building blocks to the firm's strategic growth for the years to come.​

What you will do

  • Craft datasets with quants. Take an underspecified research question and turn it into the right dataset: aligned, adjusted, point-in-time correct, documented, and reproducible.​
  • Develop and own the end-to-end lifecycle of these data products. Build and maintain pipelines, develop quality checks, correct day-to-day operational issues, and systematize/automate manual processing steps​
  • Own data quality where it matters. Design the checks and alerts that catch the problems that would actually hurt a strategy, and deliberately leave out the ones that are just noise.​
  • Build shared foundations. Reference data, instrument identifiers, corporate actions and vendor feeds that every researcher and trading desk depends on.​
  • Keep critical pipelines running. Markets in several regions, and digital asset markets that never close, depend on this data. You will be part of a team that supports it across time zones.​

What you need to succeed

Required​

  • Analytics or data engineering experience, ideally at a startup or scale-up through a growth phase​
  • Strong data modelling and data quality practice: tests, contracts, lineage, observability in production​
  • Strong proficiency in Python (ideally familiarity with another statically-typed language)​
  • Working proficiency with SQL and relational databases, and version control systems​
  • Demonstrated ability to work with large datasets and familiarity with big data solutions​
  • You have owned something in production, not only built it​
  • You enjoy working directly with the people who use your data​
  • Strong interpersonal and communication skills, with the ability to collaborate effectively with technical and non-technical stakeholders​
  • Ability to balance individual stakeholder requirements with data quality, consistency, and broad applicability ​

Strongly preferred​

  • Experience with financial data: prices, market data, transactions, instruments​
  • Familiarity with point-in-time data, look-ahead bias and survivorship bias​
  • Experience with a modern cloud data stack, such as Spark or Databricks, dbt, a cloud warehouse, and orchestration​
  • Experience with Airflow, Kafka, and GCP (esp. GKE, Dataproc, and Big Query), strongly preferred​
  • Experience with Polars, Pandas, Spark, Apache Beam, Apache NiFi​
  • Experience at a trading firm, systematic fund, brokerage, crypto exchange or market data company​
  • On-call or incident response experience​

At Flow Traders, we acknowledge the importance of open and transparent communication whether it be with our employees, our stakeholders, or our local and global communities. When it comes to salary, Flow Traders uses reliable market research to create base ranges. Where candidates will fall within the range depends on a few different factors including but not limited to level of experience, location, and specific skill set. We also consider ourselves one global team, and to demonstrate that, all employees are eligible to share in the company’s success through an annual discretionary variable remuneration allocated based on company, group and individual performance and contribution.

Per NYC salary transparency law, the total compensation for this role includes a base range of $165,000 to $210,000 plus annual discretionary variable remuneration.

Flow Traders does not accept unsolicited resumes from any professional staffing or search firms. All resumes, and any other information identifying potential candidates, submitted to any employee at Flow Traders via-email, the Internet or directly without a valid and signed search agreement will be deemed free to contact by Flow Traders without any restrictions and no placement fee of any kind will be paid in the event the candidate is hired by Flow Traders.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Data Engineer

K Health · New York, NY

$150k–$175k/yrHybrid

StrongChecked open todayPosted 1 month ago

Data Engineer II

Garner Health · New York City, NY +1 place

$138k–$160k/yrHybrid

StrongChecked open todayPosted 1 month ago

Sr. Data Engineer

NBCUniversal · New York, NY

$115k–$145k/yrFull-timeHybrid

StrongChecked open todayPosted 2 days ago

Senior Data Engineer

Pontera · New York, NY

$180k–$220k/yrHybrid

StrongChecked open todayPosted 22 days ago

Data Engineer 2

The Farmer's Dog · New York, NY

$130k–$145k/yrOn-site

StrongChecked open todayPosted 1 month ago

See more like this