Machine Learning Engineer jobs

Hardware Machine Learning Engineer

IMCChicago, NY +1 placeFull-time

$200k–$225k/yr listed by the employer

Below the typical $242k a year for Machine Learning Engineer jobs in New York (all levels)How we compare

How we compare. Typical is the median yearly pay of 192 Machine Learning Engineer jobs in New York (all levels) that list pay, from the employers' own postings. About means within 5%.

Key facts

Where
Chicago, NY · Chicago
Degree
Master's degree or equivalent

Looks real. 1 thing to check before you apply.

On IMC’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 9 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 80 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Co-design machine learning models with traders, quantitative researchers, and software engineers, accounting for hardware constraints.
  • Translate model requirements into architectural decisions for the custom hardware roadmap.
  • Work with hardware engineers to implement, verify, and deploy ML inference solutions from proof of concept through production.
  • Evaluate research in neural architecture search, machine learning systems, and quantization for measurable system improvements.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience with hardware fundamentals through VHDL/SystemVerilog development, HLS tools, or ML-to-hardware frameworks
  • Exposure to ML compiler infrastructure such as MLIR, TVM, or XLA (preferred)
  • Background in latency-sensitive or resource-constrained systems, such as high-frequency trading, particle physics data acquisition, or real-time signal processing (preferred)
  • Trading experience (preferred)

Education

  • Advanced degree (MS or PhD) in EE, CS, Physics, or a related field, or equivalent depth through industry or research experience (preferred)

Skills

  • Solid understanding of hardware constraints and design trade-offs, including pipelining, resource utilization, and fixed-point arithmetic
  • Understanding of machine learning fundamentals, including neural network architectures, inference optimization, and quantization techniques
  • Proficiency in Python, C++, or similar languages for tooling, testing, and simulation
  • Familiarity with functional verification methodologies such as SystemVerilog, UVM, or Cocotb (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Paid time off
Paid leave
Bonus
Discretionary bonus for full-time, permanent positions
Other
Insurance

Full job description

From IMC’s careers site

We are deploying machine learning directly onto custom hardware – and we want you to help drive it from the ground up. This is an initiative where you'll have the rare opportunity to architect solutions from scratch, influence technical research direction, and see your work drive real impact in one of the most demanding computing environments in the world.

Show full descriptionShow less

We build the hardware, the software, and the infrastructure, so when you hit a bottleneck, you can fix it - there's no vendor to wait on and no abstraction layer you're not allowed to touch. If you've ever wanted to push the boundaries of what's computationally possible, this role is for you. We're looking for researchers and experienced engineers from any background. Trading experience is a bonus, not a prerequisite.

Your Core Responsibilities

  • Architect and co-design ML models with traders, quant researchers, and software engineers, treating hardware constraints (latency budgets, resource limits, numerical precision) as first-class design inputs
  • Shape our custom hardware roadmap by translating ML model requirements into concrete architectural decisions
  • Work hands-on with hardware engineers to implement, verify, and deploy ML inference solutions from proof-of-concept through production
  • Track and evaluate emerging research in neural architecture search, machine learning systems and quantization methods, and determine what translates to measurable improvements in our systems

Your Skills and Experience

  • Solid understanding of hardware constraints and design trade-offs (e.g., pipelining, resource utilization, fixed-point arithmetic) that shape how ML models can be efficiently mapped onto FPGAs or custom ASICs
  • Experience with hardware fundamentals, whether through VHDL/SystemVerilog development, HLS tools, or ML-to-hardware frameworks like hls4ml, FINN, or Vitis AI
  • Understanding of machine learning fundamentals – neural network architectures, inference optimization, quantization techniques, ML frameworks such as PyTorch/TensorFlow
  • Proficiency in Python, C++, or similar languages for tooling, testing, and simulation
  • Strong communication skills and ability to work collaboratively across disciplines with both technical and non-technical teams

Nice to Have

  • Exposure to ML compiler infrastructure such as MLIR, TVM, XLA, or similar tools for lowering and optimizing models for hardware targets
  • Background in latency-sensitive or resource-constrained systems including high-frequency trading, particle physics data acquisition, real-time signal processing, or similar domains
  • Familiarity with functional verification methodologies (for example SystemVerilog, UVM, Cocotb)
  • Advanced degree (MS or PhD) in EE, CS, Physics, or related field, or equivalent depth through industry or research experience

The Base Salary range for the role is included below. Base salary is only one component of total compensation; all full-time, permanent positions are eligible for a discretionary bonus and benefits, including paid leave and insurance. Please visit Benefits - US | IMC Trading for more comprehensive information.

Salary Range

$200,000—$225,000 USD

About Us

IMC is a research-driven trading firm where quantitative modeling, machine learning, and engineering shape how modern markets are traded. A stabilizing force in markets since 1989, we provide liquidity across trading venues, delivering the best outcome in value and risk management to investors. Using our own technology and capital, we build proprietary systems and algorithms that operate across global markets. Our researchers, traders, and engineers work as a collective, combining rapid experimentation, advanced infrastructure, and real-time feedback to turn insight into execution and execution into advantage.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs in New York

Machine Learning Engineer

Verneek · New York, NY

$40k–$200k/yr · see postingFull-time

Wide pay rangeChecked open todayPosted 19 days ago

See more like this