Software Engineer jobs

Staff+ Software Engineer, Backend and Infra

Haize LabsNew York, NY +1 placeOn-site

$200k–$300k/yr listed by the employer

About the typical $250k a year for staff-level Software Engineer jobs in New YorkHow we compare

How we compare. Typical is the median yearly pay of 284 staff-level Software Engineer jobs in New York that list pay, from the employers' own postings. About means within 5%.

Key facts

Where
New York, NY · New York City, NY · on-site
Experience
7+ years
Degree
Bachelor's degree or equivalent
US visa
Sponsors US visas

Looks real. 1 thing to check before you apply.

On Haize Labs’ own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 19 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 75 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Design and build scalable infrastructure to orchestrate large volumes of LLM calls for evaluations, red-team attacks, and runtime guardrails.
  • Collaborate with research to deploy new models and build AI reliability tools.
  • Work with customers to understand pain points, design workflows, and guide them on evaluation methodology.
  • Provide technical leadership, mentor team members, and set technical direction.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 7+ years of industry experience
  • 3+ years leading large initiatives as an engineer or manager
  • Track record designing, building, and scaling complex distributed systems
  • Experience doing applied AI/ML (preferred)
  • Experience building or operating large-scale, GPU-based model training and serving infrastructure (preferred)
  • Experience working on multi-datacenter, cloud-agnostic systems (preferred)

Education

  • Bachelor’s degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience

Skills

  • Strong proficiency in one or more backend programming languages
  • Strong familiarity with security and privacy best practices (preferred)

Other requirements

  • Work in person in NYC 6 days a week

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Equity

Full job description

From Haize Labs’ careers site

Staff+ Software Engineer, Backend and Infra

Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the reliability of LLM-based applications by haizing them – i.e. rigorously, proactively, and continuously fuzz-testing them.

We are looking for a talented and experienced backend + infrastructure engineer to help build out our AI reliability platform. You will play a foundational role in designing and driving forward the core technology that puts our cutting-edge AI research in the hands of customers, empowering them to build AI applications that are trustworthy, robust, and ready for production.

Show full descriptionShow less

This is an opportunity to directly influence how AI applications are tested, verified, and deployed by everyone from frontier AI labs to massive enterprises across a wide range of industries.

In this role, you will:

  • Design and build scalable infrastructure and systems to orchestrate tens of thousands of LLM calls per second, powering functionality like model evaluations, red team attacks, runtime guardrails, and more
  • Collaborate closely with the research team and deploy innovative new models to build industry-leading AI reliability tooling
  • Interface directly with customers to understand and address their pain points, design intuitive new user workflows that streamline their journey, and guide them on the evaluation methodology Haize has pioneered
  • Act as a technical leader across the organization, mentoring top talent and helping set technical direction and vision for the company
  • Develop and uphold processes and best practices that reinforce the operational excellence of our team

You may be a good fit if you:

  • Have 7+ years of industry experience, including 3+ years leading large initiatives as an engineer or manager
  • Have a proven track record of designing, building, and scaling complex distributed systems that solve critical business problems
  • Have strong proficiency in one or more backend programming languages (e.g. Python, Go, Rust)
  • Are deeply knowledgeable about modern cloud infrastructure, including technologies like Kubernetes and Terraform, and platforms like AWS, GCP, and Azure
  • Have a strong understanding of relational and NoSQL databases (we use Postgres, MongoDB, and Redis, among others)
  • Take a pragmatic, outcomes-focused approach to solving ambiguous technical and business problems
  • Are passionate about building products and platforms that feel magical to use

Strong candidates may also:

  • Have experience doing applied AI/ML
  • Have strong familiarity with security and privacy best practices
  • Have built and/or operated large scale, GPU-based model training and serving infrastructure
  • Have experience working on multi-datacenter, cloud-agnostic systems

Logistics

  • Education requirement: Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
  • Location policy: 6 days a week, in person, in NYC.
  • US visa sponsorship: If you are exceptional, we will sponsor.

Compensation

$200,000 – $300,000 annual salary + equity + benefits

About us

At Haize, we're not here to write GPT wrappers or get rich quick off the AI bubble. We're here to solve the hardest problem in AI: making it safe, reliable, and production-ready.

Since our company's inception in 2024, we've amassed amazing customers including OpenAI, Anthropic, AI21, and more. We've developed best-in-class tooling for evaluation, dynamic testing, red-teaming, observability, and continuous “robustification” of AI applications. And we’re backed + advised by the founders of Cognition, Hugging Face, Weights and Biases, Nous, Etched, Okta, and Replit, as well as C-suite execs from Google, Stripe, Databricks, Robinhood, and more.

Our core team is exceptionally well-suited to accomplish our mission. We’ve turned down opportunities like Stanford PhD programs and Y Combinator in order to pursue this goal, and we have experience doing AI research and engineering at places like Harvard, MIT, Citadel, Datadog, and McKinsey QuantumBlack (to name a few).

We can only serve our mission with an incredibly talented and hard-working team, and we hope that includes you. Come to Haize to push yourself, learn fast, experience excellence, grow with each other, and pursue your life's work.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer II

Octane · Irving, TX +1 place

$105k–$135k/yr

StrongChecked open todayPosted 8 days ago

Software Engineer

Dirac, Inc. · New York City, NY +1 place

$120k–$200k/yrOn-site

StrongChecked open todayPosted 8 days ago

Sr. Software Engineer

NBCUniversal · New York, NY

$120k–$170k/yrFull-timeHybrid

StrongChecked open todayPosted 2 days ago

Software Engineer, Product

Ambrook · New York, NY +2 places

$115k–$260k/yr · see postingFull-timeHybrid

Wide pay rangeChecked open todayPosted 4 days ago

Software Engineer 3

MongoDB · New York City, NY +1 place

$106k–$209k/yrHybrid

StrongChecked open todayPosted 9 days ago

See more like this