New York jobs

Staff AI Engineer

SparaNew York City, NYFull-timeHybrid

$210k–$260k/yr listed by the employer

Key facts

Where
New York City, NY · hybrid, 3 days on-site
Experience
7+ years
Degree
Master's degree

1 thing to check before you apply.

On Spara’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 2 years agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 65 / 100 · Check details
See all 6 checksShow fewer
How we check

What you’ll do

  • Develop the core engine for AI agents, including retrieval, ranking, response generation, and supporting frameworks.
  • Design and scale evaluation methods across the platform as agent types and capabilities expand.
  • Guide fine-tuning and training decisions, weighing their value and tradeoffs.
  • Make foundational architecture and technical decisions.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 7+ years of engineering experience
  • Significant depth in NLP, search, retrieval, or related ML domains
  • Experience predating the current LLM wave and understanding of the fundamentals
  • Track record of designing and deploying sophisticated ML/AI systems in production
  • Experience building evaluation pipelines and strong knowledge of evaluation methodology
  • Experience with or strong instincts around fine-tuning, including tradeoffs
  • Ability to thrive in an early-stage environment
  • Previous startup experience, especially at companies that scaled from early to growth stage (preferred)

Education

  • Advanced degree in ML, NLP, or a related field (preferred)

Other requirements

  • Work in the downtown Manhattan office 3 days per week

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Dental & vision
Dental and vision insurance
Paid time off
Flexible PTO
Other
Hybrid schedule: 3 days per week in the downtown Manhattan office; remote work is an option on Wednesdays and Fridays

Also: health insurance

Full job description

From Spara’s careers site

ABOUT SPARA

Spara is building AI agents that sell. Our agents engage buyers across chat, voice, and email, handling everything from qualifying leads to booking meetings to answering deep product questions. We work with companies ranging from fast-growing startups to large enterprises, and our product is working: customers like Rho are seeing step-change improvements in their sales pipeline within weeks of going live.

Show full descriptionShow less

Sales technology is a massive market, and the shift to AI-native GTM motions is still early. We're building the company that defines how it plays out. We've raised $15M from Radical Ventures and Inspired Capital, backed by the founders of PyTorch and Google Cloud TPU, and Heads of Sales at Anthropic and OpenAI.

Our founders have done this before: David was co-founder and CEO of Triplemint, which he led to acquisition, and Zander was technical co-founder of Nomad Health (now post-Series D) and most recently led Platform at Hyperscience AI.

We're a 20-person team in downtown Manhattan building something that will be much bigger. Our engineering team is small and senior, and everyone has real influence on what we build and how we build it.

THIS ROLE

We're looking for someone who's been in the NLP and ML space long enough to have perspective. You've seen the field evolve, you transitioned into the LLM era with a clear understanding of what changed and what didn't, and you have strong instincts for when to prompt-engineer vs. fine-tune, how to build eval systems that actually scale, and how to make pragmatic architecture decisions under real constraints.

As a Staff AI Engineer at Spara, you will:

  • Go deep on the core engine that powers all of Spara's AI agents: retrieval, ranking, response generation, and the frameworks that tie them together. You'll bring a level of depth and technical judgment here that raises the bar for the whole team.
  • Design and scale the evaluation approach across the platform as we add new agent types and capabilities.
  • Bring depth on fine-tuning and training: when it's worth it, how to do it well, and how to make pragmatic tradeoffs as the platform scales.
  • Make foundational technical decisions that compound. At our stage, the right abstractions and architectural choices have outsized impact.
  • Collaborate closely with leadership to shape the product and technical roadmap. This is a role with real influence, not just execution.
  • Ship to production multiple times a day using a modern stack: FastAPI/Python, React/TypeScript, Postgres + pgvector, multiple foundation models (OpenAI, Anthropic), Google Cloud, Docker, GitHub Actions.

WHAT WE'RE LOOKING FOR

  • 7+ years of engineering experience, with significant depth in NLP, search, retrieval, or related ML domains
  • Experience that predates the current LLM wave. You understand the fundamentals underneath the abstractions.
  • Track record of designing and deploying sophisticated ML/AI systems in production
  • Strong opinions on evaluation methodology. You've built eval pipelines before and know what makes them useful vs. theater.
  • Experience with or strong instincts around fine-tuning: when it's worth it, how to do it well, what the tradeoffs are
  • Ability to thrive in an early-stage environment. We're seed stage with real enterprise customers and a senior team, moving fast toward our next phase of growth.
  • Excellent communication skills. You'll be shaping how the team thinks about hard problems, not just solving them alone.

NICE TO HAVE:

  • Advanced degree in ML, NLP, or a related field
  • Previous startup experience, especially at companies that scaled from early to growth stage

LOCATION & WORK SCHEDULE

Hybrid: 3 days per week in our office in downtown Manhattan (World Trade Center), with the option to work remotely on Wednesdays and Fridays.

COMPENSATION & BENEFITS

  • Health, dental, and vision insurance
  • Flexible PTO
  • Collaborative environment with experienced engineers solving hard problems together
  • Real ownership over product direction and technical architecture
  • In-office culture in NYC with flexibility for work-life balance

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Demand Generation Manager

Spara · New York City, NY

Pay not listedFull-timeHybrid

Looks good2 to checkChecked open todayPosted 2 months ago

Staff AI Engineer

Via · New York, NY

$250k–$300k/yr

StrongChecked open todayPosted 1 month ago

See more like this