Software Engineer jobs

AI/ML Software Engineer

OctauraNew York, NYFull-timeHybrid2+ years experience

$130k–$160k/yr listed by the employer

Below the typical $180k a year for mid-level Software Engineer jobs in New YorkHow we compare

How we compare. Typical is the median yearly pay of 133 mid-level Software Engineer jobs in New York that list pay, from the employers' own postings. About means within 5%.

Looks real. 1 thing to check before you apply.

On Octaura’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 2 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 95 / 100 · Strong
See all 6 checksShow fewer
How we check

What you’ll do

  • Design, build, and maintain backend services that power AI/ML capabilities.
  • Develop, train, evaluate, and deploy machine learning models and Agentic AI systems.
  • Build data pipelines and feature engineering workflows for model training and inference.
  • Implement MLOps practices such as model versioning, monitoring, A/B testing, and automated retraining.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 2+ years of software engineering experience with strong proficiency in Java and Spring Boot
  • Experience building event-driven systems using Apache Kafka
  • Hands-on experience with Redis for caching, queuing, or session management
  • 2+ years of hands-on experience in AI/ML development using Python
  • Experience with ML frameworks such as scikit-learn, PyTorch, TensorFlow, or XGBoost
  • Exposure to Agentic AI patterns, including tool use, planning, multi-step reasoning, or agent orchestration frameworks

Skills

  • Solid understanding of relational databases (PostgreSQL) and data warehousing (Redshift or equivalent)
  • Strong grasp of distributed systems, REST API design, and microservices architecture
  • Familiarity with supervised and unsupervised learning, model evaluation, feature engineering, and hyperparameter tuning
  • Understanding of LLMs and generative AI concepts, including prompt engineering, fine-tuning, and RAG architectures

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
90% company-paid healthcare.
Paid time off
Flexible Paid Time Off.
Parental leave
Competitive parental leave.
Equity
Equity is included in the compensation package; competitive compensation and equity are listed as a perk.
Bonus
Year-end bonus may be provided as part of the compensation package.
Wellness & mental health
Onsite gym and discounted membership.
Meals
Daily breakfast, coffee, and snacks in the office.

Full job description

From Octaura’s careers site

Come build what the market has been missing.

Octaura is a technology company transforming how some of the world’s largest, least digitized markets operate. In loans and CLOs, trillions of dollars still move through phones, emails, and PDFs because the right infrastructure hasn’t existed — until now.

We’re applying AI, real-time data, and modern software design to asset classes long overlooked by fintech. Our platforms turn fragmented information into intelligence, manual workflows into automation, and legacy conventions into scalable market infrastructure.

You’ll join a high-impact, collaborative team building the systems these markets need to become more transparent, efficient, and connected.

Show full descriptionShow less

The Role

An AI Engineer at Octaura, is a software professional who develops and implements AI-powered applications by integrating trained machine learning models, APIs, and data pipelines into functional software products. You will design, build, deploy, and maintain applied machine learning systems that power critical products and workflows across our platform. This role focuses on taking AI solutions from concept through production—working with large, complex datasets and ensuring models are reliable, explainable, and performant in real-world financial environments.

You’ll partner closely with product managers, software engineers, and data teams to solve meaningful business problems, improve market efficiency, and introduce AI responsibly into mission-critical systems. Depending on experience, you may take full ownership of complex AI initiatives and help shape Octaura’s ML architecture and best practices.

This role is based out of our New York City office (5 Penn Plaza), with a hybrid schedule of four days in the office (Monday–Thursday) and one day remote (Friday).

Key Responsibilities

  • Design, build, and maintain production-grade backend services that power AI/ML capabilities, using Java, Spring Boot, Kafka, Redis, PostgreSQL, and Redshift.
  • Develop, train, evaluate, and deploy machine learning models using Python-based ML frameworks (e.g., scikit-learn, PyTorch, or TensorFlow).
  • Architect and implement Agentic AI systems, including multi-agent workflows, tool-use pipelines, and integration with Model Context Protocol (MCP) or similar orchestration frameworks.
  • Build and maintain data pipelines and feature engineering workflows to support ML training and inference.
  • Collaborate with data scientists, platform engineers, and product teams to translate business problems into AI/ML solutions.
  • Contribute to the evaluation and selection of the team's AI/ML technology stack, including frameworks for Agentic AI, LLM orchestration, and model serving.
  • Implement MLOps practices — including model versioning, monitoring, A/B testing, and automated retraining pipelines.
  • Stay current with the rapidly evolving AI/ML landscape, including large language models (LLMs), retrieval-augmented generation (RAG), and agent frameworks.
  • Write clean, testable, and well-documented code; participate in code reviews and foster engineering best practices.

The Person

Software Engineering

  • 2+ years of software engineering experience with strong proficiency in Java and Spring Boot.
  • Experience building event-driven systems using Apache Kafka.
  • Solid understanding of relational databases (PostgreSQL) and data warehousing (Redshift or equivalent).
  • Hands-on experience with Redis for caching, queuing, or session management.
  • Strong grasp of distributed systems, REST API design, and microservices architecture.

AI/ML

  • 2+ years of hands-on experience in AI/ML development using Python.
  • Familiarity with core ML concepts: supervised/unsupervised learning, model evaluation, feature engineering, and hyperparameter tuning.
  • Experience with ML frameworks such as scikit-learn, PyTorch, TensorFlow, or XGBoost.
  • Understanding of LLMs and Generative AI concepts, including prompt engineering, fine-tuning, and RAG architectures.
  • Exposure to Agentic AI patterns — tool use, planning, multi-step reasoning, or agent orchestration frameworks (e.g., LangChain, LangGraph, CrewAI, Spring AI, or similar).

The base pay range for this position in New York is $130,000 - $160,000 annually. Pay may vary depending on job-related knowledge, skills, and experience. Equity and year-end bonus may be provided as part of the compensation package, in addition to a full range of medical, financial, and other benefits, dependent on the position offered. Applicants should apply via Octaura's internal or external careers site.

Octaura Work Perks

At Octaura, our people are our most valuable asset, and we are pleased to offer the following benefits to all full-time employees:

  • Competitive compensation and equity
  • Flexible Paid Time Off
  • Competitive Parental Leave
  • Daily breakfast, coffee and snacks in the office
  • 90% company-paid healthcare
  • Onsite gym & discounted membership

We’re committed to equal opportunity employment

Octaura is committed to a diverse and inclusive workplace. We are an equal opportunity employer and do not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Software Engineer II

Octane · Irving, TX +1 place

$105k–$135k/yr

StrongChecked open todayPosted 8 days ago

Software Engineer

Dirac, Inc. · New York City, NY +1 place

$120k–$200k/yrOn-site

StrongChecked open todayPosted 9 days ago

Sr. Software Engineer

NBCUniversal · New York, NY

$120k–$170k/yrFull-timeHybrid

StrongChecked open todayPosted 2 days ago

Software Engineer, Product

Ambrook · New York, NY +2 places

$115k–$260k/yr · see postingFull-timeHybrid

Wide pay rangeChecked open todayPosted 4 days ago

See more like this