Software Engineering jobs

Machine Learning Infrastructure Engineer - LLM & Agentic AI

Stellar CyberRemote · US onlyFull-timePosted 24 days ago

$150k–$215k/yr listed by the employer

Key facts

Experience
2+ years
Degree
Bachelor's degree or equivalent

Looks real and checked open today.

On Stellar Cyber’s own careers site (Workable).

  • Checked: On the company's own careers siteWorkable board
  • Checked: Checked open todayWorkable board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundWorkable board
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

What you’ll do

  • Build Agentic AI frameworks that orchestrate LLM agents to reason, plan, and execute SecOps tasks.
  • Develop scalable LLM inference infrastructure for efficient serving and resource management across hosting providers.
  • Develop MCP servers that connect Open XDR platform services with LLM-based agents.
  • Build supporting API services for reliable, extensible agent operations.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 2 years of experience with software development, or 1 year of experience with an advanced degree in an industry setting
  • 2 years of experience with data structures or algorithms in an academic or industry setting
  • 2 years of experience developing backend infrastructure, distributed systems, REST or gRPC APIs, and microservices for MLOps-related projects
  • Experience with cloud computing technologies, including containerization, orchestration, and deployment
  • Experience with at least one of Python, Java, or Go
  • Experience working on LLM applications in high-sensitivity domains such as finance, defense, or health (preferred)
  • Experience with Generative AI frameworks such as LangChain, LangGraph, or AutoGen, and technologies such as prompt engineering, vector databases, or RAG (preferred)
  • Experience with observability practices in ML systems, such as metrics and cost tracking (preferred)
  • Experience deploying and scaling LLMs for inference using frameworks such as vLLM or llama.cpp (preferred)
  • Experience working on ML platform teams or building tools for researchers (preferred)

Education

  • Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience

Skills

  • Knowledge of SecOps concepts, activities, and workflows (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Medical care
Dental & vision
Dental and vision care
Retirement plan
401(k)
Equity
Pre-IPO stock options
Bonus
Bonus opportunity
Wellness & mental health
Employee Assistance Program
Life & disability insurance
Life insurance
Other
Employee Discount Program, Referral Program, Rewards and Recognition Program

Also: paid time off

Full job description

From Stellar Cyber’s careers site

Join a fast-growing global leader in cybersecurity, trusted by some of the biggest names in the industry. In addition to some of the world’s largest enterprises and government agencies, more than 30% of the world’s top MSSPs rely on our platform. We’re at the forefront of protecting organizations against sophisticated cyber threats using cutting-edge AI and automation technologies. Our culture is built on diversity, openness, and collaboration, fostering creativity and innovation that drives real impact in the market.

Show full descriptionShow less

We are looking for a highly skilled Machine Learning Infrastructure Engineer with a passion for building robust and scalable systems to power Stellar Cyber’s Autonomous SOC applications. In this role, you will be at the forefront of AI infrastructure innovation, responsible for developing the foundational components that enable intelligent agents to work like true SOC analysts to operate in dynamic SecOps environments.

Responsibilities

  • Design and build Agentic AI frameworks to orchestrate LLM-based agents capable of reasoning, planning, and executing SecOps tasks in Stellar Cyber’s Open XDR platform.
  • Design and develop scalable LLM inference infrastructure that supports runtime- and cost-efficient serving and resource management across LLM hosting providers.
  • Develop MCP servers that interact with Open XDR platform services and features, and integrate with LLM-based agents.
  • Develop other supporting API services necessary for Autonomous SOC applications to provide reliable and extensible interface for agent operations.
  • Collaborate closely with machine learning / security researchers, UI / backend / infrastructure engineers, and product management to align infrastructure with evolving product needs.

Requirements

  • Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience.
  • 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting.
  • 2 years of experience with data structures or algorithms in either an academic or industry setting.
  • 2 years of experience with developing backend infrastructure, distributed systems, APIs (REST / gRPC), and microservices for MLOps related projects.
  • Experience with cloud computing technologies, including containerization, orchestration, and deployment (Docker, Kubernetes, etc).
  • Experience in one or more of the following programming languages: Python, Java, Go.

Preferred Qualifications

  • Experience working on LLM applications in high-sensitivity domains (e.g., finance, defense, health).
  • Experience with Generative AI frameworks (e.g., LangChain, LangGraph, AutoGen, or other frameworks) and technologies (prompt engineering, vector databases, RAG, etc.).
  • Experience with observability practices in ML systems (e.g., metrics, cost tracking).
  • Experience deploying and scaling LLMs for inference using frameworks such as vLLM, llama.cpp, and etc.
  • Experience working on ML platform teams and/or building tools for researchers.
  • Knowledge of SecOps concepts, activities, workflows is a plus.

Benefits

We pride ourselves in recognizing our employees. Here are some examples of our benefits program:

  • Pre-IPO Stock Options
  • Medical, Dental & Vision care
  • 401(k)
  • Employee Assistance Program
  • Employee Discount Program
  • Life Insurance
  • Paid time off
  • Referral Program
  • Rewards and Recognition Program

Why Join Us

  • Work at the forefront of cybersecurity innovation within a dynamic, fast-growing team.
  • Opportunity to significantly influence and shape the integration architecture of a next-generation SecOps platform powered by AI and automation.
  • Competitive salary, comprehensive benefits, and ample career growth opportunities.

The base compensation range for this role is USD 150,000-215,000 per year. Total compensation includes bonus opportunity and equity, and will vary based on candidate location.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

AI Engineer III

Vericast · Remote · US only

$120k–$140k/yrFull-time

StrongChecked open todayPosted 3 days ago

See more like this