New York jobs

Production Support Engineer - LLM Platform

Qube Research & TechnologiesNY, US +2 placesNY, US · Chicago, IL · New York, NYPosted 17 days ago

$150k–$220k/yr listed by the employer

This job is closed.

The employer took it down 2 days ago, after 14 days open. Here are similar open jobs.

  • To check: Employer's job board no longer lists it (checked 2026-11-19)It may be filled or taken down. Check the employer's careers site before you apply.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 60 / 100 · Check details
See all 5 checksShow fewer
How we check

Similar jobs

TechOps Engineer

Qube Research & Technologies · Chicago, NY +2 places

$170k–$240k/yr

StrongOpen 2 monthsChecked open todayPosted 2 months ago

Corvil Engineer

Qube Research & Technologies · New York, NY

$150k–$250k/yr

Looks goodOpen 10 monthsChecked open todayPosted 10 months ago

Trading Systems Engineer

Qube Research & Technologies · New York, NY

$180k–$300k/yr

StrongChecked open todayPosted 10 days ago

Data Support Specialist

Qube Research & Technologies · New York, NY

$150k–$180k/yr

Looks goodOpen 8 monthsChecked open todayPosted 8 months ago

See more like this

What you’ll do

  • Provide first- and second-line support for the LLM platform, investigate incidents and user issues, and manage tickets through resolution or escalation.
  • Monitor platform health, troubleshoot gateway and model-provider problems, perform approved recovery actions, and collect diagnostic evidence.
  • Support users configuring LLM integrations, API clients, coding assistants and developer workspaces; investigate access, permissions and model availability.
  • Carry out release checks, non-production validation, smoke tests and approved rollbacks in coordination with platform engineering.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Relevant experience in production support, application support or platform operations
  • Practical experience interpreting metrics, logs, traces and dashboards
  • Hands-on experience supporting LLM-based platforms or services and a working understanding of LLM APIs
  • Experience supporting AWS Bedrock or other managed model APIs (preferred)
  • Experience supporting AI coding assistants, API clients or developer workspaces such as Claude Code, Codex CLI, OpenCode, PI or Coder (preferred)
  • Exposure to LLM gateways or proxies such as LiteLLM, or internally hosted inference services such as vLLM (preferred)
  • Experience troubleshooting containerised services on ECS or Kubernetes (preferred)
  • Experience supporting multi-region services and globally distributed support and engineering teams (preferred)
  • Experience coordinating support cases with cloud providers or software vendors during service degradation (preferred)

Skills

  • Practical Linux troubleshooting skills
  • Familiarity with Windows-based developer environments
  • Working proficiency in Python, Bash and/or PowerShell
  • Experience using SQL to investigate application issues and query operational records
  • Confidence troubleshooting API-driven services, including HTTP errors, authentication, networking, timeouts, retries, rate limiting and streaming connections
  • Familiarity with public-cloud services and ability to inspect containerised workloads using established tools and procedures
  • Experience using PostgreSQL (preferred)
  • Experience with AWS (preferred)
  • Familiarity with Grafana, Coralogix or equivalent monitoring and log-analysis tools (preferred)
  • Familiarity with identity and access provisioning, particularly Okta, SCIM and application-level permissions (preferred)

Other requirements

  • Awareness of access controls, sensitive-data handling and safe diagnostic practices

Benefits

Bonus
Discretionary performance-based bonuses
Other
Competitive benefits package

Full job description

From Qube Research & Technologies’ careers site

Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager, operating in all liquid asset classes across the world. We are a technology and data driven group implementing a scientific approach to investing. Combining data, research, technology and trading expertise has shaped QRT’s collaborative mindset which enables us to solve the most complex challenges. QRT’s culture of innovation continuously drives our ambition to deliver high quality returns for our investors.

Show full descriptionShow less

You will provide day-to-day production support for QRT’s platform for accessing internally hosted and external LLMs. Based in the US, you will support users during US business hours and coordinate with colleagues in other regions to ensure effective incident handovers.

This is a hands-on support role, focused on incident resolution, user assistance and established operational procedures-not platform architecture, model development or infrastructure engineering.

Your future role within QRT:

  • Provide first- and second-line support for QRT’s platform for accessing internally hosted and external LLMs, investigating issues raised by engineering and business users, maintaining support tickets and following issues through to resolution or engineering escalation.
  • Monitor platform health using existing dashboards, logs and alerts; identify availability, latency and error-rate problems and perform approved recovery actions using established runbooks.
  • Troubleshoot gateway and model-provider issues, including authentication failures, rate limits, timeouts, connection resets, streaming failures and regional performance differences.
  • Determine whether incidents originate in a user’s client or configuration, the platform gateway, an internally hosted model or an external LLM provider; collect diagnostic evidence and coordinate escalation to the appropriate team or vendor.
  • Support coding assistants, API clients and developer workspaces connected to QRT’s LLM platform, including Claude Code, Codex CLI, OpenCode, PI and Coder; investigate compatibility issues following client or vendor updates.
  • Help users configure supported integrations, select the appropriate regional endpoint and migrate API access from Open WebUI to the direct gateway.
  • Investigate access and model-availability queries, check user permissions and escalate provisioning or entitlement issues through established support and governance processes.
  • Carry out operational checks for releases and configuration changes, including non-production validation, post-release smoke testing and approved rollback procedures, in coordination with platform engineering.
  • Use existing observability tools to investigate time to first token, time per output token, percentile latency and failure rates; flag recurring issues and monitoring gaps to the platform team.
  • Maintain runbooks, troubleshooting guides and known-issue records; provide clear incident updates and reliable handovers between regional support teams.
  • Maintain small support scripts and diagnostic utilities to reduce repetitive checks and improve evidence collection.

Your present skillset:

  • Relevant experience in production support, application support or platform operations, with the ability to investigate routine incidents independently and recognise when specialist escalation is required.
  • Practical Linux troubleshooting skills and familiarity with Windows-based developer environments.
  • Working proficiency in Python, Bash and/or PowerShell for operational checks, log analysis and straightforward support automation.
  • Experience using SQL to investigate application issues and query operational records, ideally in PostgreSQL.
  • Practical experience interpreting metrics, logs, traces and dashboards to distinguish a platform-wide incident from a user-, client-, model- or region-specific issue.
  • Confidence troubleshooting API-driven services, including HTTP errors, authentication, networking, timeouts, retries, rate limiting and streaming connections.
  • Hands-on experience supporting LLM-based platforms or services, with a working understanding of LLM APIs, including prompts, context limits, token usage, model identifiers and streaming responses.
  • Familiarity with public-cloud services, ideally AWS, and the ability to inspect containerised workloads using established tools and procedures.
  • Clear communication with technical and non-technical users, including concise incident updates, realistic expectations and well-documented escalations.
  • Awareness of access controls, sensitive-data handling and safe diagnostic practices, including avoiding exposure of prompts, credentials or confidential content in support records.
  • A methodical approach to troubleshooting, prioritisation and cross-region handovers

Nice to have:

  • Experience supporting AWS Bedrock or other managed model APIs.
  • Experience supporting AI coding assistants, API clients or developer workspaces such as Claude Code, Codex CLI, OpenCode, PI or Coder.
  • Familiarity with Grafana, Coralogix or equivalent monitoring and log-analysis tools.
  • Exposure to LLM gateways or proxies such as LiteLLM, or internally hosted inference services such as vLLM.
  • Experience troubleshooting containerised services on ECS or Kubernetes.
  • Familiarity with identity and access provisioning, particularly Okta, SCIM and application-level permissions.
  • Experience supporting multi-region services and working with globally distributed support and engineering teams.
  • Experience coordinating support cases with cloud providers or software vendors during service degradation.

Base salary range for this position is $150,000 to $220,000 per year.

QRT Total Compensation includes discretionary performance-based bonuses and a competitive benefits package.

Something wrong with this job? Report it · This flag looks wrong