Software Engineer jobs

AI Developer

Salvo SoftwareRemote · US onlyFull-time3+ years experiencePosted 16 days ago

Pay not listed

Looks real. 1 thing to check before you apply.

On Salvo Software’s own careers site (Workable), checked open today.

  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteWorkable board
  • Checked: Checked open todayWorkable board
  • Checked: No reposts foundWorkable board
  • Trust score 95 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Serve and operate open-source LLMs locally and in on-prem environments.
  • Build and maintain RAG pipelines and MCP integrations connecting LLMs to tools and data.
  • Develop Python backend services for inference and AI product features, including processing structured and semi-structured data.
  • Build CI/CD pipelines, deploy and containerize AI workloads, and automate operational tasks.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3–5+ years of engineering experience with production-level Python
  • Experience building real services, LLM inference, RAG pipelines, and automated tooling with Python
  • Hands-on experience serving models via Ollama or llama.cpp, implementing vector retrieval/RAG, and developing MCP integrations
  • Azure or AWS deployments, Docker containerization, Linux/Windows administration, and CI/CD automation
  • DevOps, security, and operations awareness, including Git workflows, scripting, observability, DevSecOps, and compliance frameworks

Skills

  • GPU/CUDA tuning and model quantization (preferred)
  • Terraform, Kubernetes, Kafka, or systems languages such as Go, Rust, or C++ (preferred)
  • Azure DevOps (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Salvo Software’s careers site

Salvo Software is a global technology company specializing in custom software development and advanced engineering solutions. With distributed teams across the US, LATAM, and India, we partner with clients to build high-performance, scalable systems that solve complex technical challenges. Our culture values innovation, ownership, and engineering excellence. We're growing our AI department and are looking for a hands-on AI Developer to help build it.

Role Overview

Show full descriptionShow less

We are looking for an AI Developer to join and strengthen our AI department. Your core work will be building and operating LLM-powered systems: serving open-source models with Ollama and llama.cpp, building RAG pipelines, and developing MCP integrations that connect large language models to real tools and data. Solid DevOps fundamentals - Docker, CI/CD, Azure - support this work, but AI engineering is the heart of the role.

You don't need to be a deep ML researcher. What matters is production-grade Python, strong fundamentals, and the aptitude to learn fast. You'll work closely with our engineering and product teams to take LLM-powered features from prototype to reliably deployed systems, with mentorship available as you ramp up in areas like RAG architecture, Kafka, and advanced MCP work.

Key Responsibilities

AI / LLM Engineering (core focus)

  • Serve and operate open-source LLMs using Ollama and llama.cpp, locally and in on-prem environments.
  • Build and maintain RAG pipelines: embeddings, vector databases, chunking strategies, and retrieval quality.
  • Develop MCP (Model Context Protocol) integrations connecting LLMs to internal tools and data sources.
  • Build backend services in Python that power ML inference and AI-driven product features.
  • Parse and process structured and semi-structured data (XML/XSD, Office document formats) as pipeline inputs.
  • Grow into model optimization over time: quantization (GGUF), GPU/CUDA tuning, and offline/air-gapped deployments.

DevOps & Infrastructure (supporting)

  • Build and maintain CI/CD pipelines for AI services (Azure DevOps preferred; GitHub Actions / GitLab CI also used).
  • Deploy AI workloads to Microsoft Azure,AWS and containerize services with Docker.
  • Automate operational tasks with Python, Bash and/or PowerShell scripting.
  • Troubleshoot across the stack - dig into root causes rather than patching symptoms.
  • Support event-driven architectures using Apache Kafka (producers/consumers).

Requirements

  • 3–5+ years engineering experience with production-level Python for building real services, LLM inference, RAG pipelines, and automated tooling.
  • Hands-on LLM & AI integration serving models via Ollama/llama.cpp, implementing vector retrieval/RAG, and developing MCP integrations (GPU/CUDA tuning & model quantization nice to have).
  • Cloud & Infrastructure expertise covering Azure/AWS deployments, Docker containerization, Linux/Windows admin, and CI/CD automation (Azure DevOps, GitHub Actions, or GitLab CI), with Terraform, Kubernetes, Kafka, or systems languages (Go, Rust, C++) as a plus.
  • DevOps, Security & Operations awareness, including Git workflows, scripting (Python, Bash, PowerShell), observability tools (Prometheus/Grafana), DevSecOps, and compliance frameworks (SOC 2, ISO 27001, Zero Trust).
  • Strong problem-solving & communication with a root-cause troubleshooting mindset, self-directed learning, strong ownership, and seamless remote/distributed team collaboration.

Something wrong with this job? Report it · This flag looks wrong

Similar remote jobs

SQL Developer

Bright Vision Technologies · Remote · US only

$115k–$165k/yrFull-time

StrongChecked open todayPosted yesterday

AI Engineer III

Vericast · Remote · US only

$120k–$140k/yrFull-time

StrongChecked open todayPosted 3 days ago

API Developer

Bright Vision Technologies · Remote · US only

$115k–$165k/yrFull-time

StrongChecked open todayPosted 5 days ago

Salesforce Developer

Cherokee Federal · Remote · US only

$130k–$140k/yr

StrongChecked open todayPosted 8 days ago

See more like this