DevOps, SRE & Cloud Engineer jobs

AI Platform Engineer

Bright Vision TechnologiesRemote · US onlyFull-timeFirst seen 21 days ago

$100k–$150k/yr listed by the employer

Below the typical $180k a year for remote DevOps, SRE & Cloud Engineer jobs (all levels)How we compare

How we compare. Typical is the median yearly pay of 361 remote DevOps, SRE & Cloud Engineer jobs (all levels) that list pay, from the employers' own postings. About means within 5%.

Key facts

Experience
10+ years
Degree
Bachelor's degree
US visa
No US visa sponsorship

This job is closed.

The employer took it down 20 days ago, after 1 day open. Here are similar open jobs.

  • Checked: On the company's own careers siteJazzHR board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundJazzHR board
  • Note: Last seen open 21 days agoLive check
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

Similar open jobs

Platform Engineer

Rushdown Studios · Remote · US only

$100k–$150k/yr

StrongLast seen open yesterdayPosted 11 days ago

Platform Engineer

GovSignals · Remote · US only

$160k–$230k/yrFull-time

StrongChecked open todayPosted 19 days ago

Lead Platform Engineer

Stitch Fix · Remote · US only

$113k–$189k/yr

StrongChecked open todayPosted 9 days ago

Senior Platform Engineer

Doma Technology LLC · Remote · US only

$160k–$190k/yrFull-time

StrongChecked open todayPosted 10 days ago

See more like this

What you’ll do

  • Design, build, and maintain scalable AI inference and model-serving platforms for production workloads.
  • Optimize inference latency, throughput, GPU utilization, memory management, workload scheduling, and request routing.
  • Build autoscaling, deployment, monitoring, logging, tracing, alerting, caching, security, and high-availability solutions.
  • Collaborate with AI and engineering teams to deploy and support production models; improve cloud resource use and costs.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 6+ years of experience in distributed systems, infrastructure, or ML platform engineering
  • 10+ years of professional experience in distributed systems, infrastructure engineering, cloud platforms, or machine learning platform engineering
  • Extensive experience with LLM serving, model inference optimization, and production AI infrastructure
  • Hands-on experience with vLLM, TensorRT-LLM, Triton Inference Server, Ray Serve, or similar AI serving frameworks
  • Experience optimizing GPU workloads using CUDA, NVIDIA GPU technologies, distributed inference, and high-performance AI infrastructure
  • Experience with AWS, Microsoft Azure, or Google Cloud Platform (GCP)
  • Experience designing and operating multi-region AI platforms and globally distributed inference services (preferred)
  • Experience with MLOps, GitOps, Infrastructure as Code (Terraform, Bicep, CloudFormation), and CI/CD automation (preferred)
  • Contributions to open-source AI infrastructure projects, technical publications, patents, or conference presentations (preferred)
  • Experience implementing FinOps strategies, cloud cost optimization, and enterprise AI governance (preferred)
  • Experience supporting large-scale AI APIs (preferred)

Education

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Artificial Intelligence, or a related technical discipline

Skills

  • Strong programming skills in Python and at least one of Go, Rust, or C++
  • Strong expertise in Kubernetes, container orchestration, Docker, and cloud-native application architectures
  • Strong understanding of distributed systems, networking, scalability, observability, and security best practices
  • Knowledge of quantization, pruning, compression, speculative decoding, KV cache optimization, and mixed-precision inference (preferred)
  • Familiarity with Istio or Linkerd, API gateways, and event-driven architectures (preferred)

Other requirements

  • New H-1B visa petitions cannot be sponsored

Full job description

From Bright Vision Technologies’ careers site

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: AI Platform Engineer Location: 100% Remote (Continental United States) Position Type: Full-time, Direct W2 Salary Range: $100,000 – $150,000 per annum Experience: 6+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Show full descriptionShow less

Job Summary: We are seeking an AI Platform Engineer to design, build, and operate scalable AI inference platforms for production ML workloads. The ideal candidate will have expertise in distributed systems, LLM serving, GPU optimization, autoscaling, and cloud-native infrastructure, with a strong focus on performance, reliability, and observability.

Key Responsibilities:

  • Design and maintain scalable AI model serving platforms.
  • Optimize inference performance, GPU utilization, and request routing.
  • Build autoscaling, deployment, and monitoring solutions.
  • Implement caching, security, and high-availability strategies.
  • Collaborate with ML teams to deploy and support production AI models.

Required Qualifications:

  • 6+ years of experience in distributed systems, infrastructure, or ML platform engineering.
  • Strong proficiency in Python and Go, Rust, or C++.
  • Experience with LLM inference frameworks (vLLM, TensorRT-LLM), Kubernetes, cloud platforms, and GPU optimization.

Preferred Qualifications:

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title

AI Platform Engineer

Location: 100% Remote (Continental United States) Position Type: Full-time, Direct W2 Salary Range: $130,000–$180,000 Annually (based on experience) Experience Required: 10+ Years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary

Bright Vision Technologies is seeking a highly experienced AI Platform Engineer with 10+ years of experience in distributed systems, cloud-native infrastructure, and AI platform engineering to design, build, and operate enterprise-scale AI inference and machine learning platforms. The ideal candidate will possess deep expertise in LLM serving, GPU optimization, Kubernetes, cloud infrastructure, distributed systems, and MLOps, with a proven ability to deliver highly scalable, reliable, secure, and cost-efficient AI platforms supporting production machine learning workloads.

Key Responsibilities

  • Design, build, and maintain scalable AI inference and model-serving platforms for enterprise production environments.
  • Architect highly available, cloud-native infrastructure supporting Large Language Models (LLMs), foundation models, and machine learning services.
  • Optimize inference latency, throughput, GPU utilization, memory management, and request scheduling across distributed AI workloads.
  • Design autoscaling, workload orchestration, traffic management, and intelligent request routing strategies for AI services.
  • Implement model deployment, versioning, rollback, and lifecycle management using modern MLOps practices.
  • Develop monitoring, observability, logging, distributed tracing, and alerting solutions to ensure platform reliability and performance.
  • Implement caching strategies, API gateways, security controls, authentication, authorization, and high-availability architectures.
  • Collaborate with AI researchers, ML engineers, DevOps teams, and software engineers to deploy and support production AI models.
  • Drive cloud infrastructure optimization, resource utilization, FinOps initiatives, and operational excellence.
  • Mentor engineering teams, conduct architecture reviews, and establish best practices for AI platform engineering and cloud-native development.
  • Evaluate emerging AI infrastructure technologies, model-serving frameworks, and GPU acceleration techniques to drive continuous innovation.

Required Qualifications

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Artificial Intelligence, or a related technical discipline.
  • 10+ years of professional experience in distributed systems, infrastructure engineering, cloud platforms, or machine learning platform engineering.
  • Strong programming skills in Python and at least one systems programming language such as Go, Rust, or C++.
  • Extensive experience with Large Language Model (LLM) serving, model inference optimization, and production AI infrastructure.
  • Hands-on experience with vLLM, TensorRT-LLM, Triton Inference Server, Ray Serve, or similar AI serving frameworks.
  • Strong expertise in Kubernetes, container orchestration, Docker, and cloud-native application architectures.
  • Experience optimizing GPU workloads using CUDA, NVIDIA GPU technologies, distributed inference, and high-performance AI infrastructure.
  • Experience with cloud platforms including AWS, Microsoft Azure, or Google Cloud Platform (GCP).
  • Strong understanding of distributed systems, networking, scalability, observability, and security best practices.
  • Excellent analytical, communication, collaboration, and technical leadership skills.

Preferred Qualifications

  • Experience designing and operating multi-region AI platforms and globally distributed inference services.
  • Knowledge of model optimization techniques such as quantization, pruning, compression, speculative decoding, KV cache optimization, and mixed-precision inference.
  • Experience with MLOps, GitOps, Infrastructure as Code (Terraform, Bicep, CloudFormation), and CI/CD automation.
  • Familiarity with service mesh technologies such as Istio or Linkerd, API gateways, and event-driven architectures.
  • Contributions to open-source AI infrastructure projects, technical publications, patents, or conference presentations.
  • Experience implementing FinOps strategies, cloud cost optimization, and enterprise AI governance.
  • Experience with multi-region AI deployments and AI infrastructure.
  • Familiarity with model optimization techniques such as quantization or compression.
  • Open-source contributions or experience supporting large-scale AI APIs.

Interested in this opportunity? Apply today for immediate consideration!

Email your updated resume to jaya@bvteck.com Call or Text (908) 505-3545 if you have any questions. Learn more about Bright Vision Technologies at www.bvteck.com.

We look forward to connecting with talented professionals and helping you take the next step in your career.

Bright Vision Technologies is an Equal Opportunity Employer.

Something wrong with this job? Report it