Remote · US only jobs

AI Infrastructure Engineer

Bright Vision TechnologiesRemote · US onlyFull-timeFirst seen 20 days ago

$100k–$150k/yr listed by the employer

Key facts

Experience
6+ years
Degree
Bachelor's degree
US visa
No US visa sponsorship

This job is closed.

The employer took it down 19 days ago, after 1 day open. Here are similar open jobs.

  • Checked: On the company's own careers siteJazzHR board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundJazzHR board
  • Note: Last seen open 20 days agoLive check
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

Similar open jobs

AI Infrastructure Engineer

PlayerZero · San Francisco, CA

$150k–$210k/yrFull-timeHybrid

StrongChecked open todayPosted 1 month ago

Infrastructure Engineer

Simple AI · San Francisco, CA

$140k–$250k/yrFull-timeOn-site

StrongChecked open todayPosted 9 days ago

See more like this

What you’ll do

  • Optimize throughput, latency, and cost for AI training and inference workloads.
  • Tune performance across GPU kernels, distributed systems, memory management, and compiler-level optimization.
  • Profile and measure workloads to guide performance improvements.
  • Work with cross-functional partners to turn requirements into engineering solutions.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 6+ years of experience in performance engineering, ML systems, or HPC
  • Hands-on experience optimizing deep learning workloads on modern GPUs
  • Experience with profiling tools across CPU, GPU, and distributed systems
  • Experience optimizing LLM inference at production scale (preferred)
  • Contributions to vLLM, TensorRT-LLM, DeepSpeed, or similar projects (preferred)
  • Experience with FinOps for AI workloads (preferred)
  • Publications or talks on AI systems performance (preferred)

Education

  • Bachelor's or master's degree in computer science, computer engineering, or a related field

Skills

  • Strong proficiency in Python and C++
  • Deep understanding of distributed training and inference techniques
  • Familiarity with model compression techniques and their accuracy implications
  • Excellent measurement, debugging, and analytical reasoning skills
  • Familiarity with custom kernel authoring in Triton or CUTLASS (preferred)

Full job description

From Bright Vision Technologies’ careers site

AI Infrastructure Engineer- Remote

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.

This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: AI Infrastructure Engineer Location: 100% Remote (United States) Position Type: Full-time, Direct W2 Salary Range: $100,000–$150,000 Annually Experience: 6+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Show full descriptionShow less

Job Summary We are seeking an AI Performance Optimization Engineer to focus on extracting maximum throughput, minimizing latency, and reducing cost across training and inference workloads for large neural network systems. The role spans the full stack from low-level kernel optimization to distributed system tuning, requiring deep understanding of GPU architecture, model parallelism, memory management, and compiler-level optimization. The ideal candidate has demonstrated an impact on production of AI workloads, with strong instrumentation and measurement discipline that enables rigorous, data-driven optimization decisions. In this role you will work closely with cross-functional partners — product, design, engineering, operations, and business stakeholders — to translate ambiguous requirements into well-engineered solutions, and will be expected to raise the bar through code review, design review, and mentorship of more junior engineers. The successful candidate brings strong engineering discipline, a clear communication style, and a track record of shipping meaningful work that holds up well in production.

Required Qualifications

  • Bachelor's or master's degree in computer science, Computer Engineering, or related field.
  • Six or more years of experience in performance engineering, ML systems, or HPC.
  • Strong proficiency in Python and C++.
  • Hands-on experience optimizing deep learning workloads on modern GPUs.
  • Deep understanding of distributed training and inference techniques.
  • Experience with profiling tools across CPU, GPU, and distributed systems.
  • Familiarity with model compression techniques and their accuracy implications.
  • Strong grasp of memory hierarchies, communication primitives, and parallelism strategies.
  • Excellent measurement, debugging, and analytical reasoning skills.
  • Strong communication and collaboration skills.

Preferred Qualifications

  • Experience optimizing LLM inference at production scale.
  • Contributions to vLLM, TensorRT-LLM, DeepSpeed, or similar projects.
  • Familiarity with custom kernel authoring in Triton or CUTLASS.
  • Experience with FinOps for AI workloads.
  • Publications or talks on AI systems performance.

How to Apply Would you like to know more about this opportunity? For immediate consideration, please send your resume to jaya@bvteck.com or contact us at (908) 505-3545. Learn more about Bright Vision Technologies at www.bvteck.com.

Bright Vision Technologies is an Equal Opportunity Employer.

Something wrong with this job? Report it