Software Engineer jobs

Research Engineer - AI Systems

Yotta LabsRemote · 4 countriesFull-time

Pay not listed

Looks real. 2 things to check before you apply.

On Yotta Labs’ own careers site (Ashby), checked open today.

  • To check: Posted by the employer 4 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: No reposts foundAshby board
  • Trust score 85 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Design and implement high-performance kernels for attention, MoE, GEMM, collective communication, and quantization across NVIDIA, AMD, and AWS Trainium hardware.
  • Develop custom operators and graph optimizations using Neuron SDK, PyTorch/XLA, Torch Dynamo, and Neuron Compiler.
  • Improve performance of vLLM, SGLang, TensorRT-LLM, and custom inference runtimes.
  • Design distributed training and inference solutions across thousands of accelerators.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience with CUDA, Triton, ROCm/HIP, or AWS Neuron
  • Contributions to open-source AI infrastructure projects like vLLM, SGLang, PyTorch, or Triton (preferred)
  • Experience with FlashAttention, PagedAttention, MoE, RLHF, or distributed AI systems (preferred)
  • Publications in top-tier conferences like MLSys, OSDI, SOSP, NSDI, SC, HPCA, or ISCA (preferred)

Education

  • Background in computer science, engineering, or a related field (preferred)

Skills

  • Proficiency in AI programming languages such as Python and C++
  • Deep understanding of GPU architecture and performance optimization
  • Strong understanding of AI frameworks (e.g., PyTorch, Dynamo, LMCache), model architectures, and profiling tools (e.g., Nsight, ROCm Profiler, or Neuron Profiler)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Flexible schedule
Flexible, remote work environment
Other
Competitive compensation

Also: equity

Full job description

From Yotta Labs’ careers site

Location: Remote (Global)

Type: Full-time

Company: Yotta Labs

Apply: careers@yottalabs.ai

🧠 About Yotta Labs

Yotta Labs is building the next generation multi-silicon AI cloud and runtime platform to power the world’s most demanding AI workloads. We enable training and inference across NVIDIA GPUs, AMD GPUs, and AWS Trainium, helping AI companies achieve the best performance and economics across heterogeneous hardware. Our mission is to provide high-performance AI computing and Model API services, enabling AI companies, research labs, and enterprises to train, deploy and integrate cutting-edge models at scale.

🛠️ Role Overview

Show full descriptionShow less

We are seeking a highly motivated AI Systems Research Engineer specializing in Trainium, GPU kernels, and LLM systems optimization. You will work at the intersection of AI Systems, Compiler and Runtime Optimization, Distributed Training & Inference, GPU/Accelerator Kernel Development, and Large Language Model Infrastructure. Your work will directly impact the scalability and performance of AI applications deployed on our platform.

🎯 Responsibilities

  • Design and implement high-performance kernels for Attention, MoE, GEMM, collective communication, and quantization.
  • Optimize kernels for NVIDIA, AMD, and AWS Trainium.
  • Develop custom operators and graph optimizations using Neuron SDK, PyTorch/XLA, Torch Dynamo, and Neuron Compiler.
  • Improve performance of vLLM, SGLang, TensorRT-LLM, and custom inference runtimes.
  • Design scalable distributed training and inference solutions across thousands of accelerators.
  • Contribute to open-source projects, publish technical findings and engage with the developer community.

✅ Qualifications

  • Proficiency in AI programming languages such as Python and C++.
  • Deep understanding of GPU architecture and performance optimization.
  • Experience with CUDA, Triton, ROCm/HIP, or AWS Neuron.
  • Strong understanding of AI frameworks (e.g., PyTorch, Dynamo, LMCache), model architectures and profiling tools (e.g. Nsight, ROCm Profiler, or Neuron Profiler).
  • Strong problem-solving skills and the ability to work in a collaborative, remote environment.
  • A background in computer science, engineering, or a related field is preferred.

🌟 Preferred Experience

  • Contributions to open-source AI infra projects like vLLM, SGLang, PyTorch, or Triton.
  • Experience with with FlashAttention, PagedAttention, MoE, RLHF, or distributed AI systems.
  • Publications in top-tier conferences like MLSys, OSDI, SOSP, NSDI, SC, HPCA, or ISCA

🌐 Why Join Yotta Labs?

  • Be part of a visionary team aiming to redefine AI infrastructure and influence the future of multi-silicon AI computing.
  • Work on cutting-edge technologies that solves frontier AI infrastructure problems.
  • Collaborate with experts from leading institutions and tech companies.
  • Competitive compensation with equity. Enjoy a flexible, remote work environment that values innovation and autonomy.

📩 How to Apply

Interested candidates should apply directly or send their resume and a brief cover letter to careers@yottalabs.ai. Please include links to any relevant projects or contributions.

Something wrong with this job? Report it · This flag looks wrong

Similar remote jobs

AI Engineer III

Vericast · Remote · US only

$120k–$140k/yrFull-time

StrongChecked open todayPosted 4 days ago

See more like this