Machine Learning Engineer jobs

MLOps Engineer, LLM Systems (Serving, GPU Kernels, Profiling)

Weekday AIRemote · US onlyPart-timePosted 2 months ago

$90–$120/hr listed by the employer

Hours vary, so we don't estimate a year.

Key facts

Schedule
40 hours a week
Experience
2+ years

This job is closed.

The employer took it down 18 days ago, after 2 days open. Here are similar open jobs.

  • Checked: On the company's own careers siteWorkable board
  • Checked: Pay range listedJob posting
  • Checked: No reposts foundWorkable board
  • Trust score 89 / 100 · Looks good
See all 4 checksShow fewer
How we check

Similar open jobs

AI/ML Engineer

Woolpert · Remote · US only

$118k–$148k/yr

StrongChecked open todayPosted 1 month ago

See more like this

What you’ll do

  • Design technical tasks and write solutions covering GPU kernels, profiling, debugging, and inference serving.
  • Guide research and engineering teams on ML systems, training infrastructure, and framework-level topics.
  • Evaluate MLOps and ML systems tasks and solutions, and provide written technical feedback.
  • Develop guidelines and evaluation rubrics for kernel optimization, profiler interpretation, distributed systems reasoning, and serving trade-offs.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or GPU and accelerator performance engineering
  • Practical experience in at least one of: custom GPU kernels, performance profiling and trace analysis, debugging distributed or accelerator-bound workloads, or serving large language models at scale
  • Working production experience with JAX and/or PyTorch
  • Demonstrable career progression
  • Experience in more than one of the listed GPU kernel, profiling, debugging, or LLM serving areas (preferred)
  • Framework-level depth, such as custom operators, distributed training, or compiler and graph-level work (preferred)

Skills

  • Familiarity with modern accelerators such as A100, H100, B200, or TPU, and ability to reason about throughput, latency, and memory trade-offs

Full job description

From Weekday AI’s careers site

This role is for one of our clients

Compensation: $90-$120 per hour

Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking MLOps Engineers with hands-on experience in large language model infrastructure across any of four areas: GPU kernel programming, performance profiling and trace analysis, debugging accelerated and distributed workloads, and high-throughput inference serving. This role involves AI model training and evaluation work, including writing and assessing MLOps and ML systems tasks and solutions to generate high-quality training data for frontier AI systems.

Requirements

Key Responsibilities

Show full descriptionShow less
  • Design challenging, domain-relevant tasks across four areas, GPU kernels, performance profiling, debugging, and inference serving, and write accurate, well-structured solutions to them.
  • Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, training infrastructure, and framework-level topics.
  • Evaluate MLOps and ML systems tasks and solutions, and provide clear, written technical feedback that stands up to reviewer scrutiny.
  • Develop guidelines and detailed rubrics or evaluation frameworks covering kernel-level optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs.
  • Collaborate with other subject matter experts to keep training data consistent and accurate.

Core Qualifications

  • 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or GPU and accelerator performance engineering. This is a hands-on systems role rather than an applied modelling or data science one.
  • Practical experience in at least one of the following, with more than one a strong plus: writing or optimizing custom GPU kernels (CUDA, Triton, Pallas); performance profiling and trace analysis (Kineto, torch.profiler, Nsight, XLA or JAX profiler); debugging distributed or accelerator-bound workloads; serving large language models at scale (vLLM, SGLang, TensorRT-LLM, Ray Serve, KV cache, paged attention, continuous batching).
  • Working production experience with JAX and/or PyTorch. Framework-level depth is a strong plus: custom operators, distributed training (FSDP, DDP, DeepSpeed, Megatron), or compiler and graph-level work.
  • Familiarity with modern accelerators such as A100, H100, B200 or TPU, and the ability to reason about throughput, latency and memory trade-offs.
  • Demonstrable career progression.
  • Ability to engage reliably for at least 40 hours/week during weekdays.
  • Strong written communication skills and the ability to explain complex technical decisions clearly.

Something wrong with this job? Report it · This flag looks wrong