Software Engineer jobs

Software Engineer, GPU Performance

HeyGenLos Angeles, Singapore +4 placesLos Angeles, Singapore · Los Angeles, CA · Palo Alto, CA · San Francisco, CA · Toronto, CanadaPosted 1 month ago

Pay not listed

Looks real. 1 thing to check before you apply.

On HeyGen’s own careers site (Greenhouse), checked open today.

  • To check: No pay range listed, though one is likely required in CAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: No reposts foundGreenhouse board
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

What you’ll do

  • Profile GPU workloads and investigate utilization, kernel execution, memory bandwidth, and CPU–GPU data movement.
  • Find bottlenecks in model execution, preprocessing, and inference serving, then measure optimization results.
  • Improve performance through batching, scheduling, memory management, GPU utilization improvements, and GPU kernel development or integration.
  • Build benchmarks and automated checks for performance regressions across representative video workloads.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience optimizing GPU-based AI workloads or high-performance computing systems
  • Experience with PyTorch or a similar machine learning framework
  • Experience using profiling tools to connect hardware behavior to application-level bottlenecks and validate improvements
  • Experience with CUDA, Triton, or C++ GPU programming (preferred)
  • Experience optimizing video, image, audio, diffusion, or Transformer models (preferred)
  • Familiarity with multi-GPU inference, GPU interconnects, quantization, or large-scale model serving (preferred)
  • Experience building performance benchmarks or regression testing infrastructure (preferred)
  • Prior experience in a fast-paced technology environment (preferred)

Skills

  • Proficiency in Python

Other requirements

  • Strong curiosity about GPU hardware, including memory bandwidth, cache behavior, tensor cores, and CPU–GPU data movement

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Learning & tuition
Opportunities for professional growth and advancement.
Other
Competitive salary and benefits package.

Full job description

From HeyGen’s careers site

About HeyGen

At HeyGen, our mission is to make visual storytelling accessible to all. Over the last decade, visual content has become the preferred method of information creation, consumption, and retention. But the ability to create such content, in particular videos, continues to be costly and challenging to scale. Our ambition is to build technology that equips more people with the power to reach, captivate, and inspire audiences. Learn more at www.heygen.com. Visit our Mission and Culture doc here.

Position Summary

Show full descriptionShow less

HeyGen is building AI applications including Avatar IV, Photo Avatar, Interactive Avatar, and Video Translation. We’re looking for a Software Engineer focused on GPU performance to make the systems behind these experiences faster and more efficient.

You will work across model execution and inference infrastructure, using profiling and measurement to improve latency, throughput, and GPU cost. This role is a fit for an engineer who enjoys understanding how software uses the hardware beneath it.

Key Responsibilities

  • Use NVIDIA Nsight Systems, Nsight Compute, and PyTorch Profiler to investigate GPU utilization, kernel execution, memory bandwidth, and CPU–GPU data movement.
  • Identify bottlenecks across model execution, preprocessing, and inference serving, then measure the impact of each optimization.
  • Improve performance through batching, scheduling, memory management, and better GPU utilization.
  • Develop or integrate high-performance GPU kernels when existing implementations limit performance.
  • Build benchmarks and automated checks that catch performance regressions across representative video workloads.
  • Collaborate with AI researchers and infrastructure engineers to bring optimizations into production.
  • Measure the effect of changes on latency, throughput, cost, and output quality.

Qualifications

  • Experience optimizing GPU-based AI workloads or high-performance computing systems.
  • Proficiency in Python and experience with PyTorch or a similar machine learning framework.
  • Strong curiosity about GPU hardware, including memory bandwidth, cache behavior, tensor cores, and data movement between CPU and GPU.
  • Experience using profiling tools to connect hardware behavior to application-level bottlenecks and validate improvements.
  • Ability to turn performance experiments into reliable production changes and communicate tradeoffs clearly.

Preferred Qualifications

  • Experience with CUDA, Triton, or C++ GPU programming.
  • Experience optimizing video, image, audio, diffusion, or Transformer models.
  • Familiarity with multi-GPU inference, GPU interconnects, quantization, or large-scale model serving.
  • Experience building performance benchmarks or regression testing infrastructure.
  • Prior experience in a fast-paced technology environment.

What HeyGen Offers

  • Competitive salary and benefits package.
  • Dynamic and inclusive work environment.
  • Opportunities for professional growth and advancement.
  • Collaborative culture that values innovation and creativity.
  • Access to the latest technologies and tools.

Join us at HeyGen

Help us make AI video faster and more accessible. We’d love to hear from you.

HeyGen is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

GNC Software Engineer

CHAOS Industries · El Segundo, CA +1 place

$160k–$240k/yrFull-timeOn-site

StrongChecked open todayPosted 10 days ago

See more like this