Software Engineer jobs

GPU Software Engineer (CUDA)

Bright Vision TechnologiesRemote · US onlyFull-timeFirst seen 20 days ago

$100k–$175k/yr listed by the employer

Below the typical $190k a year for remote Software Engineer jobs (all levels)How we compare

How we compare. Typical is the median yearly pay of 1,664 remote Software Engineer jobs (all levels) that list pay, from the employers' own postings. About means within 5%.

Key facts

Experience
10+ years
Degree
Bachelor's degree
US visa
No US visa sponsorship

This job is closed.

The employer took it down 18 days ago, after 1 day open. Here are similar open jobs.

  • Checked: On the company's own careers siteJazzHR board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundJazzHR board
  • Note: Last seen open 20 days agoLive check
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

Similar open jobs

See more like this

What you’ll do

  • Design and optimize CUDA kernels, libraries, and custom operators for AI and HPC workloads.
  • Profile GPU workloads and tune memory access, occupancy, registers, shared memory, and multi-GPU or multi-node execution.
  • Collaborate with ML engineers to identify bottlenecks in training and inference pipelines.
  • Develop benchmarks and regression tests, and evaluate new GPU architectures and compiler optimizations.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 10+ years of experience in GPU programming and performance engineering
  • Hands-on experience profiling and optimizing GPU workloads in production
  • Experience integrating custom kernels into ML frameworks
  • Experience with Triton, CUTLASS, or other GPU kernel authoring frameworks (preferred)
  • Exposure to compiler infrastructure such as LLVM or MLIR (preferred)
  • Open-source contributions to GPU or ML performance libraries (preferred)
  • Experience with large-scale distributed training infrastructure (preferred)

Education

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field

Skills

  • Deep expertise in CUDA C/C++ and GPU programming models
  • Strong understanding of modern GPU architectures, memory hierarchies, and execution models
  • Familiarity with NCCL, MPI, and high-performance interconnect technologies
  • Strong C++ skills and familiarity with modern systems programming practices
  • Solid grounding in linear algebra and numerical methods
  • Familiarity with TensorRT, FasterTransformer, or vLLM internals (preferred)

Full job description

From Bright Vision Technologies’ careers site

GPU Software Engineer (CUDA)– Remote

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: GPU Software Engineer (CUDA) Location: 100% Remote (U.S.) Position Type: Full-time, Direct W2 Salary Range: $100,000–$175,000 Annually Experience Required: 10+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Show full descriptionShow less

Job Summary: We are seeking a GPU Software Engineer with deep expertise in CUDA programming, GPU architecture, and high-performance computing to design and optimize compute-intensive workloads on modern accelerator hardware. This role focuses on extracting maximum performance from GPU platforms for AI training, inference, scientific computing, and high-throughput data processing workloads. The ideal candidate combines low-level systems mastery with strong software engineering practices, and has a track record of delivering measurable performance improvements on production GPU systems. In this role you will work closely with cross-functional partners — product, design, engineering, operations, and business stakeholders — to translate ambiguous requirements into well-engineered solutions, and will be expected to raise the bar through code review, design review, and mentorship of more junior engineers. The successful candidate brings strong engineering discipline, a clear communication style, and a track record of shipping meaningful work that holds up well in production.

Key Responsibilities

  • Design and implement high-performance CUDA kernels for compute-intensive workloads across AI and HPC use cases.
  • Profile and optimize GPU code using tools such as Nsight Systems, Nsight Compute, and CUDA profilers.
  • Tune memory access patterns, occupancy, register usage, and shared memory utilization for peak performance.
  • Develop highly optimized libraries for linear algebra, attention, and other ML primitives.
  • Optimize multi-GPU and multi-node training using NCCL, RDMA, and high-performance networking.
  • Implement custom operators and fused kernels in PyTorch, JAX, or Triton.
  • Collaborate with ML engineers to identify performance bottlenecks in training and inference pipelines.
  • Develop benchmarks and regression tests to safeguard performance over time.
  • Evaluate new GPU architectures and feature sets, and advise on adoption strategy.
  • Contribute to compiler-level optimizations for tensor programs where appropriate, working at the boundary between ML frameworks and underlying accelerator codegen to unlock performance not reachable through framework-level tuning alone.
  • Optimize memory hierarchy usage across HBM, L2, shared memory, and registers.
  • Implement mixed-precision and quantized compute paths that maximize accelerator throughput while preserving numerical fidelity within bounds acceptable for the target workloads.
  • Document performance characteristics, design decisions, and tuning playbooks for internal teams.
  • Stay current with GPU architecture, CUDA evolution, and emerging accelerator technologies.

Required Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field.
  • Ten or more years of experience in GPU programming and performance engineering.
  • Deep expertise in CUDA C/C++ and GPU programming models.
  • Strong understanding of modern GPU architectures, memory hierarchies, and execution models.
  • Hands-on experience profiling and optimizing GPU workloads in production.
  • Familiarity with NCCL, MPI, and high-performance interconnect technologies.
  • Experience integrating custom kernels into ML frameworks.
  • Strong C++ skills and familiarity with modern systems programming practices.
  • Solid grounding in linear algebra and numerical methods.
  • Strong communication and collaboration skills with research and engineering teams.

Preferred Qualifications

  • Experience with Triton, CUTLASS, or other GPU kernel authoring frameworks.
  • Familiarity with TensorRT, FasterTransformer, or vLLM internals.
  • Exposure to compiler infrastructure such as LLVM or MLIR.
  • Open-source contributions to GPU or ML performance libraries.
  • Experience with large-scale distributed training infrastructure.

How to Apply Would you like to know more about this opportunity? For immediate consideration, please send your resume to venkat.r@bvteck.com or contact us at (908) 505-3899. Learn more about Bright Vision Technologies at www.bvteck.com. Bright Vision Technologies is an Equal Opportunity Employer.

Something wrong with this job? Report it