Software Engineer jobs

CUDA Kernel Engineer (Remote US)

Pragmatike (agency)Cambridge +2 placesFull-timeOn-siteCambridge · San Francisco, CA · CA, US · on-site

Pay not listed

This job is closed.

The employer took it down 18 days ago, after 2 days open. Here are similar open jobs.

  • To check: Posted by the employer 6 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listed, though one is likely required in CAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteAshby board
  • Checked: No reposts foundAshby board
  • Trust score 70 / 100 · Looks good
See all 5 checksShow fewer
How we check

Similar open jobs

Software Engineer

talentpluto · San Francisco, CA

$180k–$220k/yrFull-timeOn-site

StrongChecked open todayPosted yesterday

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

Senior Platform Engineer

Arta Finance · Bay Area, CA

$110k–$205k/yrFull-timeHybrid

StrongChecked open todayPosted 2 days ago

Software Engineer, Product

Ambrook · New York, NY +2 places

$115k–$260k/yr · see postingFull-timeHybrid

Wide pay rangeChecked open todayPosted 4 days ago

See more like this

What you’ll do

  • Design, implement, and optimize custom CUDA kernels for NVIDIA GPUs.
  • Profile GPU workloads and diagnose performance bottlenecks, including warp divergence, memory access, register pressure, and PCIe transfers.
  • Improve GPU memory pipelines and memory coalescing.
  • Collaborate with AI systems, model acceleration, and backend distributed systems teams.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Proven track record building NVIDIA CUDA kernels from scratch, not just calling existing libraries
  • Experience diagnosing PCIe bottlenecks and optimizing host-device transfers using pinned memory, streams, batching, and overlap
  • Experience with multi-GPU or distributed GPU systems, including NCCL, NVLink, or MIG (preferred)
  • Background in GPU acceleration for ML frameworks or HPC workloads (preferred)
  • Exposure to compiler-level optimization or PTX/SASS analysis (preferred)
  • Startup experience or comfort working in fast-moving, ambiguous environments (preferred)

Skills

  • English
  • Strong ability to optimize kernels, including tiling strategies, occupancy tuning, shared memory design, and warp scheduling
  • Deep understanding of CUDA threads, warps, blocks, and grids; GPU memory hierarchy and memory coalescing; and warp divergence
  • Familiarity with C++, CUDA runtime APIs, and GPU debugging and profiling tools
  • Knowledge of model inference optimization, including TensorRT, CUDA Graphs, or CUTLASS (preferred)

Benefits

Dental & vision
Dental and vision coverage
Retirement plan
401(k)
Equity
Equity options
Bonus
Sign-on bonus

Also: health insurance

Full job description

From Pragmatike’s careers site

Location: SF on-site Start date: ASAP Languages: English (required)

About the Role

Pragmatike is hiring on behalf of a fast-growing AI startup recognized as a Top 10 GenAI company by GTM Capital, founded by MIT CSAIL researchers.

We are searching for a CUDA Kernel Engineer who has hands-on experience developing and optimizing NVIDIA CUDA kernels from scratch. You will work on the GPU performance layer powering large-scale, high-throughput AI systems used by Fortune 500 customers.

Show full descriptionShow less

This role is ideal for someone who deeply understands NVIDIA GPU architecture, memory hierarchy, warp-level execution, and profiling workflowsnot someone coming from generic hardware, FPGA, or non-NVIDIA compute backgrounds. You will directly influence the GPU efficiency, throughput, and scalability of mission-critical AI systems.

What Youll Do

  • Design, implement, and optimize custom CUDA kernels for NVIDIA GPUs, with a focus on maximizing occupancy, memory throughput, and warp efficiency.
  • Profile GPU workloads using tools such as Nsight Compute, Nsight Systems, nvprof, and CUDA‐MEMCHECK.
  • Analyze and eliminate performance bottlenecks including warp divergence, uncoalesced memory access, register pressure, and PCIe transfer overhead.
  • Improve GPU memory pipelines (global, shared, L2, texture memory) and ensure proper memory coalescing.
  • Collaborate closely with AI systems, model acceleration, and backend distributed systems teams.
  • Contribute to GPU architecture decisions, kernel libraries, and internal performance-engineering best practices.

What Were Looking For

  • Proven track record building NVIDIA CUDA kernels from scratchnot just calling existing libraries.
  • Strong ability to optimize kernels (tiling strategies, occupancy tuning, shared memory design, warp scheduling).
  • Deep understanding of CUDA threads, warps, blocks, and grids, GPU memory hierarchy and memory coalescing, as well as warp divergence (how to detect, analyze, and mitigate it)
  • Experience diagnosing PCIe bottlenecks and optimizing host-device transfers (pinned memory, streams, batching, overlap).
  • Familiarity with C++, CUDA runtime APIs, and GPU debugging/profiling tooling.

Bonus Points

  • Experience with multi-GPU or distributed GPU systems (NCCL, NVLink, MIG).
  • Background in GPU acceleration for ML frameworks or HPC workloads.
  • Knowledge of model inference optimization (TensorRT, CUDA Graphs, CUTLASS).
  • Exposure to compiler-level optimization or PTX/SASS analysis.
  • Startup experience or comfort working in fast-moving, ambiguous environments.

Why This Role Will Pivot Your Career

  • Research pedigree: MIT CSAIL founders recognized for breakthrough AI and systems contributions.
  • Customer impact: Deploy AI solutions powering Fortune 500 clients.
  • Industry momentum: Lab alumni have led high-value acquisitions (MosaicML Databricks, Run:AI Nvidia, W&B CoreWeave).
  • Funding & growth: Oversubscribed seed round, next funding in 2026.
  • Career growth & influence: Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale.
  • Culture & autonomy: Own critical systems while collaborating with world-class engineers.
  • Aspirational impact: Solve GPU/AI performance challenges few engineers ever face.

Benefits

  • Competitive salary & equity options
  • Sign-on bonus
  • Health, Dental, and Vision
  • 401k

Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.

Something wrong with this job? Report it · This flag looks wrong