Systems Administrator jobs

GPU Cluster Engineer, Hardware Operations

SciforiumSan Jose, CA +1 placeFull-timeOn-site

$150k–$180k/yr listed by the employer

Above the typical $116k a year for mid-level Systems Administrator jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 34 mid-level Systems Administrator jobs in California that list pay, from the employers' own postings. About means within 5%.

Key facts

Where
San Jose, CA · San Francisco, CA · on-site
Experience
3+ years

Looks real. 1 thing to check before you apply.

On Sciforium’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 4 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 90 / 100 · Strong
See all 6 checksShow fewer
How we check

What you’ll do

  • Respond to physical system outages, hardware failures, and network interruptions, and monitor GPU thermals, power draw, and system loads.
  • Coordinate with data center staff and hardware vendors on RMAs, repairs, replacements, and maintenance.
  • Rack, cable, and bring up GPU nodes, integrating power and network connectivity.
  • Install, patch, and maintain Linux on bare-metal cluster servers, and manage networking security and SSH access.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3+ years of experience in Linux Systems Administration
  • Strong background in server hardware troubleshooting within high-density environments, including power, cooling, and PCIe topologies
  • Experience managing networking security and directory services
  • Experience using Ansible, SaltStack, or Terraform for OS provisioning (preferred)
  • Familiarity with data center operations and cooling requirements for high-TDP accelerators (preferred)

Skills

  • Deep knowledge of boot processes, systemd, and disk management
  • Proficiency in Bash scripting for system automation
  • Familiarity with NVIDIA B200 or AMD MI355x accelerators (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Medical insurance
Dental & vision
Dental and vision insurance
Retirement plan
401(k) plan
Paid time off
Flexible time off
Meals
Daily lunch, snacks, and beverages

Also: equity

Full job description

From Sciforium’s careers site

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

Role Overview

Show full descriptionShow less

We are looking for a dedicated Hardware Operations Engineer to own the physical health and foundational infrastructure of our GPU clusters. You will be the primary custodian of our compute hardware, responsible for everything from data center vendor coordination up to the base Linux OS layer. You will ensure our research and product teams have a stable, secure, and fully operational physical environment to run their demanding compute workloads on.

Key Responsibilities

  • System Health & Hardware Reliability
  • On-Call Response: Serve as the primary point of contact for physical system outages, hardware failures, and network interruptions to minimize downtime.
  • Cluster Monitoring: Proactively monitor hardware health, including GPU thermals, power draw, and physical system loads, catching anomalies before they impact active workloads.
  • Vendor Liaison: Work closely with data center facility staff and third-party hardware vendors to coordinate RMA processes, physical repairs, part replacements, and routine maintenance.
  • Hardware Deployment: Rack, cable, and lead the physical bring-up of new GPU nodes, ensuring power and network connectivity are fully integrated into the existing cluster.
  • Linux & Network Administration
  • OS Management: Install, patch, and maintain Linux operating systems (Ubuntu/CentOS/RHEL) across the cluster bare-metal servers.
  • Security & Access: Configure and maintain edge and internal networking, including firewalls, VPNs, and strict SSH access controls to secure our infrastructure.
  • Identity & Storage Management: Administer LDAP/Active Directory for centralized user authentication and ensure network storage systems (NFS/GPFS/Lustre) are reliably mounted and properly permissioned.

Qualifications

  • Must-Haves:
  • 3+ years of experience in Linux Systems Administration (deep knowledge of boot processes, systemd, disk management, etc.).
  • Strong background in server hardware troubleshooting, specifically within high-density environments (power, cooling, PCIe topologies).
  • Experience managing networking security (VPNs, iptables/firewalld, VLANs) and directory services (LDAP/FreeIPA/Active Directory).
  • Proficiency in Bash scripting for essential system automation.
  • Nice-to-Haves:
  • Experience using configuration management tools like Ansible, SaltStack, or Terraform for OS provisioning.
  • Familiarity with data center operations, cooling requirements for high-TDP accelerators (like NVIDIA B200 or AMD MI355x).

BENEFITS INCLUDE

  • Medical, dental, and vision insurance
  • 401k plan
  • Daily lunch, snacks, and beverages
  • Flexible time off
  • Competitive salary and equity

EQUAL OPPORTUNITY

Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

IT Systems Engineer

M9 Solutions (agency) · Sunnyvale, CA

$100k–$190k/yrFull-timeOn-site

StrongOpen 2 monthsChecked open todayPosted 2 months ago

IT Operations Lead

Mind Robotics · Palo Alto, CA

Pay not listedFull-timeOn-site

Looks good2 to checkChecked open todayPosted 2 months ago

System Administrator

Foxconn Industrial Internet - FII · San Jose, CA

Full-timeOn-site

Looks goodPay not listedChecked open todayPosted 20 days ago

Senior System Administrator

Foxconn Industrial Internet - FII · Sunnyvale, CA

$100k/yrFull-time

StrongChecked open todayPosted 20 days ago

See more like this