Software Engineer jobs

Member of Technical Staff, Agent Harness

HarkSan Jose +1 placeFull-time

$170k–$400k/yr listed by the employer

Above the typical $210k a year for senior Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 1,292 senior Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Key facts

Where
San Jose · San Jose, CA
Experience
5+ years

Looks real. 2 things to check before you apply.

On Hark’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 8 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: Wide pay range: top of the range is 2.35× the bottomAsk what the job pays at your level before you interview.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 80 / 100 · Looks good
See all 7 checksShow fewer
How we check

What you’ll do

  • Design and build backend services for agent orchestration, tool execution, and real-time streaming.
  • Develop failure handling, retry logic, and state management for long-running agent workflows.
  • Build foundational APIs and services, including memory retrieval and sandboxed execution.
  • Optimize for low-latency streaming and high-throughput data processing.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 5+ years of experience building mission-critical backend systems
  • Proven track record shipping APIs and infrastructure that handle real-world traffic
  • Experience integrating LLMs into backend pipelines
  • Hands-on experience with gRPC or WebSockets for high-performance streaming (preferred)
  • Prior work with vector databases, distributed caching, or custom memory management systems (preferred)
  • Experience building developer-facing APIs or SDKs (preferred)

Skills

  • Expertise in concurrency, networking protocols, and distributed systems
  • Deep understanding of horizontal scaling and day 2 operations
  • Strong experience in at least one systems-level language, such as Go, Rust, C++, or Java
  • Comfort with cloud-native architectures, container orchestration, and building secure, isolated execution sandboxes
  • Deep knowledge of Kubernetes, microservices security, or serverless execution patterns (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Hark’s careers site

About Hark

Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.

We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.

Show full descriptionShow less

To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.

About the Role

You'll build the backend systems that make Hark's AI agent actually work — reliable, fast, and production-grade.

That means the hard infrastructure problems: high-concurrency services, low-latency streaming, state management for long-running agent workflows, and the execution layer that connects model outputs to real-world actions. You are building the nervous system of an agentic product.

This is a high-ownership role on a small team. You'll work directly with model researchers and platform engineers, and the systems you build will determine whether Hark feels like a slow chatbot or something genuinely new.

Responsibilities

  • Core Runtime Architecture: Design and build the high-concurrency backend services responsible for agent orchestration, tool execution, and real-time streaming.
  • Systems Reliability: Develop robust failure-handling, retry logic, and state management for long-running agentic workflows.
  • Platform Primitives: Architect the foundational APIs and services—including memory retrieval systems and sandboxed execution environments—that power the entire Hark ecosystem.
  • Performance Engineering: Optimize the stack for low-latency streaming and high-throughput data processing to ensure seamless agent-user interactions.
  • Full-Cycle Ownership: Lead features from low-level design and prototyping to production deployment, monitoring, and performance tuning.
  • System Observability: Implement deep instrumentation and automated evaluation frameworks to track system health and model quality regressions.

Requirements

  • Backend & Systems Mastery: 5+ years of experience building mission-critical backend systems. You are an expert in concurrency, networking protocols, and distributed systems.
  • Production at Scale: Proven track record of shipping APIs and infrastructure that handle real-world traffic, with a deep understanding of horizontal scaling and "day 2" operations.
  • AI System Intuition: Experience integrating LLMs into backend pipelines. You understand the unique failure modes of non-deterministic systems and how to wrap them in deterministic, reliable code.
  • Language Proficiency: Strong experience in at least one systems-level language (e.g., Go, Rust, C++, or Java).
  • Infrastructure Mindset: Comfort with cloud-native architectures (AWS/GCP), container orchestration, and building secure, isolated execution sandboxes.
  • Technical Communication: Ability to articulate complex architectural tradeoffs and collaborate with model researchers to bridge the gap between AI and production-grade software.

Bonus Qualifications

  • Hands-on experience with gRPC, WebSockets for high-performance streaming.
  • Prior work with vector databases, distributed caching, or custom memory management systems.
  • Deep knowledge of Kubernetes, microservices security, or serverless execution patterns.
  • Experience building developer-facing APIs or SDKs.

Compensation

The US base salary range for this full-time position is between $170,000 - $400,000 annually.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components and benefits depending on the specific role. This information will be shared if an employment offer is extended.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Staff Software Engineer

LinkedIn · Mountain View, CA

$156k–$255k/yrFull-timeHybrid

StrongChecked open todayPosted 5 days ago

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

See more like this