Software Engineering jobs

Software Engineer I, Build Review & Test

HandshakeSan Francisco, CAFull-timeOn-site3+ years experiencePosted 1 month ago

$136k–$170k/yr listed by the employer

This job is closed.

The employer took it down 3 days ago, after 18 days open. Here are similar open jobs.

  • Checked: On the company's own careers siteAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 4 checksShow fewer
How we check

Similar open jobs

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

See more like this

What you’ll do

  • Build and maintain tools for builds, tests, code review, and merging changes for engineers and coding agents.
  • Improve build speed and test reliability, and investigate confusing failures to fix their underlying causes.
  • Make failures easier to understand and improve the tools, instructions, and environments coding agents use to write and debug code.
  • Develop automated code reviews and checks that reduce repetitive work while maintaining quality and safety standards.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • About 3–5 years of professional software engineering experience, or comparable hands-on experience
  • Hands-on experience with JavaScript unit testing and end-to-end tests
  • Experience shipping and maintaining production software, including writing automated tests
  • Ability to finish clearly defined projects independently and know when to ask for help or collaborate
  • Experience with build systems or continuous integration, using tools such as Buildkite, GitHub Actions, Docker, or Kubernetes (preferred)
  • Experience building or extending test frameworks and shared libraries for efficient, reliable test authoring (preferred)
  • Experience making tests faster or fixing tests that fail without a code change (preferred)
  • Hands-on use of coding agents, including giving them useful instructions and checking their results (preferred)
  • Experience with automated code review or testing, with or without AI (preferred)
  • Experience making software builds and releases reliable and secure (preferred)
  • Experience using logs, metrics, or traces to investigate problems (preferred)

Skills

  • Strong JavaScript or TypeScript skills and experience in the JavaScript ecosystem
  • A careful approach to debugging; test assumptions and follow evidence to find the cause

Other requirements

  • A high bar for user experience, including listening to users and attending to usability details

Benefits

Health insurance
Medical coverage and mental health support
Dental & vision
Dental and vision coverage
Retirement plan
401(k) match
Paid time off
Flexible PTO, 15 holidays, and 2 flex days
Parental leave
Paid parental leave, fertility benefits, and parental coaching
Equity
Equity in a fast-growing company
Bonus
Referral bonuses
Learning & tuition
$2,000 learning stipend and ongoing development
Remote work stipend
Internet support
Wellness & mental health
$500 wellness stipend
Commuter benefits
Commuting support; free lunch and gym in the San Francisco office
Other
Competitive compensation and financial coaching, Team outings

Full job description

From Handshake’s careers site

ABOUT HANDSHAKE

Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.

In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.

Why join Handshake now:

Show full descriptionShow less
  • Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
  • Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
  • Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders
  • Build a massive, fast-growing business with billions in revenue

About Handshake AI

Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.

THE ROLE

We’re looking for a Software Engineer to make development at Handshake faster, more reliable, and easier to understand.

Coding agents are a core part of how our engineers work. Both need reliable tools, useful instructions, and clear feedback to produce code we can trust. You’ll build and improve tools that run builds and tests, review changes, and explain failures. Your work will help engineers and agents spend less time waiting or debugging and more time building.

You’ll care as much about how a tool feels to use as whether it works. Is it fast? Are the next steps clear? Does an error message help someone solve the problem? You’ll use developer surveys, conversations with engineers, and system data to guide improvements.

You don’t need a background in developer tools or AI. We’re looking for strong coding skills, curiosity, and a desire to make complex systems easier to use.

WHAT YOU’LL DO

  • Build and maintain tools for builds, tests, code review, and merging changes. Make them useful for both engineers and coding agents.
  • Find and fix slow builds, unreliable tests, and confusing errors. Address the cause rather than asking users to work around the problem.
  • Make tests faster and more reliable. Split work across machines, reuse previous results when safe, and keep tests from interfering with one another.
  • Make failures easier to understand. Help users see what went wrong and what they can do next.
  • Improve the tools, instructions, and environments that coding agents use to write, test, and debug code.
  • Help build automated code reviews and checks. Reduce repetitive work while keeping clear standards for quality and safety.
  • Use developer surveys and direct feedback to find problems worth solving. Work with teammates to release improvements safely, then check whether they made a difference.
  • Share what you learn through documentation, code reviews, and working sessions with other engineers.

YOU HAVE

  • About 3–5 years of professional software engineering experience, or comparable hands-on experience.
  • Strong JavaScript or TypeScript skills and experience in the JavaScript ecosystem. Your background may be server-side, such as Node.js or Bun, or browser-based.
  • Hands-on experience with JavaScript unit testing and end to end tests with tools like Jest, Vitest and Playwright.
  • Experience shipping and maintaining production software, including writing automated tests.
  • A careful approach to debugging. You test your assumptions and follow the evidence to find the cause.
  • Curiosity about unfamiliar code and the patience to learn how a system works.
  • A high bar for user experience. You notice small frustrations, listen to users, and care about the details that make tools easy to use.
  • The ability to finish clearly defined projects on your own. You also know when to ask for help or work through a problem with a teammate.
  • Clear communication and a willingness to give feedback, learn from others, and share what you know.

EXTRA CREDIT

You don’t need to know every tool we use. Any of the following would be helpful:

  • Work on build systems or continuous integration (CI), using tools such as Buildkite, GitHub Actions, Docker, or Kubernetes.
  • Experience building or extending test frameworks and shared libraries that make authoring tests more efficient and reliable.
  • Experience making tests faster or fixing tests that fail without a code change.
  • Hands-on use of coding agents, including giving them useful instructions and checking their results.
  • Work on automated code review or testing, with or without AI.
  • Experience making software builds and releases reliable and secure.
  • Use of logs, metrics, or traces to investigate problems.

PERKS

Handshake delivers benefits that help you feel supported—and thrive at work and in life.

The below benefits are for full-time US employees.

🎯 Ownership: Equity in a fast-growing company

💰 Financial Wellness: 401(k) match, competitive compensation, financial coaching

🍼 Family Support: Paid parental leave, fertility benefits, parental coaching

💝 Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend

📚 Growth: $2,000 learning stipend, ongoing development

💻 Remote & Office: Internet, commuting, and free lunch/gym in our SF office

🏝 Time Off: Flexible PTO, 15 holidays + 2 flex days

🤝 Connection: Team outings & referral bonuses

Explore our mission, values, and comprehensive US benefits at joinhandshake.com/careers http://joinhandshake.com/careers.

Something wrong with this job? Report it · This flag looks wrong