QA & Test Engineer jobs

Staff Quality Engineer

StackAdaptRemote · US only7+ years experience

$136k–$187k/yr listed by the employer

Looks real. 1 thing to check before you apply.

On StackAdapt’s own careers site (Greenhouse), checked open today.

  • To check: Posted by the employer 4 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Own quality strategy and release readiness for AI products, from test architecture through shipping.
  • Build evaluation frameworks and automated test tooling for LLM outputs, agent behavior, safety, and functional, API, integration, UI, and regression testing.
  • Set quality metrics and benchmarks, including accuracy, latency, cost, and hallucination or failure rates, and integrate automated testing into CI/CD.
  • Partner with product, design, engineering, and ML/data science teams on requirements, priorities, and definitions of done.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 7+ years of professional, hands-on software quality and test automation experience
  • Track record of setting technical direction on complex systems
  • Deep, hands-on experience with API and UI test automation frameworks
  • Experience testing AI/agentic systems, including evals, prompt/regression testing, and output validation
  • Experience using AI to scale automation, including test generation, self-healing tests, or failure triage
  • Experience with CI/CD tools
  • In-depth understanding of QA methodologies in a software company with fast release cycles
  • Ability to own a test case management practice that others build on
  • Experience coaching and influencing cross-functional teams on tooling, testing plans, and strategies, and guiding them through execution

Skills

  • Fluency in at least one of TypeScript, JavaScript, Python, or Java
  • Strong understanding of scalable system design for web-based APIs and backend processing systems
  • Ability to define test case design standards and coverage strategy, including edge/negative, compatibility, performance, and concurrency scenarios
  • Knowledge of React, including adding data-testids
  • Ability to explore a codebase and use technical tools to understand technical implementation
  • TypeScript (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Health benefits from day one of employment
Retirement plan
Retirement, 401(k), or pension savings globally
Paid time off
Paid time off packages, including birthdays off
Parental leave
Parental leave program
Equity
Candidates may be eligible for equity awards, depending on the role
Bonus
Candidates may be eligible for annual bonuses, depending on the role
Learning & tuition
Training and onboarding program, Support for personal development initiatives, including conferences, courses, and books, Access to StackAdapt programmatic courses and certifications
Remote work stipend
Work-from-home reimbursements
Wellness & mental health
Comprehensive mental health care program
Other
Optional global WeWork membership; hubs in London and Toronto, Highly competitive salary

Full job description

From StackAdapt’s careers site

StackAdapt is the leading technology company that empowers marketers to reach, engage, and convert audiences with precision. With 465 billion automated optimizations per second, the AI-powered StackAdapt Marketing Platform seamlessly connects brand and performance marketing to drive measurable results across the entire customer journey. The most forward-thinking marketers choose StackAdapt to orchestrate high-impact campaigns across programmatic advertising and marketing channels.

Show full descriptionShow less

StackAdapt is seeking a talented Staff Quality Engineer to join the Automation and Intelligence Pillar pod, the group building StackAdapt's AI and agentic products. As the most senior quality engineer on the team, you will set the technical direction for how we test, evaluate, and ship intelligent systems, working across LLM-powered features, agentic workflows, and the data and tooling that support them. This is a hands-on, individual-contributor leadership role: you will lead the effort to design quality strategy for non-deterministic AI systems, build the frameworks and harnesses that make those systems testable, and raise the quality bar across a fast-moving, cross-functional agile environment. Your work will directly affect the success of product releases, accelerate our defect detection and prevention capabilities, and help define what quality means for AI at StackAdapt.

Learn more about our engineering culture here: https://www.youtube.com/watch?v=LXM2NrkhKZc

StackAdapt is a remote-first company; we are open to candidates located anywhere in Canada and the United States for this position.

What You'll Be Doing:

  • Own and drive the end-to-end quality strategy for the Automation and Intelligence Pillar pod's AI such as our Ivy product, from test architecture through release readiness
  • Design and build evaluation frameworks for non-deterministic systems, including LLM output quality, agent behaviour, regression detection, and guardrail/safety testing
  • Develop reliable, scalable automated test suites and tooling that address functional, system, API, integration, UI, and regression testing, and integrate them into our CI/CD pipeline
  • Establish quality metrics and benchmarks (accuracy, latency, cost, hallucination/failure rates) that give the team confidence to ship and inform data-driven decisions
  • Partner closely with Engineering Managers, Product Managers, Designers, ML/Data Science, and other engineering teams to align requirements, priorities, and definitions of done
  • Act as a technical mentor and force multiplier across the QE org, promoting QE best practices, driving process improvements, and levelling up testing for AI systems company-wide
  • Participate in technical planning, code review, and architectural decision-making, advocating for testability and reliability from the design stage
  • Provide timely, actionable test result feedback to the Automation and Intelligence Pillar pod, the QA team, and other relevant stakeholders

What You'll Bring to the Table:

  • 7+ years of professional, hands-on software quality and test automation experience, with a track record of setting technical direction on complex systems
  • Deep, hands-on experience with API & UI test automation frameworks such as Playwright, Cypress, Jest, or Junit
  • Fluency in at least one of TypeScript, JavaScript, Python, or Java with preference for TypeScript
  • Experience testing AI/agentic systems (evals, prompt/regression testing, output validation) and using AI to scale automation (test generation, self-healing tests, failure triage) with technologies such as OpenAI, Anthropic
  • Experience with CI/CD tools like Jenkins, Github Actions, or CircleCI
  • Strong understanding of scalable system design for web-based APIs and backend processing systems
  • In-depth understanding of QA methodologies in a software company with fast release cycles
  • Proven ability to define test case design standards and coverage strategy such as edge/negative, compatibility, performance and concurrency scenarios and to own a test case management practice (e.g. TestRail) that others build on
  • Knowledge of React, including but not limited to adding data-testids
  • Ability to explore a codebase and use technical tools to gain an understanding of technical implementation
  • Experience coaching and influencing cross-functional teams on tooling, testing plans and strategies, and guiding them through execution

The compensation range listed for this role reflects the expected base salary for candidates located in the posting country based on a global rate. It is informed by market data and the approved budget for this position. StackAdapt maintains different compensation ranges for roles across other countries and regions, and final offers will be aligned to the candidate’s current location. We do not ask candidates about current or prior salary history, and we will not use such information, if volunteered, in setting an offer.

This range represents base salary only. Depending on the role, candidates may also be eligible for additional compensation such as annual bonuses, commissions, equity awards, and a comprehensive benefits package.

Factors Influencing Final Compensation:

  • The final compensation offer will be determined by a variety of factors, which may include, but are not limited to: the candidate's specific experience, technical skills, knowledge, abilities, and relevant education, licensure, and certifications.
  • Other business factors, such as organizational needs and budget alignment, may also be considered in the final offer.

Canada Base Salary Band

$134,400—$184,800 CAD

USA Base Salary Band

$136,000—$187,000 USD

StackAdapter's Enjoy:

  • Highly competitive salary
  • Retirement/ 401K/ Pension Savings globally
  • Competitive Paid time off packages including birthday's off!
  • Access to a comprehensive mental health care program
  • Health benefits from day one of employment
  • Work from home reimbursements
  • Optional global WeWork membership for those who want a change from their home office and hubs in London and Toronto
  • Robust training and onboarding program
  • Coverage and support of personal development initiatives (conferences, courses, books etc)
  • Access to StackAdapt programmatic courses and certifications to support continuous learning
  • An awesome parental leave program
  • A friendly, welcoming, and supportive culture
  • Our social and team events!

Please note: Benefits and perks may vary depending on your country of employment and the nature of your engagement. In locations where StackAdapt does not have a legal entity, employment and benefits are administered in accordance with local regulations and partner policies.

StackAdapt is a diverse and inclusive team of collaborative, hardworking individuals trying to make a dent in the universe. No matter who you are, where you are from, who you love, follow in faith, disability, superpower status, ethnicity, or the gender you identify with (if you’re comfortable, let us know your pronouns), you are welcome at StackAdapt.

StackAdapt is committed to providing an inclusive and accessible recruitment process. Accommodations are available upon request for candidates taking part in all aspects of the selection process. If you require an accommodation, please let us know.

We use artificial intelligence (AI) to streamline the resume reviews of candidates and assess their fit based on the criteria outlined in the job posting. We do not use AI to make any final hiring or interview decisions.

About StackAdapt

We've been recognized for our diverse and supportive workplace, high performing campaigns, award-winning customer service, and innovation. We've been awarded:

G2 Top Software for 2026 2026 Best Workplaces™ for Young Talent and in Canada by Great Place to Work® #1 DSP on G2 and leader in a number of categories including Cross-Channel Advertising

2026 Winner in the (CTV/OTT) Product/Platform category for the 2026 ADWEEK Tech Stack Awards

#LI-REMOTE

To learn more about our privacy practices, please see our Privacy Policy.

Something wrong with this job? Report it · This flag looks wrong

Similar remote jobs

Senior QA Engineer

Skylight · Remote · US only

$150k–$170k/yrFull-time

StrongChecked open todayPosted 15 days ago

QA Engineer – Automation

Bright Vision Technologies · Remote · US only

$115k–$130k/yrFull-time

StrongChecked open todayPosted 18 days ago

See more like this