QA & Test Engineer jobs

Senior Software Engineer in Test

ReplicantRemote · Canada, USFull-time5+ years experience

Pay not listed

Looks real. 2 things to check before you apply.

On Replicant’s own careers site (Ashby), checked open today.

  • To check: Posted by the employer 6 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: No reposts foundAshby board
  • Trust score 75 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Define quality standards and testing strategy, and build quality into platform development from the start.
  • Build and improve automation frameworks, validation tools, AI-driven testing workflows, and CI/CD quality gates.
  • Review code and tests, mentor QA engineers, and help teams scale their quality engineering practices.
  • Use dogfooding, A/B tests, customer feedback, bug reports, metrics, and analytics to improve coverage and inform fixes and release decisions.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 5+ years in SDET or quality engineering roles
  • Significant hands-on coding, including ownership of test strategy and release quality in complex software systems
  • Experience building quality initiatives across teams and influencing engineers, product managers, and stakeholders around a shared quality bar
  • Excellent collaboration and communication skills across Engineering, Product, and customer-facing teams
  • Experience testing AI- and LLM-powered systems, including evaluating non-deterministic behavior, hallucinations, prompt or workflow regressions, and other generative product quality issues (preferred)
  • Experience in an FDE, delivery, or professional services environment, including customer-facing implementation workflows and real-world quality challenges (preferred)

Skills

  • Strong programming skills in at least one of TypeScript, JavaScript, or Python
  • Deep knowledge of automation, API and integration testing, regression strategy, and CI/CD-based quality workflows
  • Demonstrated mastery of test design, risk-based coverage, and deciding what to automate versus explore manually
  • Comfort using data, metrics, and analytics to evaluate quality and communicate trends, risk, and opportunities for improvement

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Comprehensive benefits
Paid time off
Flexible vacations, Paid sabbatical after 5 years
Equity
Equity in the company
Learning & tuition
Stipend for conferences, books, and courses
Wellness & mental health
Stipend to support physical and mental well-being
Other
Company-wide offsites and smaller team gatherings, Distributed, remote-by-design work, Competitive salaries

Full job description

From Replicant’s careers site

At Replicant, we believe AI should work for people, starting with customer service. We’re looking for a Software Development Engineer in Test (SDET) to help raise the bar for quality across our voice AI platform as we continue to scale. This person will play a key role in shaping how quality is defined, measured, and built into the product experience from the start — across platform capabilities, AI agents, customer configurations, integrations, and release workflows. This is an opportunity to help build the systems, standards, and tooling that make quality a durable advantage for both our customers and our teams.

Show full descriptionShow less

As a SDET you will partner closely with Engineering, Product, and Delivery to create a more unified and scalable approach to quality. You’ll define standards, improve testing strategy, build and evolve automation and platform-level tooling, and turn customer and product insights into better validation systems. This is a hands-on engineering role for someone who is excited to work at the intersection of software quality, automation, analytics, and AI. The right person will help us move toward a modern quality engineering practice where testing is proactive, automated wherever possible, and grounded in the realities of conversational AI.

What You'll Do

  • Act as a senior technical authority for quality engineering at Replicant; shaping how quality is built into the platform through hands-on engineering, championing a high bar across teams, and driving the practices and execution that make it real.
  • Raise the technical bar across our team of AI-enabled QA Engineers through hands-on example, code and test review, pairing, and mentorship; leveling up how a small team builds a scalable quality engineering practice.
  • Help drive Replicant's AI-native quality engineering strategy to scale coverage, accelerate validation, and surface failures earlier.
  • Build AI-driven testing workflows that let a small team deliver broad, scalable validation across the platform.
  • Own the quality feedback loop from internal dogfooding, customer A/B testing, customer feedback triage, and bug reporting, turning real-world usage into faster fixes, better test coverage, and stronger product decisions.
  • Partner with Product and Engineering early to improve testability, shape acceptance criteria, and build quality in from the start.
  • Build and improve automation frameworks, validation tooling, and CI/CD quality gates for reliable, repeatable releases.
  • Use AI and analytics to expand edge-case coverage, summarize failures, and generate insights that inform roadmap and release decisions.

What You'll Bring

  • 5+ years in SDET or quality engineering roles, with significant hands-on coding, including ownership of test strategy and release quality in complex software systems.
  • Strong programming skills in at least one modern language (TypeScript, JavaScript, or Python), with the ability to build and own production-quality tooling and frameworks.
  • An AI-native approach to quality engineering. You know how to leverage AI to move faster, increase coverage, reduce manual effort, and build smarter testing and validation workflows.
  • Curiosity about AI systems, conversational experiences, and the nuances of testing voice-driven product behavior.
  • Experience building quality initiatives across teams and influencing engineers, product managers, and stakeholders around a shared quality bar.
  • Deep knowledge of modern testing practices, including automation, API and integration testing, regression strategy, and CI/CD-based quality workflows.
  • Demonstrated mastery of test design, risk-based coverage, and what should be automated versus explored manually.
  • Comfort using data, metrics, and analytics to evaluate quality and communicate trends, risk, and opportunities for improvement.
  • Excellent collaboration and communication skills, with the ability to work effectively across Engineering, Product, and customer-facing teams.

Nice To Have

  • Experience testing AI and LLM-powered systems, including evaluating non-deterministic behavior, hallucinations, prompt or workflow regressions, and other quality issues unique to generative products.
  • Experience working in an FDE, delivery, or professional services environment, with a strong understanding of customer-facing implementation workflows and real-world quality challenges.

For all full-time employees, we offer:

🌴 In-person connection that counts: company-wide offsites and smaller team gatherings designed to make remote work feel personal

🖥️ Tech & learning stipend: Conferences, books, courses — interested? We’ll fund them

📍 Remote by design: We’re distributed — no guilt about life events, we trust you to manage your calendar

🏋️ Health & wellness: Flexible vacations, paid sabbatical after 5 years, comprehensive benefits, plus a stipend to support your physical and mental well-being

💸 Compensation that matches your impact: competitive salaries in the company you’re helping to build

📈 Equity with upside: We believe in shared ownership—You’ll own a real piece of a fast-growing AI company

Our Values

Replicant has three core values. It is critical that everyone who joins the team feels excited and moved by these values as every new team member makes an impact on our culture.

Blade Runners: We take ownership and pride to influence the outcomes of our goals. We are successful, and like a Blade Runner, use the tools at our disposal to reach our objectives. We value open and honest communication and proactively seek feedback along the way. We are a company driven to grow and achieve both individually and as a team.

Bread Makers: We are humble and strive toward an egalitarian culture. No task is too big or too small. We work together to achieve our goals and develop our company mission. We believe that the whole is greater than the sum of its parts in everything that we do.

Självdistans (Self-Distance): Självdistans is Swedish for self-distance. It's the ability to critically reflect on oneself and one's relations from an external perspective. With this in mind, we act with objectivity and always remember that we are not our work. There's no perfect science to growing a team or business, but we trust everyone at Replicant to point out our blind spots and humbly admit their own.

Replicant is proud to be an equal opportunity employer. We are committed to fostering an inclusive, diverse and equitable workplace that is built on trust, support and respect. We welcome all individuals and do not discriminate on the basis of gender identity and expression, race, ethnicity, disability, sexual orientation, colour, religion, creed, gender, national origin, age, marital status, pregnancy, sex, citizenship, education, languages spoken or veteran status. Accommodation is available upon request at any point during our recruitment process. If you require an accommodation, please speak to your talent acquisition partner or email us at talent@replicant.ai hr@replicant.ai and we’ll work to meet your needs.

Something wrong with this job? Report it · This flag looks wrong

Similar remote jobs

Senior AI Test Engineer

TestPros · Remote · US only

$50–$80/hrPart-time

StrongChecked open todayPosted 20 days ago

Senior QA Engineer

Skylight · Remote · US only

$150k–$170k/yrFull-time

StrongChecked open todayPosted 15 days ago

Principal Test Engineer

GliaCell Technologies · Remote · US only

$180k–$260k/yrFull-time

StrongChecked open todayPosted 20 days ago

See more like this