CheckOps home

Tools directory

R

CheckOps

Replay QA

Replay QA is an autonomous testing service from Replay.io that explores each build in an instrumented Chromium browser, writes and runs its own tests, and returns bugs with a deterministic recording, root cause and suggested fix.

Visit website

Latest public signals

Not refreshed yet. Refresh reads the public site and, when the entry has a GitHub repository, the latest release.

Visit Website

Introduction

Replay QA is an autonomous QA product from Replay.io, the company known for its time-travel debugging browser. It opens your app in a real browser, discovers its user journeys (including ones nobody specified), writes and runs its own tests against them, and reports what is broken.

What sets it apart is the recording layer. Every run happens in Replay’s instrumented Chromium browser and is captured as a deterministic recording of the whole runtime. When something fails, the report includes the recording, a root cause and a suggested fix, so an engineer can step through exactly what happened instead of trying to reproduce it.

The examples on the site show the kind of bugs this approach is good at: race conditions where search results for a previous keystroke overwrite the current ones, a checkout that charges the pre-discount total only when a promo is applied after the page loads, React hydration mismatches, a brief flash of wrong content during sync, swallowed errors caused by mutating frozen Redux state, and duplicate network requests visible only on the network timeline. These are failures that rarely reach the console and are hard to catch with scripted tests.

Replay frames the product for teams whose pull request volume, much of it written by coding agents, has outgrown manual review. Static analysis passes on code it never runs; Replay QA’s argument is that the app has to be exercised to find runtime bugs.

Replay also maintains open-source recording plugins for Playwright and Cypress (beta) and Puppeteer (experimental) in its replay-cli repository, which let existing test suites produce Replay recordings.

Replay’s recordings are most valuable when a bug is hard to reproduce: an intermittent CI failure, a race condition or a user report with few details. Capturing the run once means anyone, or any agent, can step through it later without trying to recreate the conditions.

When evaluating it, pick two or three of your flakiest tests and record their failures. If the recordings let engineers find root causes faster than logs and screenshots did, the tool is earning its place; if not, a lighter trace viewer may be enough.

Recordings also help onboarding, since new engineers can watch real failing runs.

Launch and background: There’s An AI For That lists Replay QA in its app testing category.

Features

  1. Autonomous exploration: Discovers user journeys without a predefined test suite.
  2. Self-written tests: Generates and runs its own tests for those journeys.
  3. Deterministic recordings: Captures the full runtime of each run for replay.
  4. Root-cause reports: Each bug comes with a cause, suggested fix and the recording.
  5. Hard-bug coverage: Races, sub-second glitches, hydration mismatches and swallowed errors.
  6. Network forensics: Shows redundant or wrong requests on a timeline.
  7. Security and accessibility: The site says it also tests for security flaws and accessibility failures.
  8. Test-runner plugins: Playwright and Cypress (beta) and Puppeteer (experimental) recording plugins.

Pros

  1. Evidence over screenshots: Recordings make bugs reproducible for developers.
  2. Finds timing bugs: Good at failures that scripted tests and logs miss.
  3. Free tier: Start without a card.

Cons

  1. Chromium only: Runs in Replay’s instrumented Chromium browser.
  2. Credit-based: Usage is metered in credits.
  3. Not a test suite you own: Findings come from its exploration rather than tests in your repo.
  4. Newer product: Replay QA is a recent addition to Replay’s platform.
  1. Sign up on replay.io and connect your app’s URL or preview deployments.
  2. Let Replay QA explore a build and review the journeys it discovered.
  3. Open a reported bug, play the recording and read the root-cause notes.

To record your own Playwright tests:

npm install --save-dev @replayio/playwright

Resources:

Pricing

Replay’s pricing page lists a free plan with 25 credits a month and no card required, paid plans billed monthly or annually, and higher tiers that start at $1,000+ and $5,000+ a month through sales. Check the pricing page for current credit allowances.

  1. Teams shipping many AI-written PRs who need runtime verification.
  2. Front-end teams chasing race conditions and flaky UI bugs.
  3. Engineering managers who want reproducible evidence attached to bug reports.

Conclusion

Replay QA combines autonomous exploration with Replay’s deterministic recordings, which makes its bug reports unusually actionable.

It fits best as an extra layer of runtime checking on top of your own end-to-end suite.

On CheckOps, Replay QA is filed under the End-to-end & functional and Release & CI gates stages. Related tools listed here include Meticulous, QA Wolf, Momentic, QA.tech, Bug0 and TestSprite. When comparing them, weigh the licence, the languages and platforms each supports, whether it is self-hosted or managed, and how cleanly it slots into your existing CI pipeline. Details on this page were checked against the official website, documentation and repository on 11 November 2026.

Compare

CheckOps pages that put Replay QA next to related tools. There is no paid placement on these lists.

Alternatives

Other tools on CheckOps that cover similar ground. Open a page, or compare one with Replay QA side by side.