CheckOps home

Tools directory

B

CheckOps

Buildkite Test Engine

Buildkite Test Engine is a commercial test analytics service that detects and manages flaky tests, splits tests intelligently across CI agents, and shows test performance, using collectors or JUnit XML.

Visit website

Latest public signals

Not refreshed yet. Refresh reads the public site and, when the entry has a GitHub repository, the latest release.

Visit Website

Introduction

Buildkite Test Engine ‘speeds up builds with real-time flaky test management and intelligent test splitting’, according to its product page. It also offers accountability features, customisable actions and performance insights to get more from existing CI compute.

Tests report into Test Engine through collectors for RSpec, Jest, Cypress, pytest, Swift and other frameworks, or through JUnit XML files. Flaky tests can be detected, assigned to owners and disabled; test splitting uses timing data to balance tests across parallel agents; and span timelines and annotations help diagnose slow tests. The FAQ notes it can be used with your existing test framework or runner.

Test Engine is part of the Buildkite platform but its pricing is listed separately, with a free tier.

In the quality loop it supports release gates by keeping CI test signals reliable and fast.

Features

  1. Flaky test management: Detect, assign and disable flaky tests.
  2. Test splitting: Balance tests across agents with timing data.
  3. Collectors: RSpec, Jest, Cypress, pytest, Swift and more.
  4. JUnit XML: Use with any framework that emits it.
  5. Performance insights: Find slow tests with span timelines.

Pros

  1. Faster CI: Splitting reduces wall-clock time.

Cons

  1. Per-user pricing: Costs grow with team size.
  2. Best inside Buildkite: Splitting works most naturally with Buildkite pipelines.
  1. Create a test suite in Buildkite Test Engine.
  2. Add the collector for your framework or upload JUnit XML from CI.
  3. Review flaky tests and enable test splitting for the slowest suite.

Resources:

Pricing

Free tier ($0); Pro $30 per active user/month. See site.

  1. Teams on Buildkite wanting faster, more reliable test runs.
  2. Not a fit for teams only needing a static report.

Conclusion

Buildkite Test Engine is a practical tool for flaky test control and test splitting.

On CheckOps, Buildkite Test Engine is filed under the Release & CI gates stage. Related tools listed here include Trunk Flaky Tests, BuildPulse, Currents, Develocity, CloudBees Smart Tests and Datadog. Before choosing, compare them on licence, supported languages and platforms, hosting model, and how well each fits your existing CI pipeline. Facts on this page were checked against the official website, documentation and repository on 11 November 2026; statements the vendor makes about its own product are marked as vendor claims.

Alternatives

Other tools on CheckOps that cover similar ground. Open a page, or compare one with Buildkite Test Engine side by side.