CheckOps
Pa11y CI
Pa11y CI is an LGPL-3.0 accessibility test runner built on Pa11y for continuous integration, testing lists of URLs or entire sitemaps against WCAG and failing builds on issues.
- Accessibility Testing
- Web Testing
- Open source
- Free
- Command Line
- Node
- CI
- End-to-end & functional
- Accessibility
- Release & CI gates
Latest public signals
Not refreshed yet. Refresh reads the public site and, when the entry has a GitHub repository, the latest release.
Introduction
Pa11y CI is an accessibility test runner built using Pa11y and designed to run in continuous integration environments. Its README explains that automated testing can help prevent accessibility issues reaching production, and that you can test a list of URLs or a sitemap and report on the issues found. It requires a supported Node.js LTS version.
Configuration lives in a .pa11yci JSON file with defaults (standard such as WCAG2AA, timeouts, viewport, runners and ignore rules) and a list of urls, each of which can include actions such as clicking elements or filling forms before testing, or custom headers for authentication. Command-line options include --sitemap to test every URL in a sitemap, --sitemap-find/--sitemap-replace to rewrite production URLs to a staging host, --sitemap-exclude, --threshold to allow a number of errors per page before failing, concurrency settings and JSON or CLI reporters. Because Pa11y supports both the HTML_CodeSniffer and axe runners, Pa11y CI can use either or both engines. Version 5.0.0 was released on 5 October 2026.
The source code is at pa11y/pa11y-ci on GitHub under the LGPL-3.0 licence, with about 647 stars; the most recent commit was on 1 November 2026.
Features
- CI-first: Exit codes and reporters built for pipelines.
- Sitemap testing: Test every page listed in a sitemap.
- Page actions: Interact with pages before testing.
- Two engines: HTML_CodeSniffer and axe runners via Pa11y.
Pros
- Free to use: Open source under the LGPL-3.0 licence, so the core tool costs nothing to use.
- Actively maintained: The repository had commits as recent as 1 November 2026.
Cons
- Automated checks only: Cannot replace manual and assistive-technology testing.
- Headless browser needs: Requires a working headless Chrome in CI.
Usage and Links (Example)
npm install --save-dev pa11y-ci
npx pa11y-ci --sitemap https://example.com/sitemap.xml --sitemap-find example.com --sitemap-replace staging.example.com
.pa11yci:
{
"defaults": { "standard": "WCAG2AA", "runners": ["axe", "htmlcs"], "timeout": 30000 },
"urls": [
"http://localhost:3000/",
{ "url": "http://localhost:3000/login", "actions": ["set field #email to ana@example.com"] }
]
}
Resources:
Pricing
Pa11y CI is free and open source under the LGPL-3.0 licence.
Recommended for?
- Teams adding an accessibility gate to CI across many pages.
- Sites with sitemaps wanting broad automated coverage.
Conclusion
Pa11y CI is a simple, effective way to run automated accessibility checks across a whole site in CI.
Compare
CheckOps pages that put Pa11y CI next to related tools. There is no paid placement on these lists.
Alternatives
Other tools on CheckOps that cover similar ground. Open a page, or compare one with Pa11y CI side by side.
PPa11yPa11y is a free, open-source command-line accessibility checker. It opens a URL in a headless browser and reports rule failures.Compare with Pa11y CI
Aaxe-coreaxe-core is Deque's open-source accessibility rules engine. It checks rendered HTML and reports WCAG violations as JSON.Compare with Pa11y CI
LLighthouseAutomated auditing, performance metrics, and best practices for the web.Compare with Pa11y CI
IIBM Equal Access Accessibility CheckerIBM's Equal Access Accessibility Checker is an Apache-2.0 toolkit of browser extensions and Node packages (accessibility-checker, cypress-accessibility-checker) for automated accessibility testing with baselines and configurable policies.Compare with Pa11y CI
Ccypress-axecypress-axe is an MIT-licensed set of custom Cypress commands that inject axe-core into the page under test and check for accessibility violations with cy.checkA11y.Compare with Pa11y CI
AAccessibility InsightsAccessibility Insights is Microsoft's free, open-source (MIT) accessibility testing suite: a Chrome and Edge extension with FastPass and a WCAG 2.1 AA Assessment, plus a Windows app for UI Automation inspection.Compare with Pa11y CI