CheckOps home

Tools directory

C

CheckOps

Codecov

Codecov by Sentry is a code coverage reporting service that shows coverage for any language, CI and code host in pull request comments and dashboards, with flags, carryforward, test analytics for flaky tests and AI test generation.

Visit website

Latest public signals

Not refreshed yet. Refresh reads the public site and, when the entry has a GitHub repository, the latest release.

Visit Website

Introduction

Codecov is a code coverage reporting platform, now part of Sentry. Your CI uploads coverage reports produced by tools such as Coverage.py, JaCoCo, c8, Coverlet or gcovr, and Codecov shows coverage for any language, CI tool, test suite and code host (GitHub, GitLab and Bitbucket), with pull request comments, status checks and historical dashboards.

Features described on its site and pricing page include combining uploads from multiple languages into a single report, Flags to segment coverage in monorepos, and Carryforward Flags so partial CI runs keep coverage for tests that did not run on a commit. Codecov also flags flaky and failing tests automatically (test analytics), and its newer AI features can generate unit tests and review pull requests. The pricing page explains plans: Developer (best for open-source projects with unlimited uploads, or single-user teams with small private repos and up to 250 uploads per month), Team for up to 10 users and 2,500 uploads per month, and Pro, with a 14-day Pro trial. A “user” is anyone who authors a pull request on a private repository with Codecov coverage.

Features

  1. Any language and CI: Uploads from any coverage tool and CI.
  2. PR comments and checks: Coverage changes in every pull request.
  3. Flags and carryforward: Monorepo segmentation and partial runs.
  4. Test analytics: Flaky and failing tests flagged automatically.

Pros

  1. Free for open source: Developer plan with unlimited uploads for OSS.
  2. Broad integrations: GitHub, GitLab, Bitbucket and any CI.

Cons

  1. Hosted service: Coverage data is processed by a third party.
  2. Per-user pricing: Costs grow with contributors on private repos.
# .github/workflows/test.yml (excerpt)
- run: pytest --cov --cov-report=xml
- uses: codecov/codecov-action@v5
  with:
    token: ${{ secrets.CODECOV_TOKEN }}
    files: coverage.xml
    flags: backend

codecov.yml:

coverage:
  status:
    project:
      default: { target: auto, threshold: 1% }
    patch:
      default: { target: 80% }

Resources:

Pricing

Developer plan available at no cost (open source or single-user small private repos, up to 250 uploads/month for private). Team: $5 per user per month ($4 billed annually), up to 10 users. Pro: $12 per user per month. Enterprise: contact sales. 14-day Pro trial. See site for current terms.

  1. Teams wanting coverage feedback in pull requests across languages.
  2. Open-source projects, which can use the Developer plan.

Conclusion

Codecov is one of the most widely used coverage reporting services, with strong pull request integration and growing test analytics.

Alternatives

Other tools on CheckOps that cover similar ground. Open a page, or compare one with Codecov side by side.