CheckOps
MCPJam Inspector
MCPJam is an open-source testing and evaluation platform for MCP servers: inspect tools and OAuth flows, test widgets for ChatGPT apps, run cross-client evals across 16 client configurations and 170+ models, and gate regressions in CI.
- Open source
- Free tier
- Paid
- Typescript
- Node
- MCP
- MCP servers for testing
- AI-enabled testing
- LLM Testing
- API & contract testing
- Integration testing
- Release & CI gates
Latest public signals
Not refreshed yet. Refresh reads the public site and, when the entry has a GitHub repository, the latest release.
Introduction
MCPJam describes itself as the open-source testing and evaluations platform for MCP server developers who ship. You can interactively test tools, prompts, resources and authorisation across 16 client configurations and more than 170 models, run evals on test cases, see what is breaking and gate regressions before deployment. It runs hosted or locally for HTTP/S and local stdio servers.
Its key insight is that ChatGPT, Claude, Cursor and other clients each read your server differently. MCPJam catches those differences, shows where your server breaks and tells you how to fix it. Cross-client evals score agent behaviour across client configurations, including ChatGPT, Claude, Cursor and Copilot, tracking accuracy, latency and tool-call performance over time.
For hands-on debugging, the inspector shows your server’s tools, resources and prompts, lets you test prompts with real LLMs and traces every JSON-RPC message and OAuth exchange, with Chat, Trace and Raw views. It supports the OpenAI Apps SDK and MCP app UIs, with a Chrome DevTools-style widget emulator: invoke a tool to render its widget, watch window.openai messages and test locale changes, CSP permissions, light and dark mode, hover and touch, and safe-area insets.
Authorisation is a frequent source of MCP bugs, and MCPJam’s OAuth debugger runs guided conformance checks with step-by-step explanations against every version of the MCP OAuth spec (2025-03-26, 2025-06-18, 2025-11-25 and the 2026-07-28 draft), supporting client pre-registration, Dynamic Client Registration and Client ID Metadata Documents.
Everything the original inspector does is covered too: tools, resources, resource templates, prompts and elicitation flows with full JSON-RPC observability. A playground supports Skills; local skills are read from your filesystem and never leave your machine. A CLI, an SDK for testing MCP servers in code and CI/CD actions let you gate every PR on model behaviour.
MCP servers are software like any other, but they have an unusual consumer: a model that reads tool names and descriptions and decides what to call. That makes two kinds of testing necessary: protocol-level checks that requests, responses, auth and errors behave correctly, and behavioural checks that real models actually choose and use the tools as intended. MCPJam is one of the few tools that tackles both halves in one place.
The source code is at MCPJam/inspector on GitHub under the Apache-2.0 (with its eval services under a separate licence) licence, with about 2,300 stars; the most recent commit was on 11 November 2026.
Cross-client differences are easy to underestimate: a tool description that works well in one client can be ignored or misused in another. Running the same eval cases across clients before release is the most direct way to find those gaps.
Its OAuth debugger alone can save days, because authorisation failures are often opaque on the client side and depend on which version of the spec each client implements.
Because it can run locally against stdio servers, MCPJam also fits early development before a server is deployed anywhere.
Features
- Interactive inspector: Tools, resources, prompts and elicitation.
- JSON-RPC tracing: Every message and OAuth exchange.
- Cross-client evals: 16 client configurations and 170+ models.
- OAuth conformance: All MCP OAuth spec versions, DCR and CIMD.
- Widget emulator: OpenAI Apps SDK and MCP app UIs.
- Skills playground: Local and hosted skills.
- CLI and SDK: Test in terminal or code.
- CI/CD actions: Gate PRs on model behaviour.
Pros
- Behavioural testing: Goes beyond protocol checks.
- Free for developers: Test servers as you build.
- Free to use: Open source under the Apache-2.0 (with its eval services under a separate licence) licence, so the core tool costs nothing to use.
- Actively maintained: The repository had commits as recent as 11 November 2026.
Cons
- Mixed licensing: Eval services under a separate licence.
- Model costs: Evals against real LLMs cost tokens.
Usage and Links (Example)
npx @mcpjam/inspector@latest
Connect a local stdio or HTTP server, run tools in the playground, then add eval test cases and the CI action to gate pull requests.
Resources:
Pricing
MCPJam’s inspector is open source and free for developers testing servers as they build; hosted team and enterprise features are paid (see mcpjam.com).
Recommended for?
- MCP server and ChatGPT app developers.
- Teams shipping MCP integrations to many clients.
Conclusion
MCPJam is the most complete MCP testing platform, covering protocol, OAuth, widgets and model behaviour.
Start locally, then add cross-client evals to CI.
On CheckOps, MCPJam Inspector is filed under the API & contract testing, Integration testing and Release & CI gates stages. Related tools listed here include Promptfoo, Playwright MCP, Chrome DevTools MCP, Postman, DeepEval and MCP Selenium. When comparing them, weigh the licence, the languages and platforms each supports, whether it is self-hosted or managed, and how cleanly it slots into your existing CI pipeline. Details on this page were checked against the official website, documentation and repository on 11 November 2026.
Alternatives
Other tools on CheckOps that cover similar ground. Open a page, or compare one with MCPJam Inspector side by side.
PPromptfooPromptfoo is an open-source CLI for LLM evals and red teaming. The community tool is free; enterprise features are quoted.Compare with MCPJam Inspector
PPlaywright MCPPlaywright MCP is Microsoft's Model Context Protocol server for browser automation, using structured accessibility snapshots.Compare with MCPJam Inspector
CChrome DevTools MCPChrome DevTools MCP is Google's Apache-2.0 MCP server and CLI that lets coding agents control and inspect a live Chrome: automation, network and console debugging, and performance traces.Compare with MCPJam Inspector
PPostmanGo faster from development to production with higher accuracy and fewer tokens.Compare with MCPJam Inspector
DDeepEvalDeepEval is an open-source LLM evaluation library with pytest-style asserts. Confident AI is the optional paid cloud from the same team.Compare with MCPJam Inspector
MMCP SeleniumMCP Selenium is an MIT-licensed MCP server for Selenium WebDriver, by Angie Jones, that lets AI agents automate Chrome, Firefox, Edge and Safari.Compare with MCPJam Inspector