Botium

Visit Website

Introduction

Botium positions itself relative to familiar tools: Selenium is the standard for web apps, Appium for smartphone apps, and Botium for conversational AI. Like them it is free and open source.

Botium Core provides the engine, and connectors attach it to chatbots built on most major technologies, frameworks, APIs, SDKs and cloud services. Each connector ships with sample configurations and scripts. Tests are typically written as conversation scripts describing what the user says and what the bot should answer.

Note that the module sends anonymous installation information (OS, architecture, library version) unless you set BOTIUM_ANALYTICS=false.

The source code is at codeforequity-at/botium-core on GitHub under the MIT licence, with about 250 stars; the most recent commit was on 9 November 2026.

Launch and background: There’s An AI For That lists Botium in its test automation repositories.

Features

1. Conversation scripts: Define expected dialogue flows.
2. Connectors: Many chatbot platforms and APIs.
3. Samples per connector: Configs and scripts included.
4. CLI: Botium CLI for running suites.
5. Analytics opt-out: Disable with an environment variable.

Pros

1. Mature concept: Years of conversation-testing patterns.
2. Free to use: Open source under the MIT licence, so the core tool costs nothing to use.
3. Actively maintained: The repository had commits as recent as 9 November 2026.

Cons

1. Scripted focus: Less suited to free-form LLM agent behaviour.
2. Smaller community: About 250 stars.
3. Telemetry default: Opt out explicitly.

Usage and Links (Example)

1. Read the Getting Started guide and pick the connector for your chatbot platform.
2. Copy the connector’s sample configuration and point it at your bot.
3. Write conversation scripts for key dialogues and run them in CI with Botium CLI.
4. Set BOTIUM_ANALYTICS=false if you do not want installation data sent.

Resources:

• Botium website

Pricing

Botium is free and open source under the MIT licence.

Recommended for?

1. Teams with rule-based or intent-based chatbots needing regression tests.

Conclusion

Botium remains a practical open-source option for scripted chatbot regression testing.

For open-ended LLM agents, pair it with an eval framework.

On CheckOps, Botium is filed under the Integration testing and Release & CI gates stages. Related tools listed here include Promptfoo, DeepEval, Cekura, Coval, Hamming and Cucumber. When comparing them, weigh the licence, the languages and platforms each supports, whether it is self-hosted or managed, and how cleanly it slots into your existing CI pipeline. Details on this page were checked against the official website, documentation and repository on 11 November 2026.