Skip to main content
Testing in Agent Studio gives you three ways to validate your agent:
  • Simulation tests: automated conversations that verify your agent handles specific scenarios correctly. Author a test by describing what a caller will do and asserting how the agent should respond. Run it against any Branch or Sub-branch to catch regressions before they reach Live.
  • A/B tests: split live traffic between two versions and compare real-world performance before fully rolling out a change.
  • Wren: generate simulation test scenarios from natural language. Describe a flow and Wren authors the test cases for you, keeping them in sync as your agent changes.
Use simulation tests throughout development to catch issues early. Use A/B tests when you need real-world evidence that a change improves outcomes. Use Wren when you want to quickly scaffold test coverage without writing each case by hand.

Create simulation tests

Author scenario-based tests with assertions and system actions.

Run and review

Execute tests, inspect results, and organize with test sets.

A/B testing

Split live traffic between two versions and pick a winner.

Automate with API

Gate publishing on test results from CI.
Last modified on September 15, 2026