Skip to main content
Testing in Agent Studio gives you three ways to validate your agent:
  • Simulation tests — automated conversations that verify your agent handles specific scenarios correctly. Author a test by describing what a caller will do and asserting how the agent should respond, then run it against Draft or Sandbox to catch regressions before they reach production.
  • A/B tests — split live traffic between two versions and compare real-world performance before fully rolling out a change.
  • Studio Assistant — generate simulation test scenarios from natural language. Describe a flow and Studio Assistant authors the test cases for you, keeping them in sync as your agent changes.
Use simulation tests throughout development to catch issues early. Use A/B tests when you need real-world evidence that a change improves outcomes. Use Studio Assistant when you want to quickly scaffold test coverage without writing each case by hand.

Create simulation tests

Author scenario-based tests with assertions and system actions.

Run and review

Execute tests, inspect results, and organize with test sets.

A/B testing

Split live traffic between two versions and pick a winner.

Automate with API

Gate deployments on test results from CI.
Last modified on July 1, 2026