Skip to main content
For a hands-on intro, see Environments tutorial. For technical reference, see Environments and versions.
Track changes, test safely, and rollback when needed.

Quick reference

I need to…ActionTime estimate
Publish a new versionClick Publish → Add description2 min
Promote to Pre-releaseSelect version → Promote → Pre-release2 min
Promote to LiveSelect version → Promote → Live2 min
Rollback to previous versionFind old version → Promote to Live3 min
Compare two versionsSelect versions → Compare5 min
View version historyDeployments > Environments2 min
Test a versionAgent Chat → Select environment5 min

Understanding environments and versions

The three environments

PolyAI uses a three-tier deployment model:
  1. Sandbox - Development and testing environment
    • Make changes freely
    • Test without affecting users
    • No real customer traffic
  2. Pre-release - User Acceptance Testing (UAT) environment
    • Validate changes before production
    • Test with select users or internal team
    • Mirrors Live configuration
  3. Live - Production environment
    • Serves real customer traffic
    • Requires careful change management
    • Should always be stable

How versions work

  • Versions are immutable - Once published, they can’t be changed
  • Each environment has one active version - Sandbox, Pre-release, and Live each run a specific version
  • Versions flow upward - Sandbox → Pre-release → Live
  • You can skip environments - Promote directly from Sandbox to Live (not recommended)
  • Rollback is just promotion - Promote an older version to go back

Publishing a new version

When to publish

Publish a new version when you’ve made changes in Sandbox and want to:
  • Test in a clean environment
  • Prepare for promotion to Pre-release or Live
  • Create a checkpoint before major changes
  • Document a set of related updates

How to publish

  1. Make your changes in Sandbox
  2. Test thoroughly in Agent Chat
  3. Click Publish in the top right
  4. Add a version description:
    • Summarize what changed
    • Note any breaking changes
    • Reference ticket numbers if applicable
  5. Click Publish
Example descriptions:
  • “Added Spanish language support with new voice”
  • “Fixed booking function timeout issue”
  • “Updated business hours for holiday season”
  • “Added 50 new FAQ topics from customer feedback”
Use clear, descriptive version descriptions. You’ll thank yourself later when comparing versions or rolling back.

What gets included in a version

A published version includes:
  • All Managed Topics
  • Connected knowledge source configurations (not the content itself)
  • Functions and their code
  • Agent settings (about, model, rules)
  • Response Controls
  • Routing and handoff rules
  • API integrations
  • Test Cases and Test Sets
Connected knowledge content is synced separately. Sync sources before publishing to ensure the latest content is available.

Promoting versions

Promoting to Pre-release

Use Pre-release for UAT before going live:
  1. Go to Deployments > Environments in the sidebar
  2. Click the Options Menu next to the desired version
  3. Select Promote to Pre-release
  4. Confirm
When to use Pre-release:
  • Testing with internal team
  • Validating with select customers
  • Final checks before production
  • Compliance or security review

Promoting to Live

Promote to Live when you’re confident the version is ready:
  1. Go to the Pre-release tab in Deployments > Environments
  2. Click the options menu next to the version
  3. Select Promote to Live
  4. Confirm your selection by checking the box and clicking Promote
Promoting to Live affects real customers immediately. Always test in Pre-release first.

Skipping environments

You can promote directly from Sandbox to Live, but this is not recommended:
  • Risk: Untested changes go straight to production
  • Use only for: Emergency hotfixes or trivial changes
  • Best practice: Always test in Pre-release first

Comparing versions

Why compare versions

Comparing versions helps you:
  • Understand what changed between versions
  • Identify the cause of issues
  • Decide whether to promote or rollback
  • Document changes for stakeholders

How to compare

  1. Go to Deployments > Environments
  2. Select two versions to compare
  3. Click Compare
  4. Review the diff:
    • Green - Additions (new entries)
    • Red - Deletions (removed entries)
    • Blue - Edits (modified entries)

What you can compare

  • Managed Topics (questions and answers)
  • Function code
  • Agent settings
  • Response Controls
  • Routing rules
  • Connected knowledge configurations
The comparison shows configuration changes, not Connected knowledge content changes.

Rolling back

When to rollback

Rollback to a previous version when:
  • New version has critical bugs
  • Performance degrades significantly
  • Customer complaints spike
  • Functions fail unexpectedly
  • You need to buy time to fix an issue

How to rollback

  1. Go to Deployments > Environments
  2. Find the last known good version
  3. Click the options menu and select Promote to Live (or Pre-release)
  4. Confirm
The version is now active again.
Rollback is just promoting an older version. There’s no special “rollback” button.

Rollback best practices

  • Act quickly - Don’t let bad versions run longer than necessary
  • Communicate - Notify your team and stakeholders
  • Investigate - Understand what went wrong
  • Fix forward - After rolling back, fix the issue and re-promote
  • Document - Record what happened and how you fixed it

Emergency rollback procedure

For critical production issues:
  1. Identify the issue - Confirm it’s version-related
  2. Find last good version - Check Environments & Versions
  3. Promote immediately - Don’t wait for scheduled time
  4. Notify team - Alert stakeholders
  5. Monitor - Verify the rollback fixed the issue
  6. Post-mortem - Analyze what went wrong
Time to rollback: 2-5 minutes

Version management workflows

Standard deployment workflow

  1. Develop in Sandbox
    • Make changes
    • Test in Agent Chat
    • Run Test Sets
    • Iterate until satisfied
  2. Publish version
    • Add descriptive version description
    • Document changes
  3. Promote to Pre-release
    • Test with internal team
    • Run full Test Sets
    • Validate with select customers
    • Monitor for issues
  4. Promote to Live
    • Schedule for off-peak hours
    • Monitor closely after promotion
    • Be ready to rollback if needed
Total time: 1-3 days depending on testing needs

Hotfix workflow

For urgent fixes:
  1. Identify the issue in Live
  2. Reproduce in Sandbox
  3. Fix the issue
  4. Test quickly but thoroughly
  5. Publish version
  6. Promote to Pre-release (brief testing)
  7. Promote to Live immediately
  8. Monitor closely
Total time: 30 minutes to 2 hours

Feature release workflow

For major new features:
  1. Develop in Sandbox over multiple sessions
  2. Publish checkpoint versions as you go
  3. Test extensively with Test Sets
  4. Promote to Pre-release
  5. UAT with stakeholders (1-2 weeks)
  6. Gather feedback and iterate
  7. Promote to Live when approved
  8. Monitor and optimize
Total time: 2-4 weeks

Seasonal update workflow

For recurring seasonal changes (e.g., holiday hours):
  1. Find last year’s version in history
  2. Review what changed
  3. Apply similar changes in Sandbox
  4. Update dates and details
  5. Test and publish
  6. Promote to Pre-release (brief testing)
  7. Schedule promotion to Live for the right date
  8. Revert after season ends
Total time: 1-2 hours

Best practices

Version descriptions

  • Be specific - “Fixed booking timeout” not “Bug fix”
  • Include context - Reference ticket numbers or customer reports
  • Note breaking changes - Warn about incompatibilities
  • Use consistent format - Establish a team standard
Good examples:
  • “TICKET-123: Added Spanish support with ElevenLabs voice”
  • “Hotfix: Fixed payment API authentication error”
  • “Feature: New loyalty program integration with 20 FAQs”
  • “Seasonal: Updated holiday hours for Dec 2025”

Testing before promotion

  • Run Test Sets - Automated regression testing
  • Manual testing - Try realistic scenarios
  • Edge cases - Test unusual inputs
  • Performance - Check latency and quality
  • Integrations - Verify external APIs work

Monitoring after promotion

  • First 30 minutes - Watch closely for immediate issues
  • First 24 hours - Monitor key metrics
  • First week - Track trends and patterns
  • Be ready to rollback - Have the process ready

Version hygiene

  • Publish regularly - Don’t accumulate too many changes
  • Clean up old versions - Archive or delete very old versions
  • Document major versions - Keep notes on significant releases
  • Use semantic versioning - Consider v1.0, v1.1, v2.0 naming

Troubleshooting version issues

Version won’t promote

Possible causes:
  • Validation errors
  • Missing required fields
  • Conflicting configurations
Solutions:
  1. Check error messages
  2. Review version configuration
  3. Fix issues in Sandbox
  4. Publish new version
  5. Try promoting again

Changes not appearing after promotion

Possible causes:
  • Wrong environment selected
  • Caching issues
  • Version didn’t fully deploy
Solutions:
  1. Verify correct environment in Agent Chat
  2. Refresh the page
  3. Check Environments & Versions for active version
  4. Wait a few minutes for propagation
  5. Contact support if persists

Can’t find a specific version

Possible causes:
  • Version was deleted
  • Looking in wrong project
  • Version was never published
Solutions:
  1. Check version history
  2. Verify project selection
  3. Search by description or date
  4. Check with team members

Rollback didn’t fix the issue

Possible causes:
  • Issue is not version-related
  • External dependency problem
  • Data issue (not configuration)
Solutions:
  1. Compare current and previous versions
  2. Check external APIs and integrations
  3. Review Connected knowledge content
  4. Check for infrastructure issues
  5. Investigate non-version factors

Advanced version management

Using variants with versions

Variants allow different configurations within the same version:
  • Location-specific - Different menus per restaurant
  • A/B testing - Test different approaches
  • Customer segments - Different experiences per user type
Variants are included in versions, so promoting a version promotes all its variants.

Version tagging

While not a built-in feature, you can use version descriptions for tagging:
  • [HOTFIX] - Emergency fixes
  • [FEATURE] - New capabilities
  • [BUGFIX] - Non-urgent fixes
  • [SEASONAL] - Temporary changes
  • [EXPERIMENT] - A/B tests

Version branching strategies

For complex projects, consider:
  • Main branch - Stable, production-ready versions
  • Development branch - Active development
  • Hotfix branch - Emergency fixes
Coordinate with your team on which Sandbox instances to use for each branch.