Maintain
QA and analytics
How to track performance and review conversations after your agent is live.
PolyAI gives you two main tools to access and review your conversations:
- Dashboards – high-level metrics and trends
- Conversation review – transcript-level inspection and tagging
This page shows the quickest way to use both.
Pick the right dashboard
Use case | Go here |
---|---|
Daily health check (calls, containment, AHT) | Standard dashboard |
Risk or policy compliance | Safety dashboard |
Anything bespoke (e.g. bookings, revenue) | Custom dashboards – ask your CSM if you don’t see one |
Dashboards default to Production and last 7 days. Change the environment or date range at the top-right.
Example workflow: did my FAQ edit improve containment?
- Open the Standard dashboard.
- Set the date range:
- From = the day you promoted the change
- To = today
- Check Containment rate.
- If it went up → good sign
- If it dropped or stayed flat, drill down to conversations (next section)
Review conversations
- Go to Analyze → Conversations → Review.
- Use filters:
- Date range – same window you used in the dashboard
- Topic – select the FAQ you edited
- Click a call to open the transcript.
- Check:
- Did the agent serve the new answer?
- Did the caller stay in self-service or ask for a human?
- If something looks off, tag it.
Tagging and annotations
At the bottom-right of a transcript:
- Category – pick a label like Needs KB fix or Escalated unnecessarily
- Annotation – flag Wrong transcription or Missing topic
These tags surface in QA reports and help PS/Product spot patterns.
Export transcripts (optional)
Need raw data for deeper analysis?
- In Conversations, select your filters.
- Click Export → CSV or JSON.
- You’ll get a download link with call metadata and the full transcripts.
See Call data → Transcripts for field definitions.
When to escalate
Situation | Who to contact |
---|---|
Metrics flat after multiple tweaks | Your CSM – may need flow changes |
Consistent ASR errors | PolyAI support – include call IDs |
Dashboard missing a metric you need | Analytics team via your CSM |
Safety dashboard shows spikes | Raise with PS immediately |
Next steps
- Check the standard dashboard now to make sure your latest edit had the intended effect.
- If you’re comfortable with bulk analysis, explore assistant analysis for batched call scoring.