About this episode
Voice AI vendors love to quote word error rate, usually somewhere around 2 to 3%, as proof their system understands customers. Oliver Shoulson, Agent Design & Engineering Lead at PolyAI, thinks it's one of the most misleading numbers in the business. He and Nikola Mrkšić go through a month of analysis across more than 100,000 real production call turns to explain why.
Turns out not all words carry the same weight, most transcription errors are harmless, and task success barely moves even when the system mishears, because today's models recover the way a person would.
Listen to the full episode, and see how PolyAI builds dialog agents that get this right at https://poly.ai?utm_source=youtube&utm_medium=podcast&utm_campaign=podcast&utm_content=podcast
Get every episode summarized
Each time Deep Learning with PolyAI publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Deep Learning with PolyAI
What happens if your AI agents get 1% better every day?
Deep Learning with PolyAI
Who's coordinating your army of AI agents?
Deep Learning with PolyAI
Why should CX leaders care about MCP?
Deep Learning with PolyAI
Can AI really hear a call the way a person does?
Deep Learning with PolyAI