About this episode
What does a production-grade large language model look like? While at NDC Sydney, Richard talked with Vaishnavi Gudur from Microsoft about her work scaling LLMs for Teams transcriptions, summaries, and more! Vaishnavi discusses the underlying complexities of operating the Teams LLM infrastructure for a large array of customers across different countries and regulatory regimes. Data sovereignty also plays a large role: different countries have specific rules on where data must reside and how it can be accessed. As the scale increases and the tail gets longer, the rules set gets more complex! Lots of great thinking about what LLMs look like in a production environment.
Links
Recorded April 24, 2026
Get every episode summarized
Each time RunAs Radio publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from RunAs Radio
State of WSUS with Adam Marshall
RunAs Radio
Reimagining Intranets with Susan Hanley
RunAs Radio
Security Features of PowerShell 7 with Mike O'Neill
RunAs Radio
Automatic Attack Disruption with Liz Tesch
RunAs Radio