Transformers: The Discovery That Sparked the AI Revolution
About this episode
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.
Get every episode summarized
Each time Y Combinator Startup Podcast publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Y Combinator Startup Podcast
Paul Graham On Startups, Ambition, and Great Founders
Y Combinator Startup Podcast
The World’s Largest Electric Aircraft Just Flew
Y Combinator Startup Podcast
Max Junestrand: You Need The Willingness To Learn Faster Than Anyone Else
Y Combinator Startup Podcast
Susan Kare: Designing Icons & Graphics For the Original Mac
Y Combinator Startup Podcast