
technologyJun 24, 202644:51pending
Memory and Continual Learning: Engram's Dan Biderman and Jessy Lin
About this episode
Dan Biderman and Jessy Lin, co-founders of Engram, are building a neolab around memory and continual learning, which they call two sides of the same coin. Their contrarian premise: instead of stuffing ever-larger prompts into the context window or bolting on RAG, bake a team's knowledge directly into the model's weights, so it knows your company the way an employee of several years does.
The payoff: matching or beating frontier models while consuming up to 100x fewer tokens. Working with partners like Microsoft, Notion, and Harvey, the team draws on roots in computational neuroscience and state-space architectures to attack what they see as the real bottleneck in AI — not raw intelligence, but memory and continual learning. In contrast to the frontier labs' race toward one ever-bigger model and AGI, Dan and Jessy imagine a world where everyone has their own model — privately trained, always learning, and good at the things you actually care about. The real ChatGPT moment for memory, they argue, is the day your model feels like an intern that genuinely got smarter overnight.
Hosted by Sonya Huang and Shaun Maguire, Sequoia Capital
Get every episode summarized
Each time Training Data publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Training Data

Making Cities Awesome: Peregrine’s Nick Noone & Ben Rudolph
Training Data
Sep 1, 202652:27pending

Parallel’s Parag Agrawal: Building a New Web for AI Agents
Training Data
Aug 25, 202655:18pending

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It...
Training Data
Aug 18, 202653:43pending

Chai Discovery's Bitter Lesson: Drug Design Is Another Scaling Problem
Training Data
Aug 4, 202647:22pending