About this episode
Join me for an exclusive, behind-the-scenes tour of Cisco's purpose-built $20 million AI data center lab in San Jose. AI is revolutionizing the tech industry, but running massive 10,000 GPU clusters can cost up to $175 million a year—and a mere 5% network bottleneck can flush $8 million down the drain. In this video, we break down the hardware, software, and networking topologies required to build, secure, and scale massive AI data centers.
I sit down with Cisco engineers to explore scale-up domains with NVIDIA H200 and AMD MI350X servers, scale-out rail-optimized topologies, and the massive Cisco Silicon One G300 ASIC delivering 102.4 Terabits per second with innovative liquid cooling. We also dive into the Ethernet vs. InfiniBand debate for scaling to 100,000 GPUs, the power of Linear Pluggable Optics (LPO) to reduce power draw, and how Cisco used AI to safely refactor 500,000 lines of legacy code. Whether you are building
an AI network today or upgrading your engineering skills for the future, this is video can help you learn.
Big thanks to Cisco for sponsoring my trip to Cisco Data Center and Operational Control Center in San Jose.
// Will Eatherton SOCIAL //
LinkedIn: / willeatherton
Newsroom: https://newsroom.cisco.com/c/r/newsro...
// Rakesh Kumar SOCIAL //
LinkedIn: / rakesh-kumar-78559b
// Richard Licon SOCIAL //
LinkedIn: / rlicon75
// Ram Gandikota //
LinkedIn: / ramgandikota
// Faraz Taifehesmatian SOCIAL //
LinkedIn: / faraztaifeh
// YouTube video REFERENCE //
• The 100Tbps AI Switch: Inside the Beast
/ David's SOCIAL //
Discord: discord.com/invite/usKSyzb
Twitter: www.twitter.com/davidbombal
Instagram: www.instagram.com/davidbombal
LinkedIn: www.linkedin.com/in/davidbombal
Facebook: www.facebook.com/davidbombal.co
TikTok: tiktok.com/@davidbombal
YouTube: / @davidbombal
Spotify: open.spotify.com/show/3f6k6gE...
SoundCloud: / davidbombal
Apple Podcast: podcasts.apple.com/us/podcast...
// MY STUFF //
https://www.amazon.com/shop/davidbombal
// SPONSORS //
Interested in sponsoring my videos? Reach out to my team here: [email protected]
// MENU //
0:00 - The power of AI data centers
0:51 - Cost and challenges of AI data centers
02:35 - How to connect GPUs in an AI cluster
05:23 - The future of data centers
08:45 - NeoCloud infrastructure in Australia
10:28 - The right components matter
16:32 - Testing to avoid failures
21:43 - Ethernet vs InfiniBand
23:27 - Cisco security services
26:14 - Future of speeds in the data center
27:23 - Conclusion
Please note that links listed may be affiliate links and provide me with a small percentage/kickback should you use them to purchase any of the items listed or recommended. Thank you for supporting me and this channel!
Disclaimer: This video is for educational purposes only.
#ai #network #datacenter
Get every episode summarized
Each time David Bombal publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from David Bombal
#600: This Free Tool Decodes Game Boy ROM From a Photograph
David Bombal
#599: This Pocket Tool Diagnoses Wi-Fi in 45 Seconds
David Bombal
#598: AI Can’t Understand Intent. That’s a Security Problem
David Bombal
#597: The Hacking Gadgets You Need to Know
David Bombal