AI Chip Trends, RAG vs. Fine-Tuning, AI2 | The AI Moment, Episode 5

On this episode of The AI Moment, we explore what's going on with AI chips, the pros and cons to RAG and fine-tuning to make LLMs better and how the Allen Institute for AI has dropped a tool which makes them an Adult in the AI Rumpus Room

The discussion covers:

• Key Trends in Generative AI: 

• New chips, NVIDIA's GH200 Grace Hopper, Microsoft's Azure Maia AI Accelerator and Intel's Gaudi 2 are showing the potential for significant gains in performance and efficiency, which means lower AI compute costs. 

• Practices for making AI models better – RAG is the new rage, but fine-tuning gets a boost from SLoRA. Vectara's hallucination measuring tool, Hugging Face's LLMs as a Judge

• Adults in the AI Rumpus Room: The Allen Institute for AI (AI2) recently published research that lays out the challenges of having bad data sets feed AI models. They have developed a framework to address it called What's In My Big Data? (WIMBD)

Watch the video below, and be sure to subscribe to our YouTube channel, so you never miss an episode.