About this episode
Today we dive into a few of my favorite tools for running LLMs locally on your machine, even the average consumer machine. With a huge variety of models to choose from and varying levels of customization and presets, these will get you started on running your own Ai, and getting the pieces necessary to connect them into micro apps and other parts of your workflow. Not only are these huge productivity boosters to have, but it's also just a ton of fun to play around.
For the large list of links to these and so many other AI tools to check out, go to bitcoinaudible.com/ai (Link: bitcoinaudible.com/ai)
Links to the tools and the models mentioned in the episode
- GPT4All (Link: https://gpt4all.io/index.html)
- LM Studio (Link: https://lmstudio.ai/)
- Ollama AI (https://ollama.ai/)
Models mentioned
- Stablelm-zephyr (small & fast)
- Mistral Instruct (good overall, imo)
- Hermes (less likely to lecture you)
- Llama2 (great base model)
- Llava (text and images, multimodal)
Host Links
- Guy on Nostr (Link: http://tinyurl.com/yc376bff)
- Guy on X (Link: https://twitter.com/theguyswann)
- Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible)
Check out our awesome sponsors!
- Get 9% off the COLDCARD with code BITCOINAUDIBLE (Link: bitcoinaudible.com/coldcard)
- Swan: The best way to buy, learn, and earn #Bitcoin (Link: https://www.swanbitcoin.com/)
Get every episode summarized
Each time AI Unchained publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
