
About this episode
“If your doctor were only right a third of the time, would you trust them?”
OpenAI’s recent move to block ChatGPT from giving out personalized medical, legal, and financial advice is a seismic shift in how we use AI, and Jim wastes no time diving into what this means for all of us.
Jim breaks down the “why” behind this decision, sharing real-world horror stories that make the risks crystal clear. He talks about the man who landed in the ER after following ChatGPT’s advice to substitute table salt with sodium bromide, and mentions botched legal docs and misdiagnoses that have caused real harm. It’s not just about hypothetical dangers; people have already been hurt.
But it’s not all doom and gloom. Jim explains how the AI landscape is evolving, with specialized platforms like CounselPro and AlphaSense taking center stage. Instead of generic advice bots, we’re seeing a new breed of AI tools that work hand-in-hand with licensed professionals, keeping compliance and accountability front and center.
Listeners get a front-row seat to the market’s rapid adaptation: startups pivoting their APIs, compliance checks being baked in, and a push for transparency and audit trails. Jim doesn’t shy away from the frustrations some users feel, especially those who have barriers to professional services. But he’s clear: “You can’t have AI systems giving medical advice that lands people in the hospital.”
What’s the big takeaway? This shift is the start of a smarter, safer era. The future belongs to sector-specific, compliant tools that augment human expertise. And for anyone building or using AI, that’s the real opportunity.
Feeling fired up about the future of AI? Jim invites listeners to join his Slack community, Control + Alt + Build, where founders and enthusiasts share strategies and navigate the world of AI together. If you want to stay ahead of the curve, this is where you need to be. Join fellow builders here: https://jimcarter.me/ctrl-alt-build-ai-community/
Don’t miss the conversation — this is the episode that’ll change how you think about AI, forever.
Get every episode summarized
Each time The Prompt publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from The Prompt

You Don't Have an AI Problem, You Have an OVERTHINKING Problem
The Prompt

5 Claude Skills Every Small Business Owner Needs Right Now
The Prompt

This Pet Owner Used AI to Save His Dog
The Prompt

Google Took 58% from Us
The Prompt