Skip to content
TrackPodcasts
technologyDec 22, 20254:49pending

The Wild West Days of AI Are Over

The Prompt

About this episode

“If your doctor were only right a third of the time, would you trust them?”

OpenAI’s recent move to block ChatGPT from giving out personalized medical, legal, and financial advice is a seismic shift in how we use AI, and Jim wastes no time diving into what this means for all of us.


Jim breaks down the “why” behind this decision, sharing real-world horror stories that make the risks crystal clear. He talks about the man who landed in the ER after following ChatGPT’s advice to substitute table salt with sodium bromide, and mentions botched legal docs and misdiagnoses that have caused real harm. It’s not just about hypothetical dangers; people have already been hurt.


But it’s not all doom and gloom. Jim explains how the AI landscape is evolving, with specialized platforms like CounselPro and AlphaSense taking center stage. Instead of generic advice bots, we’re seeing a new breed of AI tools that work hand-in-hand with licensed professionals, keeping compliance and accountability front and center.


Listeners get a front-row seat to the market’s rapid adaptation: startups pivoting their APIs, compliance checks being baked in, and a push for transparency and audit trails. Jim doesn’t shy away from the frustrations some users feel, especially those who have barriers to professional services. But he’s clear: “You can’t have AI systems giving medical advice that lands people in the hospital.”


What’s the big takeaway? This shift is the start of a smarter, safer era. The future belongs to sector-specific, compliant tools that augment human expertise. And for anyone building or using AI, that’s the real opportunity.


Feeling fired up about the future of AI? Jim invites listeners to join his Slack community, Control + Alt + Build, where founders and enthusiasts share strategies and navigate the world of AI together. If you want to stay ahead of the curve, this is where you need to be. Join fellow builders here: https://jimcarter.me/ctrl-alt-build-ai-community/


Don’t miss the conversation — this is the episode that’ll change how you think about AI, forever.

Get every episode summarized

Each time The Prompt publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.

Email me new episodes

Free for 3 shows. No card needed.

Hosts & guests

No transcript yet

This episode has not been transcribed. Request it and it moves to the front of the queue.

The Wild West Days of AI Are Over

The Prompt

0:00
4:49

More episodes

More from The Prompt

View all episodes →