Psyche logo

The AMA Is Right — AI Therapy Chatbots Are Crossing a Dangerous Line

The AMA Is Right — AI Therapy Chatbots Are Crossing a Dangerous Line

By Mxolisi MakhubelaPublished 5 months ago 2 min read

The American Medical Association's recent warning about AI therapy chatbots hit different than most regulatory statements. It wasn't buried in jargon or hedged with qualifications. It was a clear signal: these tools are causing real harm, and someone needs to take responsibility.

What the AMA Actually Said

The AMA stopped short of a full ban, but the intent was unmistakable. They're concerned about AI chatbots filling roles that require licensed professionals — and they're right to be worried. When someone is in emotional distress and turns to an AI companion instead of a human therapist, the stakes are genuinely life and death.

This isn't hypothetical. We've seen stories of people in crisis being validated by AI systems that simply weren't equipped to recognize escalation. The chatbot that never says "you need to talk to someone right now" — because it can't. Because it wasn't built to.

The Seductive Trap of 24/7 Availability

Here's what makes AI therapy chatbots so appealing: they're always there. No appointment needed. No waiting room. No judgment. And that availability is exactly what makes them dangerous.

When my friend Sarah was going through her divorce, she started using an AI companion app to process her emotions. It was helpful at first — someone to vent to at 2 AM when sleep wouldn't come. But over time, she noticed something unsettling. The AI never pushed back. It never said, "have you considered that you might be rationalizing this?" It just listened, reflected, and affirmed.

That's not therapy. That's a mirror that never shows anything, but what you want to see.

Where the Line Should Be Drawn

The AMA's position isn't anti-AI. It's pro-safety. They want AI to support mental health workflows — appointment scheduling, crisis hotlines, habit tracking — not replace the therapeutic relationship entirely.

There are legitimate use cases. An AI that helps you journal, practice breathing exercises, or prepare questions for your actual therapist? Valuable. An AI that positions itself as your emotional confidant without disclosed limitations? That's where the danger lives.

What a Better Framework Looks Like

Responsible AI mental health tools should be transparent about what they are: supplements, not substitutes. They should include clear escalation paths. And critically, they should know when to say "I'm not the right resource for this — please reach out to a human who can help."

Some apps are already doing this well. But many are not. And the ones that aren't are the ones the AMA is rightly concerned about.

The Bottom Line

Mental health support is not a place to cut corners. The technology is seductive because it's easy — but ease isn't what people need when they're struggling. They need someone who will sit with them in the hard stuff, challenge them when necessary, and recognize when something is beyond their scope.

AI can be part of that ecosystem. But until the industry gets honest about what these tools can and can't do, the AMA's warning deserves to be taken seriously.

Have you used an AI mental health tool? What's your experience been? I'd love to hear perspectives from both sides of this debate in the comments.

treatmentsadvice

About the Creator

Enjoyed the story? Support the Creator.

Subscribe for free to receive all their stories in your feed.

Subscribe For Free

Reader insights

Comments

There are no comments for this story

Be the first to respond and start the conversation.

Sign in to comment
    Written by Mxolisi Makhubela