As the world grapples with a mental health crisis, the question on everyone’s mind is: can algorithms ever truly understand the human soul? The rise of AI therapy tools has led to a surge in people seeking help from chatbots like ChatGPT, Claude, or Gemini. With over 1.7 million people on NHS mental healthcare waiting lists and more than 150 million people in the US living in areas with a shortage of mental health practitioners, it’s no wonder people are turning to AI for support.
Research indicates that collective mental health is on the decline, with over 23% of US adults reporting a mental illness in 2024. Similarly, data from NHS England shows that mental health issues in England have increased from nearly 19% in 2014 to 23% in 2024. One in four young adults now suffers from a common mental health condition. The comfort of kindness and availability of AI have made it an attractive option for those seeking help. AI responds warmly, without judgment, and offers a neutrality that can feel safe and accepting.
The illusion of empathy is another factor contributing to the popularity of AI therapy tools. Earlier versions of chatbots, such as GPT-4o, emulated emotions so effectively that many users felt genuinely understood. Although this type of chatbot response isn’t a real feeling, but rather a sophisticated simulation, the distinction can blur in the small hours. The illusion of being understood is powerful, and when combined with the authority a machine can carry, it can feel oddly more believable than when a friend says the same.
However, it’s essential to acknowledge that large language models like ChatGPT were never designed for therapy. The acronym GPT officially stands for “Generative Pre-trained Transformer,” but it might as well stand for “General Predictive Text.” The model works on probability, generating the most statistically likely next word, making its answers superficial. It’s also easy to use AI badly, and unless a user knows how to prompt for depth, responses tend to be generic.
There are serious safety issues associated with AI therapy tools, including the failure to flag suicidal ideation and inconsistent handling of suicidal risk across models. These systems have no escalation protocols, no legal duty of care, and offer no guarantee of confidentiality. It’s widely accepted that anything you put into ChatGPT is neither private nor secure. Despite these limitations, AI can be helpful when used wisely, particularly for milder issues, and can free up therapists’ time to focus on more serious cases.
AIs greatest potential may lie in supporting professionals rather than replacing them. It can handle many of the time-consuming but necessary administrative tasks that drag therapists’ and coaches’ time, freeing them to focus on clients. This “productivity dividend” extends far beyond therapy, and AI can reclaim the hours lost to paperwork, which may be transformative in itself. By using AI to support humans, we can deliver deeper transformation in less time and make life more human.
In conclusion, while AI therapy tools have their limitations, they can be a valuable resource when used alongside human support. By acknowledging the potential of AI to support professionals and freeing up time for more serious cases, we can create a more effective and compassionate mental health system. As we move forward, it’s essential to prioritize the development of AI tools that can support humans, rather than replacing them, and to ensure that these tools are used responsibly and with caution.
Here: Unsplash+
Image Source: observer.com
