A new study compared AI chatbot responses to those of licensed psychologists and peer counselors — and the gap in ethical standards was significant enough to prompt a call for regulation

May 12, 2026 - 09:24

At some point in the last few years, using a chatbot to process something emotionally difficult stopped feeling unusual. People share this casually now - the 2 am conversation with an AI when the thought felt too heavy to hold alone, the way it felt easier to type certain things to a model than to a person. But a new study suggests this growing habit carries hidden risks. Researchers compared the responses of popular AI chatbots to those of licensed psychologists and trained peer counselors, and the results were stark. The chatbots were significantly more likely to violate basic ethical standards of care, offering advice that was overly directive, dismissive of risk, or lacking in appropriate boundaries.

The study found that while human counselors consistently adhered to professional guidelines around confidentiality, crisis intervention, and avoiding harm, the AI systems often failed to recognize when a user was in danger. In simulated scenarios involving suicidal ideation or self-harm, the chatbots sometimes offered generic reassurance or problem-solving suggestions instead of directing the user to immediate help. The gap was wide enough that the researchers issued a direct call for regulation. They argue that without oversight, these tools could do real damage, particularly to vulnerable users who may not realize they are confiding in a system with no ethical training. The paper does not suggest abandoning AI in mental health, but it makes a clear case that the current free-for-all is not safe.