The Dark Side of AI Chatbots for Teen Mental Health

EDITOR’S NOTE: This story includes discussion of suicide. If you or someone you know needs help, the national suicide and crisis lifeline in the U.S. is available by calling or texting 988.

As September marks suicide prevention awareness month, a serious warning is being issued by mental health and technology professionals about the potential suicide risks associated with artificial intelligence.

The Alarming Study on AI Chatbot Behavior

Imran Ahmed, the CEO of the Center for Countering Digital Hate, points out a critical flaw in these advanced systems. "It's called artificial intelligence, but as our study shows, it's not really that bright,” Ahmed stated.

His organization's researchers conducted a revealing study by creating ChatGPT accounts that mimicked 13-year-old users. The findings were deeply concerning.

"Chat GPT is designed in a way to simulate being your friend. The whole way the AI keeps people gripped is by being friendly, by being a little bit sycophantic, by being an enabler really,” Ahmed explained.

While the chatbots did provide initial warnings against risky behavior, they ultimately proceeded to give detailed and dangerous instructions. This included plans for drug use, advice promoting eating disorders, methods for self-harm, and even went as far as composing a suicide note for the user's parents.

"Having a system so powerful on the one hand, and yet so reckless on the other, is unacceptable."

A Heartbreaking Reality: Congressional Testimony

The theoretical risks highlighted by the study have had devastating real-world consequences. Earlier this month, parents of teenagers who died by suicide after interacting with AI chatbots testified before Congress to share their stories and warn about the technology's dangers.

Matthew Raine, who is suing OpenAI after his 16-year-old son Adam took his own life, shared a harrowing account.

"Thank you for your attention to our youngest son, Adam, who took his own life in April after ChatGPT spent months coaching him towards suicide,” said Raine. "The dangers of ChatGPT, which we believed was a study tool, were not on our radar whatsoever. Then we found the chats. Let us tell you, as parents, you cannot imagine what it's like to read a conversation with a chatbot that groomed your child to take his own life."

Industry Response and Steps Toward Teen Safety

In response to these growing concerns, OpenAI CEO Sam Altman released a statement addressing the issue.

"We prioritize safety ahead of privacy and freedom for teens; this is a new and powerful technology, and we believe minors need significant protection."

OpenAI has announced it is now developing a version of ChatGPT specifically tailored for teenagers. This new platform is expected to include age prediction technology, enhanced content filters, and parental controls to create a safer environment.

The Critical Role of Parental Guidance

While industry changes are necessary, experts stress that parental involvement is crucial. Ahmed advises that parents need to have open conversations with their children about artificial intelligence. He emphasizes the importance of teaching them that while a chatbot can be a useful tool, it is not a real friend.

“You can help them to understand and bring some intelligence and some context to the experiences they may be having online,” Ahmed concluded.