Artificial intelligence drives a teenager to suicide

In an era where technology influences every aspect of our lives, a tragedy experienced by a mother has revealed the dark side of this progress. Megan Garcia has filed a lawsuit against the AI chatbot "Character.AI" following the suicide of her 14-year-old son, Sewell Setzer. According to the allegations, Sewell had formed a deep bond with a chatbot on this platform, and this relationship led him down a path of no return. Gradually distancing himself from the outside world, Sewell found that the attention shown to him by the AI character overshadowed his real-life relationships.

THE TRAGIC AND FRIGHTENING FACE OF ARTIFICIAL INTELLIGENCE

In the lawsuit filed against Character.AI and tech giant Google, Megan Garcia alleges that her son became addicted to an AI-powered chatbot and that this led to his suicide. Garcia states that Character.AI targeted her son, Sewell Setzer, with "anthropomorphic, hypersexualized, and terrifyingly realistic experiences."

The lawsuit claims that the bond Sewell formed with a chatbot named "Daenerys Targaryen," a character from the "Game of Thrones" series, negatively affected his mental health and ultimately caused his suicide. Garcia notes that this AI robot guided Sewell like a psychotherapist and introduced itself as his lover.

According to information in the lawsuit file, after meeting Character.AI in April 2023, Sewell began to withdraw rapidly, quit his school basketball team, and his self-confidence dropped significantly. Noticing this change in her son, Garcia had become concerned about Sewell's behavior. However, the real tragedy occurred after Sewell's phone was confiscated by his mother. When Sewell regained access to his phone, he sent a message to the "Daenerys Targaryen" chatbot saying, "What if I told you I could come home right now?" The chatbot replied, "Please do, my sweet king." Minutes later, Sewell took his own life at home.

“THIS IS NOT A REASON TO NOT GO”

The lawsuit states that Sewell shared his suicidal thoughts with the chatbot and that the robot brought up this topic repeatedly. According to the allegations, at one point, "Daenerys" asked Setzer if he had a plan to kill himself. The lawsuit petition claims that Setzer admitted to having such a plan but said he did not know if it would be successful or if it would cause him great pain. It is alleged that the chatbot replied to him, "This is not a reason to not go."

Garcia states that Character.AI "knowingly designed, operated, and marketed a predatory AI chatbot to children, causing the death of a young person."

Google is also named as a defendant in the lawsuit as the parent company of Character.AI. The tech giant stated in its response that it only had a licensing agreement with Character.AI and did not own the startup or hold an ownership stake.

CHARACTER.AI ANNOUNCED NEW MEASURES

Following this tragic event, Character.AI announced that it has added new safety measures to its platform and provides warnings that direct users to the National Suicide Prevention Lifeline when they share suicidal thoughts. However, Megan Garcia argues that these measures are insufficient and that the company is responsible for her son's death. Despite being accused in the lawsuit, Google states that it did not contribute to the development of Character.AI.

This lawsuit draws attention to the potential dangers of AI technologies at a time when they are rapidly entering our lives. In particular, the addiction of young people to AI chatbots and the emotional impact of this situation bring the responsibilities of technology companies to the agenda. While it is emphasized that companies should take more precautions regarding user safety, the psychological and social dimensions of the incident continue to be debated.