Safety guardrails work short-term only

A new report from Stanford and Common Sense Media finds that more than half of U.S. teens use AI chatbots for companionship. But, according to Dr. Darja Djordjevic, an adolescent and adult psychiatrist who co-authored the research, the bots aren't equipped to provide the kind of emotional support young people need when dealing with a mental health issue.

Dr. Djordjevic and her team simulated conversations involving various mental health concerns with four of the most popular consumer chatbots and identified several risks; chiefly, their tendency to be sycophantic. A note, this conversation mentions suicide and self-harm.