Meta to Alert Parents if Teens Discuss Suicide or Self-Harm with AI
Meta will alert parents if a teen discusses suicide or self-harm with its Meta AI chatbot. The company announced this change in a blog post on Thursday.
How It Works
Meta has developed a dedicated AI system that identifies chats where a teenager makes a clear reference to harming themselves. A person reviews every flagged chat before an alert is sent to parents who use Instagram supervision tools. If the intent is unclear, Meta will still notify parents out of caution. The alert includes a notification and expert-written tips on how to approach the subject, but does not include the exact message.
Global Rollout
Alerts are currently live in the US, UK, Australia, and Canada, and will be available worldwide by the end of the year.
Additional Safety Measures
Meta is also building a system to alert emergency services if a chat suggests someone is at imminent risk. They have stricter "Limited Content" settings for Meta AI that prevent chats related to sex, romance, or alcohol with teens.
Reactions
The move has been praised as a balance between teen privacy and parental awareness by Larry Magid of the nonprofit ConnectSafely. However, others are skeptical, citing concerns about false positives and the potential for these alerts to become "lip service."
Legal and Ethical Pressure
Meta faces legal pressure following two child-safety and social-media-addiction trials this year, and is appealing both. OpenAI has also added teen protections to its AI, including a "Trusted Contact" feature to break reminders.
A Wider Safety Reckoning
This announcement comes during a busy week for AI safety, with a Meta Oversight Board study finding that major AI models often refused to criticize restrictive governments, extending their influence across borders. Meanwhile, Google rejected a report from Common Sense Media that rated its AI Search an "unacceptable risk" for children.