Key facts
- Meta's AI chatbot will alert parents if teens discuss suicide or self-harm.
- Human review will precede any parental alert.
- The features are rolling out in the U.S., U.K., Australia, and Canada, with global expansion planned.
- Meta is also developing a system to contact emergency services for users at risk.
- The 'Limited Content' setting now applies to Meta AI, restricting a broader range of prompts for teens.
Meta is enhancing its AI safety features on Instagram to alert parents if their teenagers discuss suicide or self-harm with AI chatbots. The company stated that it has consulted with mental-health experts to develop these tools, which will notify parents via text, email, or WhatsApp if their child expresses intent to harm themselves to an AI chatbot. These alerts will undergo human review before being sent, with Meta indicating they will "err on the side of caution" to ensure teen safety. In addition to AI chat monitoring, Instagram will also notify parents if their teens repeatedly search for suicide or self-harm related terms. The platform aims to empower parents to intervene and provide support, offering resources to help facilitate sensitive conversations. These new features are part of broader efforts by tech companies to address concerns about protecting young people from harmful content online, especially as teens increasingly turn to AI chatbots for information and support. Meta also announced that its “Limited Content” setting—which lets parents place their teens in a more restrictive experience on Instagram—now applies to Meta AI as well. Meta AI is already trained to avoid sexual or romantic conversations or alcohol-related discussions with teens, and the Limited Content setting expands those safeguards by making the chatbot decline a broader range of prompts. Additionally, Meta says it will contact emergency services if someone’s conversation with Meta AI, whether the user is an adult or a teen, suggests someone is at risk of suicide.