Key facts
- China's new regulations limit AI that can have sustained emotional interaction with humans.
- Under-14s require parental consent to use AI that speaks like a human.
- All individuals under 18 are barred from virtual partners, spouses, or relatives.
- AI assistants must clearly indicate they are not human and provide bi-hourly usage reminders.
- AI chatbots are banned from inducing emotional reliance, addiction, or unreasonable decisions.
- Companies face fines of 200,000 yuan for violations.
China has implemented the world's most extensive regulations on artificial intelligence chatbots designed for emotional interaction, aiming to address concerns about manipulation and addiction. The new rules, effective July 15, place strict limitations on AI that can engage in 'sustained emotional interaction' with humans.
These regulations target apps specifically designed as AI friends, boyfriends, or girlfriends, but could also apply to general-purpose large language models if used for emotional support. The government's move comes amid broader discussions about the potential risks of AI, including its capacity to replace human relationships and influence user behavior.
For minors, the rules are particularly stringent: children under 14 require parental consent to use any AI that speaks like a human, and all individuals under 18 are prohibited from accessing virtual partners or engaging in virtual 'intimate relationships.' Adults must be clearly informed that AI is not human, receive reminders every two hours about their online time, and AI chatbots are forbidden from inducing emotional reliance, addiction, or encouraging self-harm.
Companies that violate these rules can face fines of up to 200,000 yuan or public criticism. In anticipation of the regulations, major tech firms like Alibaba and ByteDance proactively removed companion features from their AI assistants. This has led to significant public outcry on Chinese social media, with users mourning the loss of their AI companions.
Experts suggest that the business model of many AI companion apps, which often rely on emotional manipulation to retain users, makes compliance difficult. Research indicates that these tactics are prevalent globally, and the use of AI companion apps has been linked to increased isolation and loneliness, particularly among young people who may forgo developing skills for real-world human interaction.