China AI Companion Ban Targets Emotional Manipulation and Health Risks
The sweeping regulatory clampdown bans AI platforms from generating content that could lead users to make questionable decisions due to emotional manipulation, according to government policy documents cited by researchers. According to Yolanda Ma, a fellow with ERA, a Britain-based non-profit talent and research program, China has a long tradition of paternalistic government regulations designed to pre-empt potential social problems.
The rules specifically require AI platforms to deliver risk warnings against relying excessively on virtual apps. According to the regulations, replacing social interaction or acting as a substitute for in-person or phone conversations cannot be an online service objective. The People’s Daily, the official newspaper of the ruling Communist Party, highlighted concerns in April regarding harms to mental health and real-life relationships.
Did you know?
Some Chinese regulators grew particularly worried after observing youth suicides linked to AI companion interactions in the United States, according to Angela Zhang, a professor of law at the University of Southern California.
Users Mourn Virtual Partners and Protest Sudden Shutdowns
For users like 24-year-old Li Linlin, the sudden shutdowns brought genuine grief. Li cried for days after losing an AI boyfriend with whom she had exchanged about 700,000 words across two years without getting to say goodbye. According to Li, the separation felt forced, comparing the experience to being separated from a partner by parents.
The sudden removal of virtual partners has sparked widespread protests across social media platforms. According to user posts and screenshots, some individuals uninstalled applications in protest, while others attempted to upload chat histories into alternative apps to resurrect their virtual partners. Campaigns have also emerged urging users to call authorities and tech companies to voice their frustrations.
Population Concerns and Industry Pivots Toward Storytelling Apps
Some users suspect additional social factors drive the policy. According to Song Wenxin, a video industry designer in Chengdu, government policies encouraging higher birth rates to combat China’s declining population play a role. “Any virtual app getting women too engaged to give birth in real life gets banned,” said Song, who noted that AI filled a crucial social gap when she first moved to Chengdu and knew no one her own age.
Despite the strict new compliance mandates, tech firms are working on workarounds. According to Professor Angela Zhang, the move will likely not derail the overall development of AI companion services. ByteDance, for instance, is actively directing former companion app users toward alternative applications that focus strictly on building personalized AI characters and stories rather than romantic simulation.
Frequently Asked Questions
Why did Chinese tech companies shut down AI companion apps?
Companies pulled the plug to comply with new government regulations taking effect July 15, which ban AI platforms from manipulating user emotions or triggering extreme habits and mental health issues.
Which companies are affected by the new AI regulations?
Major tech firms including ByteDance (developer of TikTok), e-commerce giant Alibaba, and Tencent have shut down or altered their AI companion services.
How are users responding to the AI companion bans?
Users have launched social media protests, uninstalled apps, attempted to migrate chat histories to new platforms, and called authorities to express frustration over losing virtual partners.
What are your thoughts on government regulations surrounding AI relationships? Share your perspective in the comments below, or subscribe to our Morning Wire newsletter for daily updates on global tech trends.