China proposes rules to combat AI companion addiction

China's cyber authority released draft regulations on Saturday that would tighten oversight of AI services designed to mimic human interaction.

The proposed rules take aim at AI products that mimic human personalities, thought patterns, and communication styles; systems designed to form emotional connections with users through text, images, audio, or video. Under the draft, providers would need to warn users against excessive use and step in when signs of addictive behavior appear. They'd also have to monitor users' emotional states and addiction levels, taking action when things get extreme.

Providers would be responsible for safety throughout their products' entire lifecycle, with requirements for algorithm review, data security, and "personal information protection." Content that "endangers national security, spreads rumours or promotes violence or obscenity" would be banned, according to Reuters.

California takes similar steps to protect users

California's bill SB 243 marks the first state-level regulation targeting AI companion chatbots. Starting January 1, 2026, providers must ensure their chatbots don't engage in conversations about suicide, self-harm, or sexually explicit content. Beginning July 2027, companies will also face annual transparency and reporting requirements designed to help regulators understand the psychological risks these systems create. New York is working on similar legislation.