A Chinese activist in the UK was initially told by X that deepfake posts portraying her as a drug addict and sexually promiscuous did not violate platform rules. The account was suspended only after the Guardian inquired about the platform's decisions.
The incident highlights significant concerns regarding X's content moderation policies and enforcement, particularly concerning AI-generated deepfakes and harassment targeting dissidents. It raises questions about the platform's commitment to protecting users from abuse and the effectiveness of its systems in identifying and removing harmful content, especially when it originates from state-sponso
A Chinese activist based in the UK, Apple Peiqing Ni, reported being subjected to a barrage of abusive deepfake posts on the social media platform X, formerly Twitter. The posts, which included fabricated images and videos, falsely depicted Ni, the founder of the China Dissent Network, as engaging in promiscuous sexual behavior and heavy drug use. Despite the content appearing to violate X's own rules against harassment and humiliation, the platform's automated systems and subsequent support service initially rejected Ni's complaints.
Ni, who moved to the UK in 2019, believes the posts were orchestrated by a pro-regime bot. The abuse escalated after she announced her participation in a Tiananmen Square massacre commemoration. One post even celebrated a fabricated report of her being "beaten badly on the red streets of London," possibly referencing an unrelated attack on another activist.
Following the initial rejections, the account responsible for the deepfakes was only suspended hours after The Guardian contacted X's press office for comment. X then stated that the action was taken in response to "different reports." Ni expressed confusion and distress over the platform's delayed response, noting that UK police had advised her to report the issue to X but stated they could not act due to the platform being US-based and the account's anonymity.
Ni also revealed that her parents in China have faced harassment from secret police, with threats made against their business and her deceased grandfather's grave if she continues her activism abroad. She feels profiled and constantly watched, suspecting she is being followed. Concerns have been raised about X's content moderation systems, particularly in light of a recent agreement with UK regulator Ofcom to review illegal hate and terror content within 24 hours, while dissident voices appear to receive less attention.