Feb 26 • 10:00 UTC 🇨🇳 China South China Morning Post

‘Digital public shaming’: Chinese AI tools under fire for pornographic deepfakes

Chinese AI tools, particularly those developed by ByteDance, are criticized for facilitating the spread of non-consensual sexual deepfakes, raising serious concerns regarding women's rights and safety.

The rise of artificial intelligence tools in China, such as Doubao, which is owned by ByteDance, has led to significant societal concerns regarding the misuse of technology for creating pornographic deepfakes. A grassroots group has expressed alarm about the proliferation of non-consensual sexualized images, suggesting that AI platforms are compromising women’s safety and rights in the digital space. The increasing prevalence of these deceptive images has raised ethical questions and highlighted a growing public discourse on consent and digital privacy.

According to data from QuestMobile, Doubao is currently the leading chatbot in China, boasting approximately 155 million weekly active users, alongside other popular AI tools like DeepSeek. However, despite the popularity and rapid growth of these technologies, there is a concerning lack of regulation within China regarding the use of AI-generated content. Unlike many countries that are advancing regulatory measures to mitigate the risks associated with deepfakes, China's regulatory framework remains notably insufficient. This gap in oversight presents a worrying dilemma as the technology matures and becomes increasingly accessible.

The implications of unregulated AI tools extend beyond mere privacy concerns; they encroach on fundamental rights, particularly those of women who find their likeness exploited in harmful ways. The situation calls for urgent attention from policymakers and tech companies to establish effective guidelines that prioritize the safety and consent of individuals, especially vulnerable populations at risk of digital exploitation. As discussions surrounding the ethical deployment of AI generate momentum, there is hope for future advancements to address these critical issues effectively.

📡 Similar Coverage