San Francisco orders Apple and Google to remove AI apps creating nonconsensual deepfake images

San Francisco City Attorney David Chiu sent cease-and-desist letters to Apple and Google in July 2026, demanding the removal of 13 AI-powered "nudify" apps that generate nonconsensual intimate deepfake images targeting women and girls ^{[1, 2, 3]}. The apps allow users to digitally undress people and create explicit images without consent, which Chiu said is illegal, harmful, and unacceptable ^[2]. He added that the companies have likely earned millions in fees from these apps through in-app payments ^{[1, 3]}.

Chiu warned Apple and Google they could face civil penalties under a 2025 California law that holds platform providers liable for knowingly facilitating nonconsensual deepfake pornography ^{[1, 4]}. "Apple and Google are profiting off apps that exploit women and girls by generating nonconsensual intimate deepfakes," Chiu said, emphasizing the apps’ role in bullying, humiliation, threats, and severe mental health impacts including suicidal victims ^{[1, 4]}.

Google confirmed it has suspended or deleted hundreds of apps violating its policies, including five notable ones targeted by Chiu’s office ^{[1, 2, 3]}. A Google spokesperson said, "Google Play does not allow apps that contain sexual content, and we continually take proactive steps to detect and remove apps with harmful content" ^[1]. Apple did not comment ahead of publication but enforces policies banning pornography and harassment on its platform ^{[2, 3]}.

The Tech Transparency Project reported in January and April 2026 on dozens of such apps available in app stores, some rated "E for Everyone," allowing children to download them ^{[4, 3]}. The San Francisco letters require Apple and Google to contact the city within 28 days, setting a deadline for compliance ^[4].

California’s 2025 law enabled victims to bring civil actions against facilitators of unauthorized deepfake pornography ^[4]. Chiu’s action follows months of warnings and public reporting to Apple and Google during 2026 ^[4]. The city attorney’s office seeks to remove eight nudify apps from Apple’s store and five from Google Play ^{[1, 2, 3]}.