San Francisco City Attorney David Chiu has ordered Apple and Google to remove "nudify" applications from their app stores, citing violations of California state law. The letter demands both tech giants purge apps that use artificial intelligence to create fake nude images of people without consent.
Chiu's office determined that both companies have known about these apps for an extended period yet failed to act. The apps typically use AI image generation to synthesize nude versions of clothed photos, often targeting women. California law prohibits such non-consensual intimate imagery, making the distribution of these tools a legal violation.
The move represents escalating pressure on app store gatekeepers to police harmful content. Apple and Google have faced criticism for inconsistent enforcement of their own policies around synthetic sexual content. While both companies maintain community guidelines prohibiting such material, enforcement gaps have allowed nudify apps to remain available for extended periods.
This action aligns with broader regulatory scrutiny of AI-generated intimate imagery. Several states have passed laws criminalizing non-consensual deepfake pornography, and the enforcement challenge extends beyond app stores to social platforms and AI tools generally. Law enforcement agencies nationwide increasingly prioritize these cases as the technology becomes more accessible.
For Apple and Google, the order creates immediate compliance pressure. Both companies maintain curated app ecosystems and bear responsibility for what reaches users. The San Francisco City Attorney's office can pursue enforcement actions and penalties if the companies fail to comply with the removal order.
The letter signals that local authorities view app store operators as liable parties in the distribution chain. Unlike social platforms that host user-generated content, Apple and Google directly distribute and monetize applications. This distinction places heightened responsibility on their curation practices.