Apple's Updated App Store Rules Explicitly Ban Nudify AI Apps and AI Deepfakes

Apple Strengthens App Store Rules Against Nudify AI Apps

Apple has updated its App Store Review Guidelines to explicitly ban nudify AI apps that generate nonconsensual intimate images of people without their consent using AI tools1

1

. The updated App Store rules, announced Friday, represent a significant shift in how Apple addresses AI-generated nonconsensual intimate imagery on its platform. Under the revised Section 1.2 covering user-generated content, Apple now states that apps enabling users to create or generate content present challenges including nonconsensual intimate imagery2

2

. Developers must now proactively prevent and remove such content as part of mandatory content moderation requirements3

3

.

Consequences for Violating Developers

Apple warns that developers who fail to implement adequate safeguards or don't remedy violations after notice may be removed from the App Store entirely1

1

. The company emphasized that developers failing to implement appropriate safeguards or remediate identified violations may be considered in violation of the Developer Code of Conduct2

2

. This enforcement mechanism extends beyond simple app removal, potentially resulting in developer account termination for serious or repeated violations.

Crackdown on Bait-and-Switch Apps Using Hidden Features

Apple clarified rules barring bait-and-switch apps that add or change features, including nudification capabilities, after receiving approval1

1

. The newly created Section 2.5.19 explicitly prohibits hidden, dormant, or undocumented features in apps, stating that attempting to hide such functionality through code obfuscation or other methods is grounds for removal from the App Store and termination of developer accounts2

2

. Apple specifically links this rule to nudification apps that misrepresent their purpose during review and only reveal harmful capabilities after approval3

3

.

Background: Grok Controversy and Mounting Pressure

The rule changes follow significant criticism toward Apple after X users exploited xAI's Grok earlier this year to create AI deepfakes, including sexualized images of minors1

1

. While Apple didn't pull X or Grok from the App Store, it told senators that it threatened to yank Grok unless xAI addressed the issue3

3

. At Apple's WWDC event in June, protestors called on the company to remove Grok, X, and all nudify technology from the App Store1

1

. In July, San Francisco city officials ordered Apple to remove 13 nudify apps, which the company confirmed it did1

1

.

Pattern of Problematic Apps Evading Review

Over the past year, multiple investigations exposed apps skirting App Store guidelines. In January, the Tech Transparency Project identified dozens of AI-powered nudify apps on the platform2

2

. A follow-up investigation in April revealed that App Store search suggestions and advertisements were directing users to such apps2

2

. Additionally, investigations uncovered apps disguising gambling platforms as simple games to evade review, many available to children2

2

.

Expanded Protections for Alternative App Distribution

Apple strengthened language around apps facilitating human trafficking or child exploitation, explicitly stating they will be removed from the App Store and blocked from alternative app distribution1

1

2

2

. This extension ensures harmful apps cannot circumvent enforcement through alternative distribution channels, addressing a potential loophole as Apple opens up to third-party app stores in certain regions.