Meta Takes Legal Action Against AI 'Nudify' App Maker in Crackdown on Deepfake Nude Content

Reviewed byNidhi Govil

21 Sources

Meta has filed a lawsuit against Joy Timeline HK Limited, the maker of the AI 'nudify' app Crush AI, for repeatedly violating advertising policies on Facebook and Instagram. The tech giant is also implementing new measures to combat the spread of AI-generated explicit content across its platforms.

Meta's Legal Action Against AI 'Nudify' App Maker

Meta Platforms Inc. has taken a significant step in combating the proliferation of AI-generated explicit content by filing a lawsuit against Joy Timeline HK Limited, the company behind the popular AI "nudify" app Crush AI 1. The legal action, filed in Hong Kong, aims to prevent Joy Timeline HK from advertising its CrushAI apps on Meta's platforms, including Facebook and Instagram 2.

Source: TechCrunch

Source: TechCrunch

Persistent Policy Violations and Evasion Tactics

According to Meta, Joy Timeline HK repeatedly violated the company's advertising policies by promoting services that generate fake, sexually explicit images of real people without their consent 1. Despite multiple enforcement actions taken by Meta since 2023, the app maker continued to circumvent the platform's ad review process 5.

Crush AI reportedly ran over 8,000 ads for its "AI undresser" services on Meta's platforms in the first two weeks of 2025 alone 1. The app evaded detection by setting up numerous advertiser accounts and frequently changing domain names 1.

Meta's New Measures to Combat AI-Generated Explicit Content

Source: The Verge

Source: The Verge

In response to this growing challenge, Meta has announced several new measures to crack down on AI nudify apps:

  1. Enhanced Detection Technology: Meta has developed new tools specifically designed to identify ads for AI nudify services, even when they don't explicitly include nudity 3.

  2. Expanded Keyword Flagging: The company has broadened its list of safety-related terms, phrases, and emojis that its systems are trained to detect within these ads 3.

  3. Information Sharing: Meta will share information about AI nudify apps through the Tech Coalition's Lantern program, a collaborative effort involving other tech giants like Google and Snap 1.

Broader Industry Challenges and Legal Landscape

The issue of AI-generated explicit content extends beyond Meta's platforms. Researchers have noted a surge in links to AI undressing apps on platforms like X (formerly Twitter) and Reddit in 2024 1. YouTube has also reportedly served millions of ads for such apps 1.

Source: The Register

Source: The Register

In the United States, the recently signed Take It Down Act has made it illegal to distribute nonconsensual intimate images 3. Websites are now required to make reasonable efforts to remove such content within 48 hours of notification from a victim 3.

Industry-Wide Implications

Meta's lawsuit and new measures highlight the growing concern over AI-generated explicit content and its potential for abuse. As social media platforms and tech companies continue to integrate generative AI into their services, the challenge of moderating and preventing misuse becomes increasingly complex 1. The outcome of this legal action and the effectiveness of Meta's new measures could set important precedents for how the tech industry addresses similar challenges in the future.

Explore today's top stories

Ilya Sutskever Takes Helm at Safe Superintelligence Amid AI Talent War

Ilya Sutskever, co-founder of Safe Superintelligence (SSI), assumes the role of CEO following the departure of Daniel Gross to Meta. The move highlights the intensifying competition for top AI talent among tech giants.

TechCrunch logoReuters logoCNBC logo

6 Sources

Business and Economy

3 hrs ago

Ilya Sutskever Takes Helm at Safe Superintelligence Amid AI

Google's Veo 3 AI Video Generator Expands Globally, Now Available in India

Google's advanced AI video generation tool, Veo 3, is now available worldwide to Gemini app 'Pro' subscribers, including in India. The tool can create 8-second videos with audio, dialogue, and realistic lip-syncing.

Android Police logo9to5Google logoNDTV Gadgets 360 logo

7 Sources

Technology

19 hrs ago

Google's Veo 3 AI Video Generator Expands Globally, Now

NYT Wins Court Battle: OpenAI Ordered to Retain and Allow Search of ChatGPT Logs

A federal court has upheld an order requiring OpenAI to indefinitely retain all ChatGPT logs, including deleted chats, as part of a copyright infringement lawsuit by The New York Times and other news organizations. This decision raises significant privacy concerns and sets a precedent in AI-related litigation.

Ars Technica logoFuturism logoDataconomy logo

3 Sources

Policy and Regulation

11 hrs ago

NYT Wins Court Battle: OpenAI Ordered to Retain and Allow

Microsoft's AI Push Shadows Xbox Layoffs and Game Cancellations

Microsoft's Xbox division faces massive layoffs and game cancellations amid record profits, with AI integration suspected as a key factor in the restructuring.

Gizmodo logoKotaku logoWccftech logo

4 Sources

Business and Economy

11 hrs ago

Microsoft's AI Push Shadows Xbox Layoffs and Game

Google's Veo 3 AI Tool Sparks Controversy with Racist Videos on TikTok

Google's AI video generation tool, Veo 3, has been linked to a surge of racist and antisemitic content on TikTok, raising concerns about AI safety and content moderation on social media platforms.

Ars Technica logoThe Verge logoPC Magazine logo

5 Sources

Technology

19 hrs ago

Google's Veo 3 AI Tool Sparks Controversy with Racist
TheOutpost.ai

Your Daily Dose of Curated AI News

Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.

© 2025 Triveous Technologies Private Limited
Twitter logo
Instagram logo
LinkedIn logo