EU Moves to Ban AI Deepfakes After Grok Scandal Sparks Global Crackdown on Child Sexual Abuse

Reviewed byNidhi Govil

3 Sources

Share

European governments took the first step toward banning AI-generated child sexual abuse images and non-consensual sexualized deepfakes, proposing amendments to the EU AI rules. The move follows global outrage over sexually explicit AI-generated content from Elon Musk's xAI chatbot Grok, with tech regulators in Britain, Ireland, and Spain investigating the platform.

EU Governments Push to Outlaw Artificial Intelligence Practices Generating Harmful Content

European ambassadors agreed Friday to prohibit AI systems that generate non-consensual sexualized deepfakes and AI-generated child sexual abuse images, marking a significant expansion of the bloc's landmark AI Act adopted two years ago

1

. The proposal specifically targets "practices regarding the generation of non-consensual sexual and intimate content or child sexual abuse material," according to a spokesperson for Cyprus, which holds the EU's rotating presidency

2

. This represents the first concrete step toward outlawing artificial intelligence practices that create such harmful material, as governments and regulators from Europe to Asia intensify their crackdown by governments and regulators on sexually explicit AI-generated content.

Source: ET

Source: ET

Grok Controversy Accelerates Ban on AI Generating Sexualised Deepfakes

The push to strengthen EU AI rules comes directly after a global backlash over images produced by Elon Musk's xAI chatbot Grok on X. Tech regulators and national watchdogs in Britain, Ireland, and Spain are currently investigating Grok's sexualised AI deepfakes

1

. The European Commission, the bloc's digital watchdog, kickstarted an investigation into Grok in January under the EU's online content rules

2

. X responded to the outcry by claiming "zero tolerance" for sexualised deepfakes of children and women, implementing measures it said would stop such image creation

2

. The incident exposed critical gaps in existing artificial intelligence regulations and accelerated legislative action across multiple jurisdictions.

Source: France 24

Source: France 24

European Parliament's Approval Required Before Implementation

The proposed amendments to the AI Act require backing from the European Parliament before becoming law. Lawmakers are scheduled to vote on their own similar proposition Wednesday, with EU lawmakers set to approve the ban during committee votes

2

. Following this, both the European Parliament and EU member states must negotiate a final text that incorporates the changes to the AI rulebook. The discussions will likely take a year before any changes can be implemented

1

. Ambassadors also approved a fixed timeline for delayed application of high-risk AI rules: December 2027 for stand-alone high-risk AI systems and August 2028 for high-risk AI systems embedded in products

2

.

Tensions Rise as Big Tech Pushes Back Against Stricter Legislation

The amendments come amid broader negotiations on the European Commission's proposal to water down parts of the AI Act, creating tension between different stakeholders. While tech giants and some businesses have welcomed the Commission's softening approach, privacy campaigners and civic groups have criticized the move for bowing to Big Tech

1

3

. This creates a complex regulatory landscape where governments must balance innovation concerns with urgent child sexual abuse and non-consensual content generation issues. The outcome of these negotiations will determine whether the EU maintains its position as a global leader in AI regulation or yields to industry pressure, setting a precedent that other jurisdictions may follow as they develop their own frameworks for controlling harmful AI applications.

Today's Top Stories

TheOutpost.ai

Your Daily Dose of Curated AI News

Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.

© 2026 Triveous Technologies Private Limited
Instagram logo
LinkedIn logo