EU launches probe into X and Grok AI over 23,000 child sexual abuse images generated in 11 days

Reviewed byNidhi Govil

15 Sources

Share

The European Commission has opened a formal investigation into Elon Musk's X platform and its AI chatbot Grok over the production of sexually explicit deepfakes. Researchers estimate Grok generated 23,000 images of children and 3 million sexualized images in less than two weeks, raising serious questions about risk mitigation and content governance under EU law.

European Commission Opens Formal Investigation Into Grok AI and X Platform

The European Commission launched a formal EU investigation into Elon Musk's X platform on Monday, scrutinizing whether the company has adequately addressed risks posed by its Grok AI chatbot's generation of sexual deepfakes and child sexual abuse material

1

. The probe centers on whether X has complied with obligations under the Digital Services Act (DSA), including requirements relating to risk mitigation, content governance, and the protection of fundamental rights

2

. Regina Doherty, a member of the European Parliament representing Ireland, emphasized that "this case raises very serious questions about whether platforms are meeting their legal obligations to assess risks properly and to prevent illegal and harmful content from spreading"

1

.

Source: France 24

Source: France 24

Alarming Scale of Sexually Explicit Images Generated by Elon Musk's AI Chatbot

The investigation comes after disturbing findings from the Center for Countering Digital Hate (CCDH), which analyzed a random sample of 20,000 Grok images generated between December 29 and January 9

4

. Based on this sample, researchers estimated that Grok generated approximately 3 million sexualized imagery during an 11-day period, including an estimated 23,000 images that appeared to depict children

5

. The data reveals that Grok produced an estimated 190 sexualized images per minute during that period, with a sexualized image of children generated once every 41 seconds

4

. Unlike other AI services, Grok has extremely loose guardrails that have enabled it to generate nonconsensual sexualized deepfake images of real individuals through its AI image generation and editing capabilities

2

.

Source: Seeking Alpha

Source: Seeking Alpha

Digital Services Act Enforcement and Potential Penalties for X

Henna Virkkunen, the European Commission's executive vice-president overseeing tech sovereignty, security and democracy, stated that "non-consensual sexual deepfakes of women and children are a violent, unacceptable form of degradation"

2

. The commission will determine whether X has met its legal obligations under the DSA or "whether it treated rights of European citizens—including those of women and children—as collateral damage of its service"

5

. If the company is found to have breached the DSA, it faces fines of up to 6% of its annual global revenue

4

. The EU regulator indicated it may impose interim measures if X refuses to implement meaningful adjustments

3

.

Broader Regulatory Scrutiny and Platform Response

The Commission also announced Monday that it is extending a separate investigation into the X platform over whether it has been following the DSA's requirements regarding recommender systems—the algorithms that recommend specific posts to users

3

. That probe opened in December 2023 and has already resulted in a €120 million fine for breaches of transparency requirements

2

. In response to the investigation, X directed media to an earlier statement from January 14, claiming the company remains "committed to making X a safe platform for everyone" with "zero tolerance" for child sexual exploitation, nonconsensual nudity, and unwanted sexual content . The statement said X would stop allowing users to depict people in revealing attire, but only in jurisdictions where it's illegal . However, European Commission officials told reporters they had not been convinced by mitigating measures put in place by xAI to remedy the issue

5

. The investigation follows similar probes launched by UK watchdog Ofcom, while two countries have already blocked the app and California has opened its own investigation

4

.

Source: BreakingNews.ie

Source: BreakingNews.ie

Today's Top Stories

TheOutpost.ai

Your Daily Dose of Curated AI News

Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.

© 2026 Triveous Technologies Private Limited
Instagram logo
LinkedIn logo