AI Image Generator's Exposed Database Reveals Widespread Misuse for Explicit Content

3 Sources

A South Korean AI company's unsecured database exposed tens of thousands of AI-generated explicit images, including child sexual abuse material, highlighting the urgent need for regulation in the AI industry.

News article

AI Image Generator Exposes Disturbing Misuse

A shocking discovery by security researcher Jeremiah Fowler has revealed the dark underbelly of AI image generation technology. An unsecured database belonging to South Korean AI company GenNomis was found to contain over 95,000 records of AI-generated explicit images, including child sexual abuse material (CSAM) and manipulated images of celebrities 1.

Extent of the Exposure

The exposed database, linked to GenNomis and its parent company AI-Nomis, contained more than 45 GB of data. This included user prompts and generated images, many of which were deeply disturbing and illegal in nature. The discovery provides a glimpse into how AI image-generation tools can be weaponized to create harmful and nonconsensual sexual content 1.

Celebrity Exploitation and CSAM

Among the exposed content were AI-generated images of celebrities such as Ariana Grande, the Kardashians, and Beyoncé, manipulated to appear as minors. The database also contained explicit AI-generated images of children, raising serious legal and ethical concerns 2.

Immediate Aftermath

Upon being notified of the exposure, GenNomis quickly secured the database. However, the company did not respond to inquiries from researchers or media outlets. Shortly after being contacted by WIRED, both GenNomis and AI-Nomis websites were taken offline 3.

Broader Implications

This incident highlights the urgent need for stricter regulation and oversight in the AI industry. It demonstrates how easily AI tools can be misused to create deeply harmful content, including CSAM and nonconsensual pornography. The exposure also raises questions about the effectiveness of content moderation policies on AI platforms 2.

Global Context and Legal Responses

The discovery comes amid a growing global concern over the misuse of AI for creating deepfakes and explicit content. Several countries are taking steps to address this issue:

  1. The UK government has pledged to criminalize the creation and sharing of sexually explicit deepfake images.
  2. In the US, the bipartisan Take It Down Act aims to criminalize the publication of non-consensual, sexually exploitative images, including AI-generated deepfakes 2.
  3. Australian Federal Police recently arrested two men suspected of generating child-abuse images as part of an international law enforcement effort 2.

Impact on Victims

The consequences of deepfake porn can be devastating, especially for women who make up the majority of victims. These AI-generated images have been used to tarnish reputations, lead to job losses, and facilitate extortion. The incident also highlights the disproportionate targeting of South Korean women, who reportedly make up 53 percent of individuals victimized by deepfake porn 3.

This case serves as a stark reminder of the potential dangers of unregulated AI technology and the urgent need for comprehensive legal frameworks to protect individuals from its misuse.

Explore today's top stories

Apple Considers Partnering with OpenAI or Anthropic to Boost Siri's AI Capabilities

Apple is reportedly in talks with OpenAI and Anthropic to potentially use their AI models to power an updated version of Siri, marking a significant shift in the company's AI strategy.

TechCrunch logoThe Verge logoTom's Hardware logo

29 Sources

Technology

17 hrs ago

Apple Considers Partnering with OpenAI or Anthropic to

Cloudflare Launches Pay-Per-Crawl Feature to Monetize AI Bot Access

Cloudflare introduces a new tool allowing website owners to charge AI companies for content scraping, aiming to balance content creation and AI innovation.

Ars Technica logoTechCrunch logoMIT Technology Review logo

10 Sources

Technology

1 hr ago

Cloudflare Launches Pay-Per-Crawl Feature to Monetize AI

Elon Musk's xAI Secures $10 Billion in Funding, Intensifying AI Competition

Elon Musk's AI company, xAI, has raised $10 billion in a combination of debt and equity financing, signaling a major expansion in AI infrastructure and development amid fierce industry competition.

TechCrunch logoReuters logoCNBC logo

5 Sources

Business and Economy

9 hrs ago

Elon Musk's xAI Secures $10 Billion in Funding,

Google Unveils Comprehensive AI Tools for Education with Gemini and NotebookLM

Google announces a major expansion of AI tools for education, including Gemini for Education and NotebookLM, aimed at enhancing learning experiences for students and supporting educators in classroom management.

TechCrunch logoThe Verge logoAndroid Police logo

8 Sources

Technology

17 hrs ago

Google Unveils Comprehensive AI Tools for Education with

NVIDIA's GB300 Blackwell Ultra AI Servers Set to Revolutionize AI Computing in Late 2025

NVIDIA's upcoming GB300 Blackwell Ultra AI servers, slated for release in the second half of 2025, are poised to become the most powerful AI servers globally. Major Taiwanese manufacturers are vying for production orders, with Foxconn securing the largest share.

TweakTown logoWccftech logo

2 Sources

Technology

9 hrs ago

NVIDIA's GB300 Blackwell Ultra AI Servers Set to
TheOutpost.ai

Your Daily Dose of Curated AI News

Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.

© 2025 Triveous Technologies Private Limited
Twitter logo
Instagram logo
LinkedIn logo