AI Researchers Remove Thousands of Links to Suspected Child Abuse Imagery from Dataset
Curated by THEOUTPOST
On Sat, 31 Aug, 8:03 AM UTC
6 Sources
6 Sources
[1]
AI researchers delete over 2,000 web links to suspected child sexual abuse imagery
A report by the news agency Associated Press early Saturday said that the dataset in the picture is the Large-scale Artificial Intelligence Open Network (LAION). Artificial Intelligence (AI) researchers said on Friday (Aug 30) that they deleted over 2,000 web links to suspected child sexual abuse imagery from a dataset used to train popular AI image-generator tools. A report by the news agency Associated Press early Saturday said that the dataset in the picture is the Large-scale Artificial Intelligence Open Network (LAION). LAION is a huge index of online images and captions that's been a source for leading AI image-makers such as Stable Diffusion and Midjourney. In December 2023, a report by the Stanford Internet Observatory said that LAION contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children. Also read | South Korea sees outcry over sexual deepfakes in Telegram chatrooms This report caused LAION to immediately remove its dataset. Eight months (after the report was released), LAION said that it was working with the Stanford Internet Observatory and anti-abuse organisations in Canada and the United Kingdom (UK) to fix the problem and release a cleaned-up dataset for future AI research. The Associated Press report said that Stanford commended LAION for significant improvements but said the next step but said that the next step was to withdraw from distributing the "tainted models" that were still able to produce child abuse imagery. The cleaned-up version of the LAION dataset comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children.
[2]
Child abuse images removed from AI image-generator training source, researchers say
Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools. The LAION research database is a huge index of online images and captions that's been a source for leading AI image-makers such as Stable Diffusion and Midjourney. But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children. That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research. But one of the LAION-based tools that Stanford identified as the "most popular model for generating explicit imagery" -- an older and lightly filtered version of Stable Diffusion -- remained publicly accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a "planned deprecation of research models and code that have not been actively maintained." The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children. San Francisco's city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable people to make AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform's founder and CEO, Pavel Durov.
[3]
Child abuse images removed from AI image-generator training source, researchers say
Artificial intelligence researchers said Friday that they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools. The LAION research database is a huge index of online images and captions that's been a source for leading AI image-makers such as Stable Diffusion and Midjourney. But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children. That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research. But one of the LAION-based tools that Stanford identified as the "most popular model for generating explicit imagery" -- an older and lightly filtered version of Stable Diffusion -- remained publicly accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a "planned deprecation of research models and code that have not been actively maintained." The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children. San Francisco's city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable people to make AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform's founder and CEO, Pavel Durov.
[4]
Child abuse images removed from AI image-generator training source, researchers say
Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools. The LAION research database is a huge index of online images and captions that's been a source for leading AI image-makers such as Stable Diffusion and Midjourney. But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children. That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research. But one of the LAION-based tools that Stanford identified as the "most popular model for generating explicit imagery" -- an older and lightly filtered version of Stable Diffusion -- remained publicly accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a "planned deprecation of research models and code that have not been actively maintained." The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children. San Francisco's city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable people to make AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform's founder and CEO, Pavel Durov.
[5]
Child Abuse Images Removed From AI Image-Generator Training Source, Researchers Say
Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools. The LAION research database is a huge index of online images and captions that's been a source for leading AI image-makers such as Stable Diffusion and Midjourney. But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children. That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research. But one of the LAION-based tools that Stanford identified as the "most popular model for generating explicit imagery" -- an older and lightly filtered version of Stable Diffusion -- remained publicly accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a "planned deprecation of research models and code that have not been actively maintained." The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children. San Francisco's city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable people to make AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform's founder and CEO, Pavel Durov. Copyright 2024 The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed.
[6]
Child abuse images removed from AI image-generator training source, researchers say
Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a dataset used to train popular AI image-generator tools. The LAION research dataset is a huge index of online images and captions that's been a source for leading AI image-makers such as Stable Diffusion and Midjourney. But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children. That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organisations in Canada and the United Kingdom to fix the problem and release a cleaned-up dataset for future AI research. San Francisco goes after websites that make AI deepfake nudes of women and girls Stanford researcher David Thiel, author of the December report, commended LAION for significant improvements but said the next step is to withdraw from distribution the "tainted models" that are still able to produce child abuse imagery. One of the LAION-based tools that Stanford identified as the "most popular model for generating explicit imagery" -- an older and lightly filtered version of Stable Diffusion -- remained easily accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a "planned deprecation of research models and code that have not been actively maintained." The cleaned-up version of the LAION dataset comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children. San Francisco's city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable the creation of AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform's founder and CEO, Pavel Durov. Durov's arrest "signals a really big change in the whole tech industry that the founders of these platforms can be held personally responsible," said David Evan Harris, a researcher at the University of California, Berkeley who recently reached out to Runway asking about why the problematic AI image-generator was still publicly accessible. It was taken down days later. Read Comments
Share
Share
Copy Link
AI researchers have deleted over 2,000 web links suspected to contain child sexual abuse imagery from a dataset used to train AI image generators. This action aims to prevent the creation of abusive content and highlights the ongoing challenges in AI development.
AI Dataset Cleansing: Removing Suspected Child Abuse Imagery
In a significant move to address ethical concerns in artificial intelligence development, researchers have removed more than 2,000 web links suspected of containing child sexual abuse imagery from a dataset used to train AI image generators 1. This action underscores the ongoing challenges faced by the AI industry in ensuring the ethical use and development of technology.
The LAION Dataset and Its Implications
The dataset in question, known as LAION-5B, is a vast collection of 5.8 billion image-text pairs used in training popular AI image generators like Stable Diffusion 2. Created by the nonprofit organization LAION, this dataset has been instrumental in advancing AI capabilities but has also inadvertently included problematic content.
Collaborative Effort in Content Removal
The removal of the suspected links was a result of collaborative efforts between LAION and child safety experts 3. These experts identified the potentially abusive content, leading to the deletion of 2,046 links from the dataset. This action aims to prevent AI models from generating or being used to create abusive content involving minors.
Implications for AI Development
This incident highlights the critical need for rigorous content filtering and ethical considerations in AI development. As AI technologies become more advanced and widely used, ensuring they are not trained on or capable of producing harmful content becomes increasingly important 4.
Ongoing Challenges and Future Steps
While the removal of these links is a positive step, it also reveals the ongoing challenges in creating safe and ethical AI systems. The sheer scale of datasets used in AI training makes comprehensive content review a daunting task. Industry experts emphasize the need for continued vigilance and improved methods for detecting and removing problematic content 5.
Impact on AI Image Generators
Popular AI image generators like Stable Diffusion, which have been trained on the LAION dataset, may need to be retrained to ensure they do not produce inappropriate content. This process could have significant implications for the development and deployment of AI technologies across various industries.
Broader Implications for AI Ethics
This incident serves as a reminder of the broader ethical considerations in AI development. It raises questions about the responsibility of AI researchers and companies in curating training data and the potential consequences of overlooking harmful content in the pursuit of technological advancement.
Reference
[4]
[5]
U.S. News & World Report
|Child Abuse Images Removed From AI Image-Generator Training Source, Researchers Say
AI Dataset LAION-5B Back Online After Removal of Illegal Content
The LAION-5B dataset, used to train AI models like Stable Diffusion, has been re-released after being taken offline to remove child sexual abuse material (CSAM) and other illegal content.
3 Sources
AI-Generated Child Sexual Abuse Material: A Growing Threat Outpacing Tech Regulation
The rapid proliferation of AI-generated child sexual abuse material (CSAM) is overwhelming tech companies and law enforcement. This emerging crisis highlights the urgent need for improved regulation and detection methods in the digital age.
9 Sources
AI-Generated Child Abuse Imagery on the Rise, Posing New Challenges for Internet Watchdogs
The Internet Watch Foundation reports a significant increase in AI-generated child abuse images, raising concerns about the evolving nature of online child exploitation and the challenges in detecting and combating this content.
3 Sources
Law Enforcement Races to Combat AI-Generated Child Sexual Abuse Imagery
U.S. law enforcement agencies are cracking down on the spread of AI-generated child sexual abuse imagery, as the Justice Department and states take action to prosecute offenders and update laws to address this emerging threat.
7 Sources
U.S. Prosecutors Tackle Rising Threat of AI-Generated Child Sex Abuse Imagery
Federal prosecutors in the United States are intensifying efforts to combat the use of artificial intelligence in creating and manipulating child sex abuse images, as concerns grow about the potential flood of illicit material enabled by AI technology.
8 Sources
Your one-stop AI hub
The Outpost is a comprehensive collection of curated artificial intelligence software tools that cater to the needs of small business owners, bloggers, artists, musicians, entrepreneurs, marketers, writers, and researchers.
The Outpost
Keep in touch
© 2024 TheOutpost.AI All rights reserved