Curated by THEOUTPOST
On Sat, 5 Oct, 12:02 AM UTC
2 Sources
[1]
Civil society groups demand action against 'sexist' AI disinformation
Washington (AFP) - More than two dozen international civil society organizations will call on major tech firms to bolster their AI policies to combat "sexist and misogynistic" disinformation plaguing social media platforms, according to the draft of an open letter seen by AFP on Thursday. The letter to the chief executives of six giants -- Meta, X, YouTube, TikTok, Snapchat, and Reddit -- follows an online boom in non-consensual deepfake porn as well as harassment and scams enabled by cheap, widely available artificial intelligence tools. "It's evident that these harms are not felt equally," said the letter, signed by 27 digital and human rights organizations including UltraViolet, GLAAD, the National Organization for Women, and MyOwn Image. "Specifically, women, trans people, and nonbinary people are uniquely at risk of experiencing adverse impacts of AI-based content on social media." The letter, which the groups said will be made public on Friday, made a dozen recommendations to strengthen AI policies. Those include clearly defining the consequences for posting non-consensual explicit material -- which should include suspension of repeat offenders -- implementing a third-party tool to detect AI-generated visuals, and clear labelling of such content. The groups also demanded a coherent procedure for users to flag and report harmful content and that platforms carry out comprehensive annual audits of its AI policies. Misogynistic, sexist attacks The letter comes barely a month before what is widely billed as America's first AI election on November 5. The tight race to the White House has seen a firehose of disinformation. A particular target of gendered disinformation is Democratic Party nominee Kamala Harris, which has included a flood of misogynistic and sexist narratives attacking the first Black, South Asian and woman vice president in US history. "These harms silence us online, violate our right to control our own image, and distort our elections," said Jenna Sherman, the campaign director at UltraViolet. "But worse, they normalize and even algorithmically codify sexual exploitation and reinforce harmful stereotypes about gender, sexuality, and consent." The proliferation of non-consensual deepfakes is outpacing efforts to regulate the technology globally, experts say, with several photo apps digitally undressing women and manipulated images fueling "sextortion" rackets. While celebrities such as singer Taylor Swift and actress Emma Watson have been victims of deepfake porn, experts say women not in the public eye are equally vulnerable. "AI technologies have further facilitated the creation and spread of gender-based harassment and abuse online," said Ellen Jacobs, senior US digital policy manager at the Institute for Strategic Dialogue, which was among the organizations that signed the letter. "We need effective policies that specifically address the heightened risks to women, girls, and LGBTQ+ people." The platforms did not immediately respond to a request for comment ahead of the release of the letter. "The world's largest platforms have shown they are not equipped to handle the rise of AI-facilitated hate, harassment, and disinformation campaigns, including deepfakes and bots that can spew hate-based imagery at massive scale," said Leanna Garfield, social media safety program manager at GLAAD. The platforms "need to take concrete action now, so that everyone can feel safe online."
[2]
Civil society groups demand action against 'sexist' AI disinformation
More than two dozen international civil society organizations will call on major tech firms to bolster their AI policies to combat "sexist and misogynistic" disinformation plaguing social media platforms, according to the draft of an open letter seen by AFP on Thursday. The letter to the chief executives of six giants -- Meta, X, YouTube, TikTok, Snapchat, and Reddit -- follows an online boom in non-consensual deepfake porn as well as harassment and scams enabled by cheap, widely available artificial intelligence tools. "It's evident that these harms are not felt equally," said the letter, signed by 27 digital and human rights organizations including UltraViolet, GLAAD, the National Organization for Women, and MyOwn Image. "Specifically, women, trans people, and nonbinary people are uniquely at risk of experiencing adverse impacts of AI-based content on social media." The letter, which the groups said will be made public on Friday, made a dozen recommendations to strengthen AI policies. Those include clearly defining the consequences for posting non-consensual explicit material -- which should include suspension of repeat offenders -- implementing a third-party tool to detect AI-generated visuals, and clear labeling of such content. The groups also demanded a coherent procedure for users to flag and report harmful content and that platforms carry out comprehensive annual audits of its AI policies. Misogynistic, sexist attacks The letter comes barely a month before what is widely billed as America's first AI election on November 5. The tight race to the White House has seen a firehose of disinformation. A particular target of gendered disinformation is Democratic Party nominee Kamala Harris, which has included a flood of misogynistic and sexist narratives attacking the first Black, South Asian and woman vice president in US history. "These harms silence us online, violate our right to control our own image, and distort our elections," said Jenna Sherman, the campaign director at UltraViolet. "But worse, they normalize and even algorithmically codify sexual exploitation and reinforce harmful stereotypes about gender, sexuality, and consent." The proliferation of non-consensual deepfakes is outpacing efforts to regulate the technology globally, experts say, with several photo apps digitally undressing women and manipulated images fueling "sextortion" rackets. While celebrities such as singer Taylor Swift and actress Emma Watson have been victims of deepfake porn, experts say women not in the public eye are equally vulnerable. "AI technologies have further facilitated the creation and spread of gender-based harassment and abuse online," said Ellen Jacobs, senior US digital policy manager at the Institute for Strategic Dialogue, which was among the organizations that signed the letter. "We need effective policies that specifically address the heightened risks to women, girls, and LGBTQ+ people." The platforms did not immediately respond to a request for comment ahead of the release of the letter. "The world's largest platforms have shown they are not equipped to handle the rise of AI-facilitated hate, harassment, and disinformation campaigns, including deepfakes and bots that can spew hate-based imagery at massive scale," said Leanna Garfield, social media safety program manager at GLAAD. The platforms "need to take concrete action now, so that everyone can feel safe online."
Share
Share
Copy Link
Over 25 international civil society organizations are calling on major tech companies to strengthen their AI policies to combat sexist and misogynistic disinformation on social media platforms. The open letter addresses the rise of non-consensual deepfake porn and AI-enabled harassment.
In a significant move to combat AI-driven sexist disinformation, more than two dozen international civil society organizations are set to release an open letter addressing major tech companies. The letter, scheduled for public release on Friday, calls on the chief executives of Meta, X, YouTube, TikTok, Snapchat, and Reddit to bolster their AI policies 12.
The initiative comes in response to a surge in non-consensual deepfake pornography and AI-enabled harassment on social media platforms. These issues have been exacerbated by the widespread availability of cheap AI tools. The letter emphasizes that the adverse impacts of AI-based content are disproportionately affecting women, transgender individuals, and non-binary people 12.
The coalition of 27 digital and human rights organizations, including UltraViolet, GLAAD, the National Organization for Women, and MyOwn Image, has put forth a dozen recommendations to strengthen AI policies. These include:
The timing of this letter is crucial, coming just a month before what is being called America's first AI election on November 5. The upcoming election has already seen a surge in disinformation, with Democratic Party nominee Kamala Harris being a particular target of gendered disinformation campaigns 12.
Experts warn that the proliferation of non-consensual deepfakes is outpacing global regulatory efforts. While celebrities like Taylor Swift and Emma Watson have been victims of deepfake porn, women not in the public eye are equally vulnerable. Jenna Sherman, campaign director at UltraViolet, stated, "These harms silence us online, violate our right to control our own image, and distort our elections" 12.
Leanna Garfield, social media safety program manager at GLAAD, emphasized the urgency of the situation: "The world's largest platforms have shown they are not equipped to handle the rise of AI-facilitated hate, harassment, and disinformation campaigns, including deepfakes and bots that can spew hate-based imagery at massive scale" 12.
As of now, the platforms have not responded to requests for comment ahead of the letter's release. The civil society groups stress the need for concrete action to ensure online safety for all users, particularly those most vulnerable to AI-driven harassment and disinformation 12.
Reference
Major AI companies have committed to developing technology to detect and prevent the creation of non-consensual deepfake pornography. This initiative, led by the White House, aims to address the growing concern of AI-generated explicit content.
8 Sources
8 Sources
A new study reveals that 1 in 6 congresswomen have been victims of AI-generated sexually explicit deepfakes, highlighting the urgent need for legislative action to combat this growing threat.
6 Sources
6 Sources
A surge in AI-generated deepfake pornography targeting female politicians worldwide is raising concerns about women's participation in public life and the integrity of democratic processes.
2 Sources
2 Sources
Artificial intelligence poses a significant threat to the integrity of the 2024 US elections. Experts warn about the potential for AI-generated misinformation to influence voters and disrupt the electoral process.
2 Sources
2 Sources
The rapid proliferation of AI-generated child sexual abuse material (CSAM) is overwhelming tech companies and law enforcement. This emerging crisis highlights the urgent need for improved regulation and detection methods in the digital age.
9 Sources
9 Sources
The Outpost is a comprehensive collection of curated artificial intelligence software tools that cater to the needs of small business owners, bloggers, artists, musicians, entrepreneurs, marketers, writers, and researchers.
© 2025 TheOutpost.AI All rights reserved