Google Reports AI-Generated Deepfake Terrorism and Child Abuse Content Complaints to Australian Regulator

Google reports scale of complaints about AI deepfake terrorism content to Australian regulator

SYDNEY (Reuters) - Google has informed Australian authorities it received more than 250 complaints globally over nearly a year that its artificial intelligence software was used to make deepfake terrorism material. The Alphabet-owned tech giant also said it had received dozens of user reports warning that its AI program, Gemini, was being used to create child abuse material, according to the Australian eSafety Commission. Under Australian law, tech firms must supply the eSafety Commission periodically with information about harm minimisation efforts or risk fines. The reporting period covered April 2023 to February 2024. Since OpenAI's ChatGPT exploded into the public consciousness in late 2022, regulators around the world have called for better guardrails so AI can't be used to enable terrorism, fraud, deepfake pornography and other abuse. The Australian eSafety Commission called Google's disclosure "world-first insight" into how users may be exploiting the technology to produce harmful and illegal content. "This underscores how critical it is for companies developing AI products to build in and test the efficacy of safeguards to prevent this type of material from being generated," eSafety Commissioner Julie Inman Grant said in a statement. In its report, Google said it received 258 user reports about suspected AI-generated deepfake terrorist or violent extremist content made using Gemini, and another 86 user reports alleging AI-generated child exploitation or abuse material. It did not say how many of the complaints it verified, according to the regulator. Google used hatch-matching - a system of automatically matching newly-uploaded images with already-known images - to identify and remove child abuse material made with Gemini. But it did not use the same system to weed out terrorist or violent extremist material generated with Gemini, the regulator added. The regulator has fined Telegram and Twitter, later renamed X, for what it called shortcomings in their reports. X has lost one appeal about its fine of A$610,500 ($382,000) but plans to appeal again. Telegram also plans to challenge its fine.

Google reports scale of complaints about AI deepfake terrorism content to Australian regulator

SYDNEY, March 6 (Reuters) - Google has informed Australian authorities it received more than 250 complaints globally over nearly a year that its artificial intelligence software was used to make deepfake terrorism material. The Alphabet-owned (GOOGL.O), opens new tab tech giant also said it had received dozens of user reports warning that its AI program, Gemini, was being used to create child abuse material, according to the Australian eSafety Commission. Under Australian law, tech firms must supply the eSafety Commission periodically with information about harm minimisation efforts or risk fines. The reporting period covered April 2023 to February 2024. Since OpenAI's ChatGPT exploded into the public consciousness in late 2022, regulators around the world have called for better guardrails so AI can't be used to enable terrorism, fraud, deepfake pornography and other abuse. The Australian eSafety Commission called Google's disclosure "world-first insight" into how users may be exploiting the technology to produce harmful and illegal content. "This underscores how critical it is for companies developing AI products to build in and test the efficacy of safeguards to prevent this type of material from being generated," eSafety Commissioner Julie Inman Grant said in a statement. In its report, Google said it received 258 user reports about suspected AI-generated deepfake terrorist or violent extremist content made using Gemini, and another 86 user reports alleging AI-generated child exploitation or abuse material. It did not say how many of the complaints it verified, according to the regulator. Google used hatch-matching - a system of automatically matching newly-uploaded images with already-known images - to identify and remove child abuse material made with Gemini. But it did not use the same system to weed out terrorist or violent extremist material generated with Gemini, the regulator added. The regulator has fined Telegram and Twitter, later renamed X, for what it called shortcomings in their reports. X has lost one appeal about its fine of A$610,500 ($382,000) but plans to appeal again. Telegram also plans to challenge its fine. Reporting by Byron Kaye; Editing by Edwina Gibbs Our Standards: The Thomson Reuters Trust Principles., opens new tab Suggested Topics:Artificial IntelligencePublic Health

Google Gemini linked to AI-generated deepfake porn, terrorist content

Gift 5 articles to anyone you choose each month when you subscribe. Google's generative artificial intelligence bot Gemini is potentially being used to create deepfake child pornography as well as terrorist and violent extremist material, according to data in a report from the eSafety Commissioner. The report reveals that Google has received 86 reports from users around the world about suspected synthetic child sexual exploitation and abuse material generated by the AI text and image generator between April 2023 to February 2024. Over the same period, Gemini users reported 258 instances of potential deepfake terrorist and violent extremist material.