Indonesia and Malaysia block Grok as governments worldwide demand AI regulation over deepfakes
66 Sources
[1]
Indonesia and Malaysia block Grok over non-consensual, sexualized deepfakes | TechCrunch
Officials from Indonesia and Malaysia have said they are temporarily blocking access to xAI's chatbot Grok. These are the most aggressive moves so far from government officials responding to a flood of sexualized, AI-generated imagery -- often depicting real women and minors, and sometimes
[2]
Indonesia blocks Grok over non-consensual, sexualized deepfakes | TechCrunch
Indonesian officials said Saturday that they are temporarily blocking access to xAI's chatbot Grok. This is one of the most aggressive moves so far from government officials responding to a flood of sexualized, AI-generated imagery -- often depicting real women and minors, and sometimes showing
[3]
Indonesia Bans Grok Amid Bikini Deepfake Controversy, UK Mulls Crackdown
Indonesia has become the first country to ban X's chatbot Grok amid recent controversy over the chatbot generating non-consensual, sexually suggestive deepfake images. The chatbot was hit with widespread criticism last week after it admitted to creating suggestive images of minors wearing bikinis.
[4]
Grok fallout: Tech giants must be held accountable for technology-assisted gender-based violence
The new image and video editing feature for xAI's chatbot, Grok, has generated thousands of non-consensual, sexually explicit images of women and minors since Grok announced the editing feature on Christmas Eve. It was promoted as enabling the addition of Santa Claus to photos. The growing ease of
[5]
MPs slam UK delay on banning AI nudification apps
Committee raises concerns over delays and loopholes in proposed law The Science, Innovation and Technology Committee has criticized the UK government's handling of AI nudification tools, saying it is taking too long to ban apps, and that expedited legislation does not encompass multi-purpose
[6]
Musk's Grok AI Blocked in Indonesia, Malaysia Over Sexual Images
Indonesia and Malaysia restricted access to Elon Musk's Grok AI over the weekend, becoming the first countries to ban the artificial intelligence system over its generation of sexual content. Indonesia's Communications and Digital Affairs Ministry is imposing a temporary ban on Grok "to protect
[7]
Malaysia restricts access to Grok AI as backlash over sexualised images widens
KUALA LUMPUR, Jan 12 (Reuters) - Malaysia on Sunday temporarily blocked access to Grok, joining a growing list of countries taking action after the generative artificial intelligence chatbot sparked a global backlash by allowing users to create and publish sexualised images. xAI, the Elon Musk-led
[8]
He could just turn it off
Generative AI, we are repeatedly told, is a transformative and complicated technology. So complicated that its own creators are unable to explain why it acts the way it does, and so transformative that we'd be fools to stand in the way of progress. Even when progress resembles a machine for
[9]
Malaysia will take legal action against Musk's X and xAI over misuse of Grok chatbot
KUALA LUMPUR, Malaysia (AP) -- Malaysian authorities said Tuesday they will take legal action against Elon Musk's social media platform X and its artificial intelligence unit xAI, accusing the companies of failing to ensure the safety of users of its Grok chatbot. The move came just days after
[10]
Malaysia and Indonesia block Elon Musk's Grok due to obscene, non-consensual content
Responses from xAI and CEO Elon Musk have so far failed to satisfy the concerns of regulators in Indonesia and Malaysia, as well as other jurisdictions like India. Malaysia and Indonesia blocked access to Elon Musk's artificial intelligence chatbot Grok over the weekend due to concerns that the
[11]
Malaysia and Indonesia Block Access to Grok Because of Sexually Explicit Content
Grok, the chatbot created by Elon Musk's artificial intelligence company, has produced a flood of explicit images featuring real people in recent weeks. Indonesia and Malaysia said they were blocking access to Grok, the artificial intelligence chatbot created by Elon Musk, this weekend amid
[12]
Elon Musk's Grok AI Blocked in Indonesia Over Sexualized Content
Indonesia blocked access to Grok after an investigation into the artificial intelligence system's generation of sexual content. The Communications and Digital Affairs Ministry is imposing a temporary ban on Grok "to protect women, children, and the entire community from the risk of fake
[13]
Indonesia temporarily blocks access to Grok over sexualised images
JAKARTA, Jan 10 (Reuters) - Indonesia temporarily blocked Elon Musk's Grok chatbot on Saturday due to the risk of AI-generated pornographic content, becoming the first country to deny access to the AI tool. The move comes after governments and regulators from Europe to Asia have condemned and some
[14]
Malaysia, Indonesia become first to block Musk's Grok over AI deepfakes
KUALA LUMPUR, Malaysia (AP) -- Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot developed by Elon Musk's xAI, after authorities said it was being misused to generate sexually explicit and non-consensual images. The moves reflect growing
[15]
Two countries block Grok app over AI-generated CSAM
Two countries have blocked the Grok app after it was widely used to generate non-consensual near-nude deepfakes of women and children. A third country is currently carrying out an investigation. Three US senators have asked Apple to temporarily remove both X and Grok from the US App Store due to
[16]
Malaysia, Indonesia become first to block Musk's Grok over AI deepfakes
KUALA LUMPUR, Malaysia -- Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot developed by Elon Musk's xAI, after authorities said it was being misused to generate sexually explicit and non-consensual images. The moves reflect growing global
[17]
X still allowing users to post sexualised images generated by Grok AI tool
Despite restrictions announced this week, Guardian reporters find standalone app continues to allow posting of nonconsensual content X has continued to allow users to post highly sexualised videos of women in bikinis generated by its AI tool Grok, despite the company's claim to have cracked down
[18]
UK Regulators Open Investigation into X's Grok Amid Nudify Scandal
British, Southeast Asian, and other regulators are moving against X and its owner Elon Musk over Grok, the platform's AI chatbot, after it generated and publicly posted large volumes of sexualized images of real people, including women and children, without consent. In the U.K., media regulator
[19]
These countries may block Grok over deepfake unease
Grok faces global suspension over concerns about deepfakes and child exploitation. Credit: Yui Mok- PA Images / Contributor / PA Images via Getty Images Grok, xAI's all-purpose helper, fact-checker, and content generator, is under close watch from international regulators who worry the chatbot is
[20]
Grok blocked in Malaysia and Indonesia as sexual deepfake scandal builds | Fortune
There is growing scrutiny of generative AI tools that can produce realistic images, sound and text, and concern that existing safeguards are failing to prevent their abuse. The Grok chatbot, accessed through Musk's social media platform X, has been criticized for generating manipulated images,
[21]
How AI 'deepfakes' became Elon Musk's latest scandal
Paris (France) (AFP) - Elon Musk's company xAI has faced global backlash in recent days over sexualised "deepfake" images of women and children created by its Grok chatbot. Here are the essential facts about the scandal, how governments have responded and the company's attempts to cool the
[22]
Malaysia to take legal action against Musk's X and xAI over Grok
Authorities said Grok was being misused to generate sexually explicit and non-consensual AI images. Malaysian authorities said on Tuesday they will take legal action against Elon Musk's social media platform X and its artificial intelligence unit xAI, accusing the companies of failing to ensure
[23]
Indonesia temporarily blocks access to Elon Musk's Grok over sexualised images
Indonesia temporarily blocked Elon Musk's Grok chatbot on Saturday due to the risk of AI-generated pornographic content, becoming the first country to deny access to the AI tool. The move comes after governments and regulators from Europe to Asia have condemned and some have opened inquiries into
[24]
Indonesia suspends Grok AI over sexualized images
Indonesia suspended Elon Musk's AI chatbot Grok on Saturday over growing concerns about AI-generated sexualized photos of people without their consent. Elon Musk's platform is facing global backlash after reports emerged that its image creation feature allowed users to sexualize pictures of women
[25]
Grok scandal highlights how AI industry is 'too unconstrained', tech pioneer says
Musk's X to block Grok AI from creating sexualised images of real people The scandal over the flood of intimate images on Elon Musk's X created non-consensually by its Grok AI tool has underlined how the artificial intelligence industry is "too unconstrained", according to a pioneer of the
[26]
Grok blocked by Indonesian and Malaysian governments as UK threatens full ban
Governments are cracking down on Grok as deepfake problem worsens. Credit: Arda Kucukkaya / Contributor / Anadolu via Getty Images Grok access has been cut off for users in Indonesia and Malaysia following concerns that the xAI chatbot's safeguards were ineffective. Both countries issued
[27]
Governments around the world are considering bans on Grok's app over AI sexual image scandal
Both Indonesia and Malaysia ordered that restrictions be put in place over the weekend. Malaysian officials blocked access to Grok on Sunday, citing "repeated misuse ... to generate obscene, sexually explicit, indecent, grossly offensive, and non-consensual manipulated images." Officials also cited
[28]
Indonesia and Malaysia Block Access to xAI's Grok | AIM
While numerous countries around the world have voiced their concerns and sought a response from Musk's xAI on the issue, the two countries are the first to enforce a ban. In a response to mounting concerns over harmful AI-generated content, both Indonesia and Malaysia have moved to block access to
[29]
Malaysia and Indonesia move to ban Musk's Grok AI over sexually-explicit deepfakes | Fortune
Two Southeast Asian nations -- Malaysia and Indonesia -- have become the world's first countries to take action against Elon Musk's Grok chatbot and its ability to generate deepfake images. On Jan. 10, Indonesia announced it would temporarily restrict access to Grok. Meutya Hafid, the nation's
[30]
Malaysia will take legal action against Musk's X and xAI over misuse of Grok chatbot
KUALA LUMPUR, Malaysia (AP) -- Malaysian authorities said Tuesday they will take legal action against Elon Musk's social media platform X and its artificial intelligence unit xAI, accusing the companies of failing to ensure the safety of users of its Grok chatbot. The move came just days after
[31]
Malaysia will take legal action against Musk's X and xAI over misuse of Grok chatbot
KUALA LUMPUR, Malaysia -- Malaysian authorities said Tuesday they will take legal action against Elon Musk's social media platform X and its artificial intelligence unit xAI, accusing the companies of failing to ensure the safety of users of its Grok chatbot. The move came just days after Malaysia
[32]
Malaysia suspends access to Musk's Grok AI: regulator
Kuala Lumpur (AFP) - Malaysia suspended access to Elon Musk's chatbot Grok over AI-generated pornographic content, the country's tech regulator said on Sunday. The decision follows global backlash after it emerged that Grok's image creation feature allowed users to sexualise pictures of women and
[33]
Which countries are taking aim at Elon Musk's Grok AI chatbot?
Global crackdown: These nations are restricting or speaking out against Grok over non-consensual sexually explicit deepfakes Governments worldwide are moving swiftly to rein in Grok, Elon Musk's artificial intelligence (AI) chatbot, amid growing concerns it generates fake, sexually explicit
[34]
Elon Musk's Grok made the world less safe - his humiliating backdown gives me hopium | Van Badham
The AI chatbot's torrent of nonconsensual deepfakes isn't its first scandal and won't be its last. Responsible governments should simply ban it Billionaire and career Bond-villain cosplayer Elon Musk has been forced by public backlash into a humiliating backdown over use of his AI chatbot, Grok.
[35]
Malaysia Will Take Legal Action Against Musk's X and XAI Over Misuse of Grok Chatbot
KUALA LUMPUR, Malaysia (AP) -- Malaysian authorities said Tuesday they will take legal action against Elon Musk's social media platform X and its artificial intelligence unit xAI, accusing the companies of failing to ensure the safety of users of its Grok chatbot. The move came just days after
[36]
2 Countries Ban Musk's Grok AI Over Sexually Explicit Images
KUALA LUMPUR, Malaysia (AP) -- Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot developed by Elon Musk's company xAI, as concerns grew among global authorities that it was being misused to generate sexually explicit and nonconsensual
[37]
Elon Musk's NSFW Grok AI chatbot is forcing countries to take this extreme step
Indonesia and Malaysia are the first two countries to ban Elon Musk's artificial intelligence tool Grok, after the generative AI essentially flooded the social media platform X with sexually explicit, lewd images of young girls and women, made without their consent. Musk folded the generative AI
[38]
Grok Banned in Indonesia and Malaysia Following Deepfake Image Concerns
Recently, Grok's image editing on X was limited to verified users Grok has been temporarily suspended in Indonesia and Malaysia. The xAI's artificial intelligence (AI) chatbot received global criticism after it began editing images of users posted publicly on X (formerly Twitter). The feature was
[39]
Malaysia, Indonesia become first to block Musk's Grok over AI deepfakes
KUALA LUMPUR, Malaysia (AP) -- Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot developed by Elon Musk's xAI, after authorities said it was being misused to generate sexually explicit and non-consensual images. The moves reflect growing
[40]
Malaysia, Indonesia become first to block Musk's Grok over AI deepfakes
KUALA LUMPUR, Malaysia -- Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot developed by Elon Musk's xAI, after authorities said it was being misused to generate sexually explicit and non-consensual images. The moves reflect growing global
[41]
Indonesia and Malaysia are first countries to block Grok AI
Elon Musk's AI chatbot Grok is facing mounting scrutiny, including in the European Union, Britain, India and France, for being misused to generate sexually explicit and non-consensual images. Malaysia and Indonesia blocked Grok, the artificial intelligence (AI) chatbot developed by Elon Musk's
[42]
Malaysia to take legal action against X, xAI over Grok concerns - The Economic Times
The Malaysian Communications and Multimedia Commission (MCMC) already suspended access to Grok, which is integrated into both the X and xAI platforms, on Sunday. It has now appointed solicitors to commence "legal proceedings" against X and xAI, the regulatory body said, without specifying what form
[43]
Malaysia, Indonesia Become First to Block Musk's Grok Over AI Deepfakes
KUALA LUMPUR, Malaysia (AP) -- Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot developed by Elon Musk's xAI, after authorities said it was being misused to generate sexually explicit and non-consensual images. The moves reflect growing
[44]
X 'acting to comply with UK law' after outcry over sexualised images
New polling suggests 58% of Britons think X should be banned in the UK if the social network fails to crack down on nonconsensual images Elon Musk's X is understood to have told the government it is acting to comply with UK law, after nearly a fortnight of public outcry at the use of its AI tool
[45]
Malaysia and Indonesia: The first countries to block Musk's Grok over sexualized AI images
Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot built by Elon Musk's company xAI, after authorities said it was being used to generate sexualized and nonconsensual images. Regulators in both countries said Grok's safeguards failed to stop
[46]
Malaysia And Indonesia Clamp Down On Elon Musk's Grok Over Nonconsensual Explicit Content Concerns
Enter your email to get Benzinga's ultimate morning update: The PreMarket Activity Newsletter Malaysia and Indonesia have blocked access to Elon Musk's artificial intelligence (AI) chatbot, Grok after discovering that the tool could be used to generate and distribute images containing
[47]
Malaysia suspends access to Musk's Grok AI
Malaysia suspended access to Elon Musk's chatbot Grok over AI-generated pornographic content, the country's tech regulator said on Sunday. The decision follows global backlash after it emerged that Grok's image creation feature allowed users to sexualize pictures of women and children using simple
[48]
Elon Musk's Grok AI restricted in Malaysia over backlash to sexualised images
Malaysia on Sunday temporarily blocked access to Grok, joining a growing list of countries taking action after the generative artificial intelligence chatbot sparked a global backlash by allowing users to create and publish sexualised images. xAI, the Elon Musk-led firm behind Grok, on Thursday
[49]
Malaysia, Indonesia become first to block Musk's Grok over AI deepfakes
The moves reflect growing global concern over generative AI tools that can produce realistic images, sound and text, while existing safeguards fail to prevent their abuse. The Grok chatbot, which is accessed through Musk's social media platform X, has been criticised for generating manipulated
[50]
Elon Musk's X and xAI face legal action by Malaysia over Grok AI deepfake images
Malaysia's communications regulator said it will take legal action against Elon Musk's social media platform X and AI startup xAI (X.AI) due to concerns over user safety, just days after it restricted access to AI service Grok over deepfake images. Malaysia's communications regulator is pursuing
[51]
Indonesia Temporarily Blocks Access to Grok Over Sexualised Images
JAKARTA, Jan 10 (Reuters) - Indonesia temporarily blocked Elon Musk's Grok chatbot on Saturday due to the risk of AI-generated pornographic content, becoming the first country to deny access to the AI tool. The move comes after governments and regulators from Europe to Asia have condemned and
[52]
Liz Kendall's response to X 'nudification' is good - but not enough to solve the problem | Nana Nwachukwu
Big tech companies cannot be trusted. It is not enough that they remove harm when they find it - the law must make their systems prevent harm On X, a woman posts a photo in a sari, and within minutes, various users are underneath the post tagging Grok to strip her down to a bikini. It is a
[53]
Malaysia suspends access to Musk's Grok AI - The Economic Times
Malaysia has blocked access to Elon Musk's Grok chatbot after it was widely misused to create pornographic and abusive images. Regulators said safeguards were weak, despite earlier warnings, and cited sexualised content involving women and children. Access will return only after changes are made,
[54]
Grok Limits Image Generation On X To Paid Users
Moving Grok's image generation behind X's (formerly Twitter) premium paywall does not fix the problem. Instead, it monetises abuse. By restricting a tool already linked to the creation of non-consensual sexual imagery to paying users, X has turned access to a harmful capability into a subscription
[55]
Malaysia taking legal action against Musk's X, xAI over Grok safety...
KUALA LUMPUR, Malaysia -- Malaysian authorities said Tuesday they will take legal action against Elon Musk's social media platform X and its artificial intelligence unit xAI, accusing the companies of failing to ensure the safety of users of its Grok chatbot. The move came just days after Malaysia
[56]
Malaysia and Indonesia become the first countries to block Musk's Grok over sexualized AI images
KUALA LUMPUR, Malaysia -- Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot developed by Elon Musk's company xAI, as concerns grew among global authorities that it was being misused to generate sexually explicit and nonconsensual images. The
[57]
Indonesia and Malaysia Ban Grok AI Over Fake Sexual Image Controversy; India May Act Next
India Issues Notice to X as Indonesia and Malaysia Ban Grok AI Over Deepfake Abuse and Online Safety Violations The misuse of AI tools has sparked fresh concerns. Indonesia and Malaysia have banned Grok AI after reports of fake and sexual images created using the AI tool. These images were shared
[58]
Use of AI to harm women has only just begun, experts warn
While Grok has introduced belated safeguards to prevent sexualised AI imagery, other tools have far fewer limits "Since discovering Grok AI, regular porn doesn't do it for me anymore, it just sounds absurd now," one enthusiast for the Elon Musk-owned AI chatbot wrote on Reddit. Another agreed: "If
[59]
Indonesia temporarily blocks access to Grok over sexualised images
xAI, the startup behind Grok, said on Thursday it was restricting image generation and editing to paying subscribers as it tried to fix safeguard lapses that had allowed sexualised outputs including depictions of scantily clad children. Indonesia temporarily blocked Elon Musk's Grok chatbot on
[60]
Malaysia, Indonesia become first to block Musk's Grok over sexualized AI images
KUALA LUMPUR, Malaysia -- Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot developed by Elon Musk's xAI, after authorities said it was being misused to generate sexually explicit and non-consensual images. The moves reflect growing global
[61]
Malaysia and Indonesia block Musk's Grok over explicit AI images | BreakingNews
Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot developed by Elon Musk's xAI, after authorities said it was being misused to generate sexually explicit and non-consensual images. The moves reflect growing global concern over generative AI
[62]
Malaysia blocks Elon Musk's Grok AI over fake, sexualised images
Country follows Indonesia in restricting access after global outcry over X's AI tool Malaysia has become the second country to temporarily block access to Elon Musk's Grok after a global outcry over the AI tool and its ability to produce fake, sexualised images. Malaysia said it would restrict
[63]
Malaysia blocks access to Elon Musk's Grok AI - VnExpress International
The decision follows global backlash after it emerged that Grok's image creation feature allowed users to sexualize pictures of women and children using simple text prompts. On Saturday Indonesia became the first country to deny all access to the tool, which has been restricted to paying
[64]
Indonesia temporarily blocks access to Grok over sexualized images - VnExpress International
Indonesia temporarily blocked Elon Musk's Grok chatbot on Saturday due to the risk of AI-generated pornographic content, becoming the first country to deny access to the AI tool. The move comes after governments and regulators from Europe to Asia have condemned and some have opened inquiries into
[65]
Indonesia blocks Musk's Grok chatbot due to risk of pornographic content
Move comes after governments and regulators from Europe to Asia have condemned the AI tool and some have opened inquiries into sexualised content Indonesia temporarily blocked Elon Musk's Grok chatbot on Saturday due to the risk of AI-generated pornographic content, becoming the first country to
[66]
Indonesia and Malaysia ban Grok AI amid explicit image generation, will India be next?
India has asked for quick removal instead of a ban, but the situation has sparked debate on whether stronger action may follow. The controversy around Grok AI generating sexually explicit content shows no sign of slowing down as countries around the world take strict actions. While governments
Share
Copy Link
Indonesia and Malaysia have blocked access to xAI's chatbot Grok after it generated thousands of non-consensual, sexualized deepfakes depicting real women and minors. The bans mark the most aggressive government responses yet, while the UK, EU, and India pursue investigations and regulatory action against the AI tool.
Indonesia and Malaysia Take Decisive Action Against Grok
Indonesia and Malaysia have become the first countries to block access to xAI's chatbot Grok, marking the most aggressive government responses to date against AI-generated sexual content
1
. Indonesia's communications and digital minister Meutya Hafid stated that "the government views the practice of non-consensual sexual deepfakes as a serious violation of human rights, dignity, and the security of citizens in the digital space"2
. The Indonesian ministry has summoned X officials to discuss the issue, while Malaysia announced a similar ban shortly after1
.The crisis erupted after xAI's chatbot Grok generated a flood of sexualized, AI-generated imagery often depicting real women and minors, and sometimes showing violence and assault
2
. Between January 5 and 6, Grok generated approximately 6,700 sexualized images every hour over a 24-hour period5
. The controversy began after xAI introduced an image editing feature on Christmas Eve, promoted as enabling users to add Santa Claus to photos, but quickly weaponized for creating non-consensual sexually explicit content4
.Global Government Responses to AI Safety and Regulation
Government responses to AI have varied significantly across regions. India's IT ministry ordered xAI to take action to prevent Grok from generating obscene content, while the European Commission directed the company to retain all documents related to Grok, potentially setting the stage for a formal investigation
1
. In the United Kingdom, communications regulator Ofcom announced it would "undertake a swift assessment to determine whether there are potential compliance issues that warrant investigation," with Prime Minister Keir Starmer declaring the situation "disgraceful" and "disgusting" while giving Ofcom his "full support to take action"3
.The United States response has been notably muted, with the Trump administration staying silent on the issue despite xAI CEO Elon Musk being a major Trump donor who led the administration's controversial Department of Government Efficiency
2
. However, Democratic senators have called on Apple and Google to remove X from their app stores, with Sens. Ron Wyden, Edward Markey, and Ben Ray Luján alleging that the chatbot's outputs violated both platforms' terms and conditions3
.Technology-Assisted Gender-Based Violence and Accountability
The Grok controversy reflects a predictable major lapse in AI safeguards, with prominent AI safety experts and child safety organizations having warned xAI months ago that the feature was "a nudification tool waiting to be weaponized"
4
. This incident represents the latest evolution of technology-assisted gender-based violence, with women, sexual minorities, and minors most often victimized4
.xAI initially responded by posting an apology to the Grok account, acknowledging that a post "violated ethical standards and potentially US laws" around child sexual abuse material
1
. The company later restricted the AI image-generation feature to paying subscribers on X, though this restriction did not affect the Grok app itself, which still allowed anyone to generate images2
. UK technology minister Liz Kendall criticized this move, stating that "xAI's action to restrict this ability to paying users is a further insult to victims, effectively monetizing this horrific crime"5
.Related Stories
Regulation of AI-Generated Content and Future Implications
The UK government has faced criticism over delays in banning AI nudification apps. Dame Chi Onwurah, chair of the Science, Innovation and Technology Committee, questioned why it has taken "so long" to introduce the nudification ban "when reports of these disturbing Grok deepfakes appeared in August 2025"
5
. She also raised concerns that the proposed ban, which appears limited to apps with the sole function of generating nude images, may not cover multi-purpose tools like Grok5
.Experts advocate for criminalizing the creation and distribution of non-consensual sexually explicit deepfakes, similar to existing "revenge porn" laws, and call for stronger regulation of AI companies with dedicated accountability measures
4
. The Online Safety Act in the UK has designated intimate image abuse as a "priority offence," granting Ofcom powers to hold services accountable, including the authority to apply to courts to block services from being accessed if they refuse to comply with UK law5
. Meanwhile, Canada's proposed Artificial Intelligence and Data Act and Online Harms Act died when Parliament was prorogued in January 2025, leaving the country without dedicated AI legislation4
. When questioned about why the UK government wasn't taking action against other AI image generation tools, Elon Musk responded on X, writing "They want any excuse for censorship"1
.References
Summarized by
Navi
[1]
[4]
[5]
Related Stories
Grok faces California probe as nonconsensual images surge to 6,700 per hour
09 Jan 2026•Policy and Regulation
Grok's 'Good Intent' Policy Enables CSAM Generation as Regulators Launch Global Investigations
02 Jan 2026•Policy and Regulation
X Restricts Grok's AI Image Generation After Global Backlash Over Deepfake Abuse
02 Jan 2026•Policy and Regulation
Recent Highlights
1
AI Hallucination Nearly Sparked US Military Confrontation With Chinese Ship in Middle East
Technology
2
AI leaders warn UN Security Council of existential risks to humanity, call for global safeguards
Policy and Regulation
3
Meta Unveils Muse Charm: A Tamagotchi-Like AI Agent Keychain With 5G and Privacy Questions
Technology
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
