OpenAI Confirms ChatGPT Abuse by Hackers for Malware and Election Interference
15 Sources
[1]
OpenAI confirms threat actors use ChatGPT to write malware
OpenAI has disrupted over 20 malicious cyber operations abusing its AI-powered chatbot, ChatGPT, for debugging and developing malware, spreading misinformation, evading detection, and conducting spear-phishing attacks. The report, which focuses on operations since the beginning of the year,
[2]
Chinese and Iranian hackers use ChatGPT and LLM tools to create malware and phishing attacks -- OpenAI report has recorded over 20 cyberattacks created with ChatGPT
OpenAI says it will be working with the community to avoid such exploits. If there's one sign that AI is more trouble than it is worth, OpenAI confirms that over twenty cyberattacks have occurred, all created via ChatGPT. The report confirms that generative AI was used to conduct spear-phishing
[3]
OpenAI says it shuts down multiple campaigns using its systems for cybercrime
Hackers are using ChatGPT to try to influence elections around the world OpenAI, the company behind the famed Chat-GPT generative Artificial Intelligence (AI) solution, says it has recently blocked multiple malicious campaigns abusing its services. In a report, the company said it blocked more
[4]
Using ChatGPT to make fake social media posts backfires on bad actors
OpenAI claims cyber threats are easier to detect when attackers use ChatGPT. Using ChatGPT to research cyber threats has backfired on bad actors, OpenAI revealed in a report analyzing emerging trends in how AI is currently amplifying online security risks. Not only do ChatGPT prompts expose what
[5]
OpenAI says cybercriminals are using ChatGPT more to influence elections
OpenAI has seen a number of attempts where its AI models have been used to generate fake content, including long-form articles and social media comments, aimed at influencing elections, the ChatGPT maker said in a report on Wednesday. Cybercriminals are increasingly using AI tools, including
[6]
Bad Actors Use OpenAI in Attempt to Manipulate Elections
Cybercriminals are increasingly using AI tools, including ChatGPT, to aid in their malicious activities such as creating and debugging malware, and generating fake content for websites and social media platforms, the startup said. So far this year it neutralized more than 20 such attempts,
[7]
OpenAI Blocks 20 Global Malicious Campaigns Using AI for Cybercrime and Disinformation
OpenAI on Wednesday said it has disrupted more than 20 operations and deceptive networks across the world that attempted to use its platform for malicious purposes since the start of the year. This activity encompassed debugging malware, writing articles for websites, generating biographies for
[8]
Propagandists around the world keep trying to use ChatGPT, according to OpenAI report
The report said groups seeking to influence elections were trying to automate tasks with the AI tool but had struggled make meaningful breakthroughs. Propagandists seeking to influence elections around the globe have tried to use ChatGPT in their operations, according to a report released
[9]
OpenAI sees continued attempts to use AI models for election interference
OpenAI has seen continued attempts by cybercriminals to use its artificial intelligence (AI) models for fake content aimed at interfering with this year's elections, the ChatGPT maker said in a new report. According to OpenAI's report, released Wednesday, the AI developer discovered and disrupted
[10]
OpenAI says bad actors are using its platform to disrupt elections, but with little 'viral engagement'
Big technology companies are betting that a new wave of smaller, more precise AI models will be more effective when it comes to the needs of businesses in sectors like law, finance, and health care. OpenAI is increasingly becoming a platform of choice for cyber actors looking to influence
[11]
OpenAI sees increasing use of its AI models for influencing elections
Oct 9 (Reuters) - OpenAI has seen a number of attempts where its AI models have been used to generate fake content, including long-form articles and social media comments, aimed at influencing elections, the ChatGPT maker said in a report on Wednesday. Cybercriminals are increasingly using AI
[12]
OpenAI Sees Increasing Use of Its AI Models for Influencing Elections
(Reuters) - OpenAI has seen a number of attempts where its AI models have been used to generate fake content, including long-form articles and social media comments, aimed at influencing elections, the ChatGPT maker said in a report on Wednesday. Cybercriminals are increasingly using AI tools,
[13]
OpenAI sees increasing use of its AI models for influencing elections
(Reuters) - OpenAI has seen a number of attempts where its AI models have been used to generate fake content, including long-form articles and social media comments, aimed at influencing elections, the ChatGPT maker said in a report on Wednesday. Cybercriminals are increasingly using AI tools,
[14]
OpenAI: How ChatGPT Could Be Used to Manipulate US Elections
ChatGPT can be used to automate engagement and interaction on social media platforms. ChatGPT can be used to give responses to users over social media, participate in discussions, and spread misinformation in real time. This automation can create an illusion of widespread support or opposition.
[15]
Ahead Of Trump Vs. Harris Faceoff, ChatGPT Parent OpenAI Uncovers Election Interference Misuse, But Sees No 'Meaningful Breakthrough' - Microsoft (NASDAQ:MSFT), Alphabet (NASDAQ:GOOGL)
ChatGPT-parent OpenAI has disclosed that its platform is being misused by malicious entities to meddle with democratic elections across the globe. What Happened: According to the 54-page report published on Wednesday, OpenAI has thwarted over 20 global operations and deceptive networks that sought
Share
Copy Link
OpenAI reports multiple instances of ChatGPT being used by cybercriminals to create malware, conduct phishing attacks, and attempt to influence elections. The company has disrupted over 20 such operations in 2024.
OpenAI Confirms Abuse of ChatGPT by Cybercriminals
OpenAI, the company behind the popular AI chatbot ChatGPT, has released a report confirming that threat actors are using its AI-powered tool to enhance their malicious cyber operations. The company has disrupted over 20 such operations since the beginning of 2024, marking the first official confirmation of mainstream AI tools being used for offensive cyber activities
1
2
.Malware Development and Debugging
Several threat groups have been identified using ChatGPT for malware-related activities. Chinese and Iranian hackers were found leveraging the AI tool to debug existing malware, develop new malicious software, and create supporting infrastructure for their operations
1
2
.One notable case involves the Iranian group Storm-0817, which used ChatGPT to develop custom malware for Android devices. This malware can steal contact lists, call logs, browser history, and access files on infected devices, as well as obtain precise location data
1
4
.Phishing and Social Engineering
OpenAI reported that a Chinese threat actor, dubbed 'SweetSpecter', targeted the company directly with spear-phishing emails. These emails contained malicious ZIP attachments disguised as support requests, which, if opened, would trigger an infection chain leading to the deployment of SugarGh0st RAT on the victim's system
1
4
.Election Interference Attempts
Perhaps most concerning is the use of ChatGPT in attempts to influence elections worldwide. OpenAI has observed multiple instances where its AI models were used to generate fake content, including long-form articles and social media comments, aimed at swaying public opinion during election periods
3
5
.Specific examples include:
- An Israeli-based commercial company briefly generated social media comments about elections in India
3
. - An operation called "A2Z" focused on Azerbaijan and its neighbors just before the European Parliament elections
3
. - Generation of comments about elections in France, Italy, Poland, Germany, and the US
3
. - Accounts from Rwanda used to generate comments about local elections for posting on social media platforms
5
.
Related Stories
OpenAI's Response and Industry Implications
OpenAI has taken swift action by banning all accounts associated with these malicious activities and sharing indicators of compromise with cybersecurity partners
1
. The company emphasizes that while these incidents don't represent new capabilities in malware development, they demonstrate how AI tools can make offensive operations more efficient for low-skilled actors1
2
.OpenAI maintains that the majority of AI-generated social media posts received little to no engagement, and many operations ceased entirely after access to the AI models was blocked
3
. However, the company acknowledges the need for continued vigilance and improvement of AI safeguards2
.Future Concerns and Mitigation Efforts
As 2024 is a significant election year globally, there are growing concerns about the potential misuse of AI in influencing public opinion. OpenAI has committed to working with internal safety and security teams, as well as sharing findings with industry peers and the research community to prevent such abuses
2
3
.The incidents highlight the double-edged nature of AI technology, showcasing both its potential for misuse and its ability to help detect and prevent cyber threats. As AI continues to evolve, it will be crucial for companies like OpenAI to stay ahead of bad actors and implement robust security measures to protect users and maintain the integrity of democratic processes worldwide.
References
Summarized by
Navi
[1]
Related Stories
OpenAI Uncovers Global AI Misuse in Cyber Operations and Influence Campaigns
06 Jun 2025•Technology
OpenAI Disrupts Malicious AI Use by State-Sponsored and Cybercriminal Groups
07 Oct 2025•Technology
OpenAI Cracks Down on ChatGPT Misuse: Bans Accounts Linked to Surveillance and Influence Campaigns
22 Feb 2025•Technology
Recent Highlights
1
AI Leaders Warn UN Security Council of Existential Risks, Call for Global AI Governance
Policy and Regulation
2
AI Hallucination Nearly Sparked US Military Confrontation With Chinese Ship in Middle East
Technology
3
OpenAI AI Agent Breaches Australian Government Healthcare Portal in Historic Hack
Technology
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
