OpenAI Disrupts Cambodia-Based ChatGPT Scam Network Targeting Hundreds of Victims

OpenAI Disrupts Poipet Scam Network Using ChatGPT Across Multiple Fraud Schemes

OpenAI said it disrupted a Cambodia-based scam operation that used its generative artificial intelligence (AI) chatbot ChatGPT to facilitate a wide range of investment, romance, gambling, and law enforcement impersonation schemes. To that end, it banned a coordinated network of ChatGPT accounts likely originating from Southeast Asia and operating from the city of Poipet, a region with extensive ties to scam compounds and human trafficking in the past. The cluster of accounts is said to have used OpenAI's models to create and support the operation of fake online personas, generate and translate messages sent to scam targets, create promotional content for their fraudulent schemes, and assist with day-to-day activities. The promotional content included creating social media advertisements for "chatter" jobs in Poipet specifically targeting users in Bangladesh and India that promised a base salary of $800 (and a bonus of $100 for "full attendance"), along with flight tickets, free accommodation, meals, 1-year Cambodia visas, and work permits. A subset of these accounts have also been found to leverage the AI tool for administrative work, such as drafting internal announcements, translating messages between staff, and documenting employee debts, salary deductions, fines, loan repayments, visa overstays, work permits, immigration status, and recruitment incentives. The AI upstart said it investigated the operation in partnership with Meta-owned WhatsApp. "The operation illustrates an important reality about modern scam networks: organized criminal groups rarely restrict themselves to a single type of scam," OpenAI said. "Instead, they opportunistically employ whatever narratives, personas, and tactics they think will be most effective to deceive victims." The threat actors behind the network conducted various types of scams in parallel, blending techniques from different schemes to increase the likelihood of success of their illicit activities. Besides using dating personas to build trust before trapping victims into fraudulent investment opportunities involving cryptocurrencies and spot gold trading, the actors engaged in extended romantic conversations with targets using synthetic identities or posing as representatives of online gambling platforms that purported to offer fake bonuses and winnings. Other users that are part of the cluster impersonated law enforcement agencies to induce a false sense of urgency and inform targets they needed to pay fines for committing serious criminal offenses. To pull these off, the network created and operated fake dating profiles, fictitious investment experts, and fraudulent law enforcement personas, while also generating images of forged documents, including passports, as well as legal notices, stock-purchase confirmations, and gambling platform interfaces. The attack chain, per OpenAI, follows a three-step approach called ping-zing-sting, where the scammers undertake initial outreach on messaging platforms like WhatsApp and Telegram and engage in a trust-building exercise, before instructing victims to make deposits, pay activation fees, or settle non-existent fines. The targets are then provided fake screenshots of transfers or account information as proof of payment. Some accounts in the network generated content that is consistent with human trafficking and forced labor associated with organized crime groups in East Asia. The threat actors are known to recruit people with false promises of lucrative jobs, only to confiscate their passports and force them to work in slave-like conditions. "The full scale of financial losses associated with the network is unknown, but based on the scammers' own communications, the operation may have interacted with hundreds of targets across multiple scam types," OpenAI said. "User conversations referenced individual victims losing thousands of dollars, although we are unable to independently verify those claims." The development signals how threat actors are developing AI-augmented offensive capabilities that enable them to dramatically increase the speed and scale of their campaigns, even as the frontier models themselves have been caught targeting real systems and individuals during Capture-the-Flag (CTF)-style cyber evaluations.

OpenAI says it stopped an Asian scam campaign hijacking ChatGPT to lure in victims

* OpenAI disrupted a major scam campaign in Cambodia's Poipet, banning accounts and blocking new registrations * Criminals used ChatGPT to run romance fraud, fake investments, bogus police scams, and even operations linked to human trafficking * AI was leveraged for fake personas, fraudulent messages, job lures, and worker administration; OpenAI shared findings with authorities after evidence of hundreds of victims losing thousands of dollars OpenAI said it disrupted a major scam campaign coming out of Southeast Asia by banning accounts used by the operation and making it difficult to open new ones. In a blog post, the ChatGPT maker said it was tipped off about the existence of the campaign by WhatsApp. After investigating further, the company found that a group of criminals in Cambodia used its AI tool in different scam campaigns - romance fraud, fake investment scams, or bogus police investigations. It also used AI to help with day-to-day operations and, most worryingly, for things that could be related to human trafficking and forced criminality. Detention and escape attempts OpenAI did not say if the group had a name, just that it operated out of Poipet, "a city in Banteay Meanchey province that public reporting⁠ has repeatedly⁠ linked⁠ to online scam compounds and trafficking operations." The group used AI to create fake personas, to help draft fraudulent emails and chat messages, and to create posters for fake jobs which were probably used to lure people into human trafficking or forced labor. The tool was also used for worker administration, since the operators maintained records of employee debts, salary deductions, disciplinary fines, and loan repayments. They also used the tool to translate discussions about immigration status, work permits, visa overstays, and recruitment incentives. "Some conversations also referenced apparent detention, escape attempts, and potential criminal liability for people who had been trafficked and forced to work in scam operations," OpenAI said. "While these conversations do not allow us to determine the circumstances of any particular individual, they are consistent with extensive public reporting⁠ describing⁠ the activities of organized crime groups in Southeast Asia." The company could not say how many people fell victim, or how much money this group has stolen, but said it found evidence of "hundreds" of victims losing "thousands of dollars." These findings were shared with relevant authorities. Via The Hacker News Follow TechRadar on Google News and add us as a preferred source to get our expert news, reviews, and opinion in your feeds.