Telegram Briefly Delisted by Apple After Extortionist Used AI-Generated Illegal Content in Attack

Telegram CEO says 'takedown extortionist' was responsible for the app being briefly delisted by Apple - Engadget

Pavel Durov claims there's "a potential systemic risk" for platforms with user-generated content. Telegram founder Pavel Durov took to social media to address the circumstances of the app's brief removal from the App Store earlier this week. The exec claimed that the service was targeted by "a takedown extortionist." In a lengthy post on X, Durov alleged that a malicious actor edited an old message in an active group chat to show "AI-modified illegal content" that wouldn't be seen and reported by the group's members. He claimed this laid the scene for an extortion attempt, where the actor would use a fleet of automated accounts to report their own post to Apple if the company didn't pay to be left alone. "Extortionists have found a way to manipulate Apple into overreacting. Apple removed Telegram from the App Store before contacting us. This creates a potential systemic risk for every mobile app that hosts user-generated content." Responsibility for user-generated content is not a new issue. Questions about culpability for users' possible illegal activity has been a debate for social media networks for years. It also isn't the first time Telegram and Durov have been the subjects of those exact questions. Between video and image editing tools in chatbots and the speed of task execution agents are capable of, the proliferation of AI has made it potentially easier for an extortionist to carry out this type of attack.

Durov says fake reports triggered Telegram's App store removal

Telegram founder Pavel Durov said a "takedown extortionist" was responsible for the app's brief removal from Apple's App Store earlier this week. In a post on X, Durov said a malicious actor edited an old message in an active group chat to display "AI-modified illegal content" that group members would not notice or report. Durov said the edited post was used to set up an extortion attempt. He said the actor threatened to deploy automated accounts to report the post to Apple unless Telegram paid. "Extortionists have found a way to manipulate Apple into overreacting," Durov said. "Apple removed Telegram from the App Store before contacting us. This creates a potential systemic risk for every mobile app that hosts user-generated content." The incident adds to a long-running debate over how platforms should handle user-generated content and whether they are responsible for illegal material posted by users. Telegram and Durov have faced similar scrutiny before over possible illegal activity on the platform. Durov also said the spread of AI tools has made this type of attack easier to carry out.