TikTok scales back AI Overviews after feature mistakes celebrity for blueberries

TikTok's AI Overviews Probably Thinks This Story Is a Blueberry

Aaron covers what's exciting and new in the world of home entertainment and streaming TV. Previously, he wrote about entertainment for places like Rotten Tomatoes, Inverse, TheWrap and The Hollywood Reporter. Aaron is also an actor and stay-at-home dad, which means coffee is his friend. TikTok's AI Overviews is singing the blues. The feature, which was in testing, was supposed to generate text summaries beneath video posts on the app. But due to numerous egregious inaccuracies in the AI-generated descriptions -- including one mistaking a celebrity content creator for blueberries -- TikTok has scaled back the test. A TikTok spokesperson told Business Insider that the updated feature will now only identify products shown in a video, not offer the sometimes-bizarre summaries. A TikTok representative didn't immediately respond to a request for comment. TikTok's AI Overviews feature was similar to the AI summaries Google uses in its search algorithm. It was supposed to explain what's happening in video posts and provide additional context. It succeeded only some of the time. The Business Insider reporter documented firsthand experience with TikTok's AI Overviews, citing a collection of incorrect summaries. The feature described a video of TikTok personality Charli D'Amelio talking to the camera as "a collection of various blueberries with different toppings." And it called a video from the singer Shakira "a repetitive sequence of several distinct blue shapes appearing and moving across the screen." Many TikTok users on Reddit were dissatisfied with the feature. One Reddit post shows a screenshot of a video featuring two ballroom dancers. The AI caption identified the visual as "a person repeatedly striking their head with a rubber chicken." AI-generated overviews have come a long way since they first began appearing online. Just a few years ago, Google faced a similar set of accuracy problems when its algorithm suggested eating one rock per day and using glue to keep cheese on pizza. TikTok isn't backing away from AI. The company recently rolled out a tool that converts an image to a video, and another that lets you control how much AI content appears on your For You Page. It has also addressed safety issues that come with implementing AI on its platform by releasing moderation tools.

TikTok rows back on AI video overviews in US after absurd errors

TikTok has rowed back on an AI feature which incorrectly summarised some videos on the platform, including claiming a celebrity was fruit. The company's 'AI overviews' recently began appearing beneath content on the platform to describe what a video was showing, or provide more context. While only rolled out to some users in the US and the Philippines, the feature's incorrect and bizarre AI-generated summaries of TikTok content - seen beneath videos of celebrities like platform star Charli D'Amelio - have been shared widely. According to TikTok, its experimental summaries have been tweaked to only suggest products similar to those shown in videos. The changes were first reported by news outlet Business Insider. Much like the AI Overviews at the top of most Google search results, TikTok's AI-generated overviews would attempt to sum up the contents of videos for some users when they clicked to see more of a video's caption. Some examples screenshotted by users and seen by the BBC showed videos on the platform being accurately described, but Business Insider also identified a number of "wildly inaccurate" AI overviews. This included one which saw a video of dancer Charli D'Amelio described as a "collection of various blueberries with different toppings," the publication said. It saw similarly vague, inaccurate and strange AI-generated summaries on other TikTok videos of celebrities and artists, including Shakira and Olivia Rodrigo. The feature will now only be used to surface information about items in videos, according to TikTok. It comes as tech firms look to deploy more AI products on their platforms to boost user engagement. However, some such efforts have been met with user backlash, or mockery, when these tools go awry. Posts reacting to TikTok's testing of AI overviews on its videos first began appearing in January. But it appears the summaries were made more widely available, with several users and creators highlighting AI-generated descriptions containing absurd mistakes in late April. A recent example shared on Reddit saw a performance by ballroom dancers Reagan and Juli To described in an AI overview on TikTok as "a person repeatedly striking their head with a rubber chicken". Other examples shared by TikTok users contained similarly strange descriptions. For instance, AI overviews for two separate videos, neither of which featured violence or tools, said they featured "a person repeatedly striking their head with a hammer". According to TikTok, users were able to report and provide feedback about AI overviews. But this did not stop some from speculating as to whether the platform was "trolling" its users. "The new AI Overview is so bad it feels like it has to be a joke," wrote TikTok user and creator Brett Vanderbrook alongside his video. He showed a range of examples where TikTok's AI feature conjured up bizarre descriptions for what was happening in videos - such as a comedy skit described as someone "demonstrating a new, clever technique for cutting through water". TikTok says it has identified the cause of AI overview errors and inconsistencies, without detailing what this was. But generative AI tools often make things up when responding to users, summarising or generating information, and errors can range from being hilarious to potentially harmful in nature. Google was widely mocked in 2024 after its AI Overviews results told users to eat rocks and "glue pizza". Apple later faced criticism after an AI tool designed to summarise notifications created false headlines for the BBC News and the New York Times apps. The tech giant suspended the feature, saying it would improve and update it. Since then AI development has continued, with firms claiming the tech has vastly improved in ability and accuracy, but so-called "hallucinations" persist. However, ChatGPT-maker OpenAI recently said it identified "goblin" and "gremlin" creeping into its systems' responses - a quirk it believes arose after a tool it trained to have a nerdy persona incentivised mentioning the creatures. False case law or citations appearing in court filings have meanwhile prompted warnings about AI use in legal settings, with AI errors also reportedly causing issues for some governments. Sign up for our Tech Decoded newsletter to follow the world's top tech stories and trends. Outside the UK? Sign up here.

'Completely off the rails': TikTok is scaling back its AI summaries feature after it creates bizarre and inaccurate captions -- as if TikTok wasn't bad enough for misinformation already

* TikTok has been testing AI summaries for its videos * The feature is throwing up wildly inaccurate text captions * TikTok says it will now pull back on the technology In the age of AI deepfakes, it's a good idea to treat everything you see on social media with a certain degree of skepticism, but the misinformation problem on TikTok has been made worse with some wildly inaccurate AI captions -- and it's bad enough that the video platform is now scaling back this captioning technology. As reported by Business Insider, TikTok had been testing AI-powered text summaries for videos with a limited number of users. However, after numerous mistakes and hallucinations, the technology is going to be limited to identifying products in videos, rather than fully describing the video's contents. Those mistakes and hallucinations included describing a video of celebrity Charli D'Amelio talking to the camera as showing a "collection of various blueberries with different toppings", and labeling a dog-training video as "a captivating display of intricate origami art, meticulously folded from a single sheet". You don't have to look far on social media to find further examples: there's what seems to be an image of two cats with the caption "a person demonstrating an impressive new robot arm with multiple dexterous fingers", for example. 'Garbage that has nothing to do with the video' It's not clear exactly what's been going wrong for TikTok's AI summaries to get the wrong idea so regularly (though presumably this did work, some of the time). Recognizing the contents of images and videos is usually something AI can do pretty reliably. That clearly hasn't been the experience of many TikTok users, however. One Redditor described the captions as "completely off the rails", while another said they were seeing "garbage that has nothing to do with the video" -- with the AI summary also serving to distract from the actual caption on the video. Other examples online show a Kentucky Derby horse race video described as "showcasing an intricate piece of calligraphy", and a cookery video with an overhead shot of a gray pan getting the label "a single ball bouncing and rolling on a green surface" -- although these screenshots could also be faked, of course. Even as AI is pushed into more and more of our apps and devices, hallucinations and errors remain a significant problem, which AI companies don't like admitting to. Whether it's a TikTok video or a legal document, if you're getting AI to summarize something, you'd be wise to run additional checks. Follow TechRadar on Google News and add us as a preferred source to get our expert news, reviews, and opinion in your feeds.