Google AI Overviews mistakes SCP Foundation horror fiction for documented fact in 20+ cases

Google's AI Overviews are calling fan-fiction monsters real

Google's AI Overviews repeatedly described entries from the SCP Foundation, a sprawling online horror fan-fiction project, as real, Futurism found, in at least 20 cases. The feature mostly skipped the part where none of it is true. Google's AI is having trouble telling horror stories from real life. Ask it about certain online monsters, and it will describe them as documented fact. According to a report by Futurism, Google's AI Overviews repeatedly present entries from the "SCP Foundation" as real. The SCP Foundation is a vast collaborative fan-fiction project. Its "anomalies" are invented, and its website says so plainly. 'Ed's Head' and a haunted toaster Take SCP-565, nicknamed "Ed's Head". Searched on Google, the AI Overview described it as an "ambulatory human head" that scuttles across the seabed like a crab, complete with a dead man's name and "official" records to read. At no point did it note that none of this is real. One case was stranger still. SCP-426 is a fictional toaster that makes people refer to it in the first person. So the AI Overview answered in the first person, as the toaster, and relayed invented accounts of harm as though they had happened. In all, Futurism found at least 20 such cases. A known weak spot To be fair, SCP entries are written to look exactly like dry research files. That is the joke. Even so, the site carries a clear fiction disclaimer, and the AI mostly ignored it. Sometimes it gestured at "lore" without explaining what that meant. It is also not a fresh problem. AI Overviews have confidently served nonsense before, from glue-on-pizza recipes to invented idioms. One analysis put their accuracy at about 91 per cent. That sounds high, until you remember Google handles trillions of queries, which turns the other 9 per cent into millions of wrong answers. Why it matters Most people searching for SCP codes already know they are fiction. The risk is everyone else. A child who saw a scary clip, or an adult unsure what is real, may simply take the AI's word for it. The stakes are rising, too, because Google is turning Search into an AI-first interface that answers rather than links. That shift already strains the open web, and AI Overviews are tied to a sharp drop in clicks to the sites they summarise. Now add a tool that can put fan-fiction at the top of the page as fact. Google did not respond to Futurism. One caveat: when Digital Trends retried the searches, some now correctly labelled the entities "fictional", so Google may have quietly fixed part of it.

Google's AI Overviews Is Telling Users That SCP Horror Fiction Entities Are Real

Can't-miss innovations from the bleeding edge of science and tech If you Google "SCP-565" -- an iconic entry in the collaborative fan fiction universe known as the "SCP Foundation" -- the company's AI Overviews describes the nonexistent entity as though it were entirely real, without a single acknowledgement that it's a piece of online horror fiction. "SCP-565 (also known as 'Ed's Head') is an anomalous, ambulatory human head that behaves like a coral crab (Carpilius convexus)," the AI feature bloviates. "It moves across the seafloor by manipulating exposed, unfurled brain matter as legs and tentacles. DNA and dental records link the anomaly to a deceased man named Edward Belltram." The AI-generated search summary adds that the entity "navigates using neural tissue that protrudes from a large wound on the back of its skull" and "has been observed scavenging dead fish and living alongside normal crab colonies in ocean reefs." Of course, there's no deceased human's head scuttling around the ocean like a coral crab. Ed's Head is a made-up "anomaly" among the many fictional "objects, entities, and phenomena" dreamed up by members of the SCP Foundation fandom. As the lore goes, the SCP Foundation is a non-government organization that collects and contains supernatural discoveries. Writers catalogue these fictional phenomena -- which range from the terrifying to the downright bizarre -- in the form of fake records, studies, research documents, and logs, all of which are indexed in a sprawling archive. The key word, of course, is "fake." Google's AI Overviews, it turns out, has a bad habit of presenting entities from the expansive SCP universe as real items, events, or beings -- blatantly confusing those fabricated studies and records as actual evidence of horrifying or otherworldly happenings. This is cleanly demonstrated in our Google search for the term "SCP-565," the SCP code for Ed's Head. Nowhere in the resulting AI Overview does the large language model-powered search tool acknowledge that Ed's Head is imaginary; it never refers to fan-fiction, nor does it even mention the word "lore." Instead, it presents Ed's Head as if it's an actual deep-sea discovery, even pointing us to "official" records for further research. "Forensics confirmed that SCP-565 belonged to Edward Belltram, who died roughly two years before the anomaly's initial sighting," reads the AI summary. "It is safely contained in a secure aquatic enclosure by the SCP Foundation, where it is regularly monitored for mental and physical degradation." The search tool then suggests that if we "read the SCP Foundation file in its entirety," we "can check out the official SCP-565 Document." "Would you like to explore similar aquatic or biologically anomalous entities, or do you have a specific test log from the file you want to review?" the AI continues. "Let me know how to best continue our search!" Another identical search directed to an animated YouTube video depicting SCP-565, referring to the clip as a "quick and highly accurate animated overview of how Ed's Head moves and behaves." It's an incredible example of an LLM confusing fiction -- indeed, arguably one of the web's most expansive and well-known fictional universes -- with real information. We first caught wind of the bizarre AI Overview behavior after netizens across social media discovered that a Google search for "SCP-426" -- a fictional toaster that causes anyone talking about the toaster to refer to it in the first person -- returns an AI Overview in which the AI feature discusses the mysterious entity in the first person, as if the AI itself had been impacted by the toaster's supernatural effect. "Hello, I am SCP-426, an ordinary four-slice retro toaster that causes anyone mentioning me to inadvertently refer to me in the first person," the AI Overview reads. "Prolonged exposure (over two months) leads people to believe they are me. I am safely secured in a windowless containment chamber." It then describes the SCP Foundation's purported containment of the device, and lists made-up horror stories about its victims as if they were real events. "If someone is exposed to my continuous presence for more than two months, they begin to view themselves as a toaster," the AI summary continues. "In the past, this has led affected subjects to attempt to emulate my functions-often resulting in self-inflicted harm or death (e.g., trying to consume electricity or stuffing themselves with 10kg of bread.)" The more we looked, the more examples we found: so far, Futurism has found at least 20 cases in which Google Overviews presented fictional SCP entries as fact. Among the beings that Google portrayed as real were "SCP-922," known as "Another Version of the Truth," a reality-altering event plaguing a redacted university; "SCP-704," a deadly, mind-altering roadway known as "Dangerous Curves"; and "SCP-779," a wasp-like parasite said to use hallucinogenic venom to trick humans into believing that it's a human-like fairy. "Discovered in August 2009, the anomaly alters memory, falsifies registration records, and creates duplicate individuals -- even occasionally inserting fictitious Foundation personnel into existing databases," the AI Overviews result for SCP-922 insists. "Read the complete The SCP Foundation entry for full file logs and documentation." In some cases, our review showed, AI Overviews loosely referenced a phenomenon's "lore" or mentioned the SCP "universe," two terms hinting at the vast web of fan-fiction behind our queries. But vanishingly few searches actually described the items as fake or fictional. We reached out to Google to ask about why the SCP universe seems to be so tricky for AI Overviews, but didn't immediately hear back. The average person Googling SCP entities is probably a fan who already knows they're not real. But that's not a safe assumption for all users; some might be children who came across references to the scary stories on social media and are trying to figure out if they're real, or adults who are similarly confused about the horror lore's relationship to reality. Needless to say, Google is letting them down badly. Users are turning to its search interface as a trusted source of information about unfamiliar and perhaps upsetting terminology, and instead of connecting them with trustworthy context -- such as the SCP Foundation's own prominent disclaimer that the entries are works of fiction -- Google is telling them that horrific make-believe entities are real. In other words, Google has deployed immature AI tech to billions of users, even though it can't reliably tell the difference between fact and fiction -- a technical shortcoming we've seen over and over and over again. There's no sign that the search giant is slowing down. Instead, it recently announced plans to imminently replace its entire search page into an AI-driven interface built to summarize information instead of linking users to it.

Google's AI Overviews are blabbering about fictional monsters as if they're real

A new report claims Google's AI Overviews described fan-fiction horror creatures from the SCP Foundation as documented fact in at least 20 cases. Google's AI Overviews feature is reportedly presenting entries from the SCP Foundation, a popular fan fiction universe built around fake horror "anomalies," as though they describe real creatures and events. Futurism found at least 20 cases where the AI-generated summaries skipped any mention that the SCP entries are fiction. Confusing made-up monsters as the real thing A search for "SCP-565" reportedly returned an AI Overview describing an "anomalous, ambulatory human head" that moves like a crab and is tied to forensic records and a deceased man's identity. The summary even pointed users toward an "official" SCP document for further reading. According to Futurism, a search for "SCP-426," a fictional toaster that supposedly makes anyone who mentions it talk about it in first person, generated a response written in first person, with the AI describing itself as the toaster and detailing fabricated injuries from people trying to imitate it. Other examples cited in the report included "SCP-922," called "Another Version of the Truth," and "SCP-779," a parasite said to mimic a fairy. Recommended Videos In each case, the AI Overview reportedly treated the SCP Foundation's invented documentation as legitimate research rather than flagging it as fiction. This isn't the first time Google's AI-powered search results have confidently presented false information as fact, with past slip-ups ranging from wrong dates to invented historical claims. No acknowledgment, no disclaimer The SCP Foundation's own website states clearly that its entries are fictional. Google's AI Overviews rarely repeated that context, Futurism notes, occasionally referencing "lore" without explaining what that meant. Futurism reached out to Google for comment but did not receive a response before publishing.' I tried to replicate these findings, but a search for "SCP-565" did not return an AI Overview at all, and Google's AI Mode labeled the entity a "fictional anomaly" rather than presenting it as real. Trying to reproduce this behavior with other fictional characters in the SCP universe also came up empty, suggesting Google may have already addressed the issue, at least for some of the queries Futurism flagged. Google has previously rolled out updates aimed at making AI Overviews and AI Mode more reliable, though accuracy issues have continued to surface from time to time. Although I wasn't able to replicate this behavior, the mistake still matters because AI Overviews sit at the top of many Google searches, and anyone unfamiliar with the SCP community, including children, could come away believing the stories are documented fact rather than horror fiction. It echoes other AI Overview missteps, including an instance where the feature recommended adding non-toxic glue to pizza sauce, a reminder that confidently wrong answers remain a persistent risk in AI-powered search.