14 Sources
[1]
Google removes some AI health summaries after investigation finds "dangerous" flaws
On Sunday, Google removed some of its AI Overviews health summaries after a Guardian investigation found people were being put at risk by false and misleading information. The removals came after the newspaper found that Google's generative AI feature delivered inaccurate health information at the
[2]
Google removes AI Overviews for certain medical queries
Following an investigation by the Guardian that found Google AI Overviews offering misleading information in response to certain health-related queries, the company appears to have removed the AI Overviews for some of those queries. For example, the Guardian initially reported that when users
[3]
Google pulls AI overviews for some medical searches
Earlier this month, The Guardian published an investigation that showed Google was serving up misleading and outright false information via its AI overviews in response to certain medical inquiries. Now those results appear to have been removed. According to the original report: In one case that
[4]
Use Google AI Overview for health advice? It's 'really dangerous,' investigation finds
Don't rely solely on AI to research serious medical conditions. Turning to AI to answer health-related questions seems like an easy and convenient option that may spare you from a doctor's visit. That's particularly true with a tool like Google's AI Overviews, which summarizes the results that pop
[5]
Google removes AI Overviews from some medical searches after experts warn of risks to users' health
Serving tech enthusiasts for over 25 years. TechSpot means tech analysis and advice you can trust. What just happened? Don't be surprised to find some of Google's AI Overviews conspicuously absent from certain medical searches. The company has removed several of these AI summaries following a
[6]
Google Pulls Some Health-Related AI Overviews as Industry Goes All-In on Healthcare
Google has quietly pulled back some AI-generated health summaries at the same time that the industry is seemingly racing to embed AI into healthcare. The move came after The Guardian found some of the information provided by the feature was misleading. The Guardian reported Sunday that Google had
[7]
Google pulls AI Overviews on some health queries after claims they mislead users
A number of health-related AI overviews have seemingly been removed Google has removed several AI Overviews from searches relating to health information after experts deemed them misleading and potentially dangerous. An investigation by The Guardian found that certain queries, such as "what is the
[8]
'Dangerous and alarming': Google removes some of its AI summaries after users' health put at risk
Exclusive: Guardian investigation finds AI Overviews provided inaccurate and false information when queried over blood tests Google has removed some of its artificial intelligence health summaries after a Guardian investigation found people were being put at risk of harm by false and misleading
[9]
Google Removes AI Health Summaries After Risky Medical Errors Exposed
We have all been there. You feel a weird pain in your side or get a confusing test result back from the doctor, and the first thing you do is open Google. You aren't looking for a medical degree; you just want a quick answer to "am I okay?" But recently, Google had to pump the brakes on its AI
[10]
Google's AI Overviews Caught Giving Dangerous "Health" Advice
"If the information they receive is inaccurate or out of context, it can seriously harm their health." In May 2024, Google threw caution to the wind by rolling out its controversial AI Overviews feature in a purported effort to make information easier to find. But the AI hallucinations that
[11]
Google removes AI Overviews for health queries after accuracy concerns
An investigation by the Guardian found that Google's AI-generated summaries gave out inaccurate health information. Google has reportedly removed some AI Overviews for health-related questions following an investigation that found that some of the information was misleading. AI Overviews are
[12]
Google's Recent Misstep Is a Warning for AI-Generated Medical Info
Google removed AI responses for some medical search queries after an investigation by The Guardian found out-of-context or even incorrect answers to questions about everything from pancreatic cancer to liver disease -- answers that could pose a threat to patients' wellbeing. The specific search
[13]
Google's AI Overviews Said to Provide Wrong Medical Advice
The extent of the incorrect information on AI Overviews is not clear Google's AI Overviews has again stirred a commotion for sharing incorrect medical advice. According to a report, the Mountain View-based tech giant's artificial intelligence (AI) search summary feature was spotted sharing
[14]
Google stops showing AI Overviews for certain health questions
However, variations of these searches, such as "lft reference range" or "lft test reference range," can still trigger AI-generated summaries. Google has removed AI-generated summaries, known as AI Overviews, for certain health-related searches following a report by The Guardian. The investigation
Share
Copy Link
Google has removed some AI Overviews from health-related searches following a Guardian investigation that exposed dangerous flaws in AI-generated health summaries. The investigation found that Google's generative AI feature delivered inaccurate medical information, including wrong advice about pancreatic cancer and misleading liver function test results that could lead seriously ill patients to mistakenly believe they are healthy.
Google has removed several AI Overviews from medical queries after a Guardian investigation revealed that the AI-generated health summaries were putting users at risk with inaccurate medical information and misleading health information
1
. The investigation, published in early January, found that Google's generative AI feature delivered false guidance at the top of search results, potentially leading seriously ill patients to dangerous conclusions about their health2
.
Source: Gadgets 360
The Guardian documented multiple cases where Google AI Overviews provided dangerous health advice that contradicted established medical guidance. In one particularly alarming example, the AI advised people with pancreatic cancer to avoid high-fat foods—exactly the opposite of standard medical recommendations
3
. Medical experts warned this incorrect pancreatic cancer advice could increase the risk of patient death, as maintaining weight is critical for these patients4
.
Source: ZDNet
Google disabled specific queries including "what is the normal range for liver blood tests" after experts flagged the results as dangerous
1
. The investigation revealed that searching for liver function tests generated raw data tables listing specific enzymes like ALT, AST, and alkaline phosphatase without essential context. The AI feature failed to adjust these figures for patient demographics such as age, sex, and ethnicity.Vanessa Hebditch, director of communications and policy at the British Liver Trust, told The Guardian that understanding liver function test results "is complex and involves a lot more than comparing a set of numbers."
1
She warned that the AI Overviews fail to inform users that someone can receive normal results for these tests while having serious liver disease requiring further medical care. "This false reassurance could be very harmful," she emphasized.The recurring problems with Google AI Overviews stem from a fundamental design flaw in how the system works
1
. Google built the feature to show information backed up by top search results from its page ranking system, based on the assumption that highly ranked pages contain accurate information. However, Google's algorithm has long struggled with SEO-gamed content and spam. The system now feeds these unreliable results to its language model, which then summarizes them with an authoritative tone that can mislead users seeking expert advice on patient health matters.
Source: Ars Technica
Even when the AI draws from accurate sources, the language model can still draw incorrect conclusions from the data, producing flawed summaries of otherwise reliable information. The technology does not inherently provide factual accuracy but reflects whatever inaccuracies exist on the websites Google's algorithm ranks highly, presenting facts with an authority that makes errors appear trustworthy
1
.Related Stories
While Google removes AI Overviews for specific queries like "what is the normal range for liver blood tests" and "what is the normal range for liver function tests," The Guardian found that slight variations such as "lft reference range" or "lft test reference range" still prompted AI Overviews to appear
2
. Hebditch called this a major concern, noting that the AI Overviews present lists of tests in bold, making it easy for readers to miss that these numbers might not be the right ones for their specific test1
.Several other examples that The Guardian originally highlighted to Google remain active. When asked why these AI Overviews had not been removed, Google said they linked to well-known and reputable sources and informed people when it was important to seek expert advice. A Google spokesperson told The Verge that the company's internal team of clinicians reviewed what was shared and "found that in many instances, the information was not inaccurate and was also supported by high-quality websites."
1
.This is not the first controversy for AI Overviews. The feature has previously told people to put glue on pizza and eat rocks
3
. It has proven unpopular enough that users discovered inserting curse words into search queries disables AI Overviews entirely1
. A report from September found that over 10% of Google AI Overviews cite AI-generated content.Google declined to comment on the specific removals to The Guardian, with a spokesperson stating that the company does not "comment on individual removals within Search" but works to "make broad improvements." The company said AI Overviews only appear for queries where it has high confidence in the quality of responses and that it constantly measures and reviews the quality of its summaries across many different categories of information
1
.Hebditch welcomed the removal as "excellent news" but added, "Our bigger concern with all this is that it is nit-picking a single search result and Google can just shut off the AI Overviews for that but it's not tackling the bigger issue of AI Overviews for health."
2
The way users phrase medical queries influences the answer, with the same question asked two different ways potentially yielding one partially accurate response and another that is inaccurate and unhelpful4
.Summarized by
Navi
[2]
[3]
16 Mar 2026•Technology
26 Jan 2026•Technology
08 Apr 2026•Technology

1
Technology

2
Technology

3
Policy and Regulation
