KPMG pulls AI report after organizations expose widespread hallucinations and fake citations

Reviewed byNidhi Govil

11 Sources

Share

One of the world's largest consulting firms withdrew its October 2025 report on agentic AI after multiple organizations, including UBS and the UK's National Health Service, said claims about their AI usage were false. GPTZero's investigation revealed that 40 of 45 citations appeared to be AI hallucinations, raising questions about human oversight in professional services.

KPMG Withdraws AI Report Amid Hallucination Scandal

KPMG has pulled its October 2025 report titled "Redefining excellence in the age of agentic AI" after multiple organizations disputed the accuracy of claims made about their AI deployments

1

. The professional services firm, one of the Big Four accounting and consulting companies, removed the document from its websites following revelations that the AI report contained widespread AI hallucinations and fake citations

2

.

Source: Analytics Insight

Source: Analytics Insight

UBS, the UK's National Health Service, Swiss Federal Railways, and Transport for London all told the Financial Times that the report's descriptions of their AI usage were either untrue or misleading

5

. UBS specifically stated that KPMG's claims about integrating agentic AI across investment advisory, risk management, and compliance monitoring were "factually incorrect"

4

.

GPTZero Uncovers Systematic Inaccuracies

AI-safety firm GPTZero conducted a forensic review of the retracted report and found that only five of its 45 citations correctly pointed to the cited source

3

. The remaining 40 citations ranged from mangled and misleading to partially fabricated or too vague to verify. GPTZero introduced the term "vibe citing" to describe this phenomenon, where AI-generated content appears to stitch together fragments of real sources or invent titles that look convincing until verified

2

.

The investigation revealed that approximately half of the factual claims in the paper were false, unsupported, or attributed to the wrong source

3

. In one example, the report claimed that Japanese East Japan Railway Company (JR East) was using agentic AI for customer service, linking to a 2019 press release from half a decade before agentic AI became mainstream

2

. Another false claim stated that Emirates airline launched a mobile chatbot named Sara that could converse with passengers and change their flights, when in fact Sara was a robot assistant introduced in 2023 that lacked flight-booking capabilities

3

.

Risks of AI-Generated Content Without Human Oversight

Source: Engadget

Source: Engadget

GPTZero alleges that an LLM research tool was likely asked to find case studies of companies using agentic AI worldwide, and "this tool seems to have conflated sources, exaggerated claims, and injected references to agentic AI that were copied into the final report without verification"

2

. Researchers suspect no human at KPMG double-checked the citations, claims, or sources before publication

2

.

The risks of AI-generated content extend beyond the original document. The now-removed report was referenced by multiple customer service publications, a major Czech Republic newspaper, and is being cited as a resource by OpenAI's ChatGPT and Google Gemini. GPTZero chief executive Edward Tian warned that error-riddled papers from trusted sources like the Big Four could "poison the well of information" and lead to second-hand AI hallucinations

4

.

Pattern of AI Misuse in Professional Settings

KPMG is not alone in facing reputational damage from unchecked AI-generated content. Last month, EY withdrew a report on loyalty rewards programs that appeared to include fake footnotes and AI hallucinations

1

. In October 2025, the Australian government ordered Deloitte to refund a portion of the $290,000 it was paid for a compliance report after discovering several incorrect citations that appeared to be AI hallucinations and a fabricated quote.

The problem is already affecting everyday workers. More than 40% of US desk workers reported receiving "workslop"—low-quality AI-generated content—in the past month, according to a survey by the Stanford Social Media Lab and BetterUp Labs.

Questions About KPMG's AI Integration

Source: The Register

Source: The Register

A KPMG spokesperson stated that "we expect all our people to follow our guidelines on the responsible use of AI, including human oversight to validate content and verify independent sources"

1

. The firm is now reviewing the circumstances surrounding the publication.

For KPMG's clients, the incident raises concerns about oversight standards. KPMG partnered with Anthropic earlier this year to deploy Claude across all 276,000 staff, embedding AI into advisory, audit, and tax work. The pulled report serves as a preview of what happens when AI integration outpaces verification processes, highlighting the critical need for human oversight in professional services to prevent misinformation from spreading through trusted channels.

Today's Top Stories

© 2026 TheOutpost.AI All rights reserved