OpenAI's Whisper AI Transcription Tool Raises Concerns in Healthcare Settings
24 Sources
[1]
AI Model Used By Hospitals Caught Making Up Details About Patients, Inventing Nonexistent Medications and Sexual Acts
In a new investigation from The Associated Press, dozens of experts have found that Whisper, an AI-powered transcription tool made by OpenAI, is plagued with frequent hallucinations and inaccuracies, with the AI model often inventing completely unrelated text. What's even more concerning, though,
[2]
OpenAI's Transcription Tool Hallucinates. Hospitals Are Using It Anyway
In health care settings, it's important to be precise. That's why the widespread use of OpenAI's Whisper transcription tool among medical workers has experts alarmed. On Saturday, an Associated Press investigation revealed that OpenAI's Whisper transcription tool creates fabricated text in medical
[3]
OpenAI transcription tool widely used by doctors and hospitals raises concerns over hallucinations
Facepalm: It is no secret that generative AI is prone to hallucinations, but as these tools make their way into medical settings, alarm bells are ringing. Even OpenAI warns against using its transcription tool in high-risk settings. OpenAI's AI-powered transcription tool, Whisper, has come under
[4]
Hospitals adopt error-prone AI transcription tools despite warnings
OpenAI's Whisper tool may add fake text to medical transcripts, investigation finds. On Saturday, an Associated Press investigation revealed that OpenAI's Whisper transcription tool creates fabricated text in medical and business settings despite warnings against such use. The AP interviewed more
[5]
OpenAI's Whisper invents parts of transcriptions -- a lot
Imagine going to the doctor, telling them exactly how you're feeling and then a transcription later adds false information and alters your story. That could be the case in medical centers that use Whisper, OpenAI's transcription tool. Over a dozen developers, software engineers and academic
[6]
OpenAI's Whisper model is reportedly 'hallucinating' in high-risk situations
The tool has widespread adoption in US hospitals, but researchers are warning of potential harms Researchers have found that OpenAI's audio-powered transcription tool, Whisper, is inventing things that were never said with potentially dangerous consequences, according to a new report. As per
[7]
Doctors Are Using AI to Transcribe Conversations With Patients. But Researchers Say the Tool Is Hallucinating 'Entire' Sentences.
ChatGPT-maker OpenAI introduced Whisper two years ago as an AI tool that transcribes speech to text. Now, the tool is used by AI healthcare company Nabla and its 45,000 clinicians to help transcribe medical conversations across over 85 organizations, like the University of Iowa Health
[8]
OpenAI's Whisper Experiencing 'AI Hallucinations' Despite High-Risk Applications
OpenAI's new AI audio transcription tool Whisper is having frequent "AI hallucinations", despite its rapid adoption in "high-risk industries" like healthcare, AP News reports. AI hallucination is where a large language model (LLM) spots patterns that don't exist, creating outputs that can be
[9]
A transcription AI developed by OpenAI and used in hospitals lies more than it speaks - Softonic
A group of researchers detect an unusual amount of "hallucinations" committed by Whisper Whisper, the transcription tool developed by OpenAI and based on artificial intelligence, is lying a lot. Too much. According to several experts in the technological field, this tool is prone to "hallucinate,"
[10]
Concerns about medical note-taking tool raised after researcher discovers it invents things no one said -- Nabla is powered by OpenAI's Whisper
A good transcription app shouldn't indulge in creative writing. Researchers and engineers using OpenAI's Whisper audio transcription tool have said that it often includes hallucinations in its output, commonly manifested as chunks of text that don't accurately reflect the original recording.
[11]
OpenAI's Whisper Transcription Tool Might Be Hallucinating
Every 8 out of 10 Whisper transcriptions reportedly contain hallucination OpenAI released an artificial intelligence (AI) tool dubbed Whisper in 2022, which can transcribe speech to text. However, a report claimed that the AI tool is prone to hallucinations and is adding imaginary text in
[12]
OpenAI's Transcriptions Make Up Things You Never Said to Your Doctor
Let's hope your physician isn't transcribing your conversations with Whisper. It's no surprise to those of us following generative artificial intelligence news that AI is imperfect. In fact, generative AI so often spits out untrue, false, and otherwise incorrect outputs that we have a name for it:
[13]
Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said
SAN FRANCISCO (AP) -- Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy." But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with
[14]
Researchers say an AI-powered transcription tool used in hospitals...
Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy." But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen
[15]
Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said
Experts said that such fabrications are problematic because Whisper is being used in a slew of industries worldwide to translate and transcribe interviews, generate text in popular consumer technologies and create subtitles for videos.Tech behemoth OpenAI has touted its artificial
[16]
Researchers Say an AI-Powered Transcription Tool Used in Hospitals Invents Things No One Ever Said
SAN FRANCISCO (AP) -- Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy." But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with
[17]
Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said
SAN FRANCISCO -- Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy." But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more
[18]
OpenAI's transcription tool hallucinates more than any other, experts say -- but hospitals keep using it
Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy." But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen
[19]
Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said
SAN FRANCISCO (AP) -- Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy." But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with
[20]
OpenAI's AI transcription tool hallucinates excessively - here's a better alternative
A researcher 'found hallucinations in eight out of every 10 audio transcriptions he inspected' from Whisper. OpenAI's Whisper, an artificial intelligence (AI) speech recognition and transcription tool launched in 2022, has been found to hallucinate or make things up -- so much so that experts are
[21]
Research: AI transcription tool in hospitals fabricates speech
SAN FRANCISCO (AP) -- Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy." But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with
[22]
An AI-powered transcription tool invents things no one ever said
SAN FRANCISCO (AP) -- Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy." But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with
[23]
Transcription tool powered by AI found to 'hallucinate' extra sentences | BreakingNews.ie
Tech giant OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy". But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software
[24]
AI Speech Tools Stumble as Hallucination Problems Persist | PYMNTS.com
In a troubling discovery for businesses racing to automate customer service, OpenAI's popular Whisper transcription software has been caught adding fabricated text to conversations, including potentially harmful content that speakers never uttered. The findings underscore a growing challenge for
Share
Copy Link
OpenAI's Whisper, an AI-powered transcription tool, is found to generate hallucinations and inaccuracies, raising alarm as it's widely used in medical settings despite warnings against its use in high-risk domains.
OpenAI's Whisper: A Controversial AI Transcription Tool
OpenAI's Whisper, an AI-powered transcription tool, has come under scrutiny for its tendency to generate fabricated text, known as hallucinations. Despite OpenAI's claims of "human level robustness and accuracy," experts have identified numerous instances where Whisper invents entire sentences or adds non-existent content to transcriptions
1
2
.Widespread Adoption in Healthcare
Despite OpenAI's explicit warnings against using Whisper in "high-risk domains," the medical sector has widely adopted Whisper-based tools. Nabla, a medical tech company, has developed a Whisper-based tool used by over 30,000 clinicians and 40 health systems, including the Mankato Clinic in Minnesota and Children's Hospital Los Angeles
3
4
.Alarming Findings
Researchers and engineers have reported numerous instances of hallucinations in their work with Whisper:
- A University of Michigan researcher observed hallucinations in 80% of public meeting transcriptions examined
2
. - A machine learning engineer encountered hallucinations in approximately half of over 100 hours of Whisper transcriptions analyzed
3
. - Another developer found hallucinations in nearly all 26,000 transcripts created using the tool
3
.
Potential Consequences in Healthcare
The use of Whisper in medical settings raises significant concerns:
- Nabla's tool has been used to transcribe an estimated 7 million medical visits
1
5
. - The tool erases original audio recordings, making it impossible to verify the accuracy of transcriptions
2
4
. - Deaf patients may be particularly impacted by mistaken transcripts
4
.
Types of Hallucinations
A study conducted by researchers from Cornell University and the University of Virginia revealed alarming types of hallucinations:
- Addition of non-existent violent content and racial commentary to neutral speech
2
4
. - Invention of fictional medications, such as "hyperactivated antibiotics"
3
. - Transformation of innocuous statements into violent scenarios
3
5
.
Related Stories
Implications and Concerns
Experts warn of potential grave consequences, especially in hospital settings. Alondra Nelson, a professor at the Institute for Advanced Study, emphasized the need for a higher bar in medical contexts
1
3
.OpenAI's Response
An OpenAI spokesperson stated that the company appreciates the researchers' findings and is actively studying how to reduce fabrications. They incorporate feedback in updates to the model
2
.Broader Impact
Whisper's influence extends beyond OpenAI, with integration into some versions of ChatGPT and availability on Oracle and Microsoft's cloud computing platforms. In just one month, a recent version of Whisper was downloaded over 4.2 million times from the open-source AI platform HuggingFace
3
5
.As AI tools like Whisper continue to be adopted in critical sectors, the need for improved accuracy and safeguards becomes increasingly apparent. The medical community, in particular, must carefully weigh the benefits of AI-powered transcription against the potential risks of misinformation in patient records.
References
Summarized by
Navi
[3]
Related Stories
Ontario Audit Reveals AI Medical Scribes Hallucinate Patient Info, Miss Critical Health Details
14 May 2026•Health
AI Hallucinations on the Rise: New Models Face Increased Inaccuracy Despite Advancements
05 May 2025•Technology
AI Hallucinations: The Challenges and Risks of Artificial Intelligence's Misinformation Problem
22 Mar 2025•Technology
Recent Highlights
1
AI Hallucination Nearly Sparked US Military Confrontation With Chinese Ship in Middle East
Technology
2
OpenAI AI Agent Hacks Australian Government Healthcare Website in First-of-Its-Kind Breach
Technology
3
AI leaders warn UN Security Council of existential risks to humanity, call for global safeguards
Policy and Regulation
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
