5 Sources
[1]
Microsoft patent filing describes AI that rewrites what people say in livestreams in real time
Serving tech enthusiasts for over 25 years. TechSpot means tech analysis and advice you can trust. The takeaway: Microsoft, Sony, and other companies have filed several patents in the past year that use generative AI to alter content in real time. Patents don't always become products, but the
[2]
Microsoft Patents an AI That Can Literally Put Words in People's Mouths in Real Time
There's simply no way something like this wouldn't get abused almost immediately. Microsoft just filed a patent for an AI product that would be able to transform live video in real time to alter speakers' words and faces. The patent, as first flagged by patent-tracker Patentlyze, is described by
[3]
Microsoft AI patent rewrites what people say on livestreams, then redraws their lips to match
Microsoft has filed a patent application for an AI system that can change what people say during livestreams and other live video broadcasts in near real time. The technology is capable of redrawing the speaker's lips so viewers can't tell the words were swapped. The Microsoft filing, US
[4]
Microsoft Seeks to Patent AI Product that Can Put Words in Our Mouth
The tech itself is neither good or bad, but we feel that in a world flooded with AI slop and deepfakes, such a tech can cause more harm than good What would a Big Tech giant do with a new technology that is a "near real-time artificial intelligence (AI) enhancement of video or augmented reality
[5]
Microsoft patents AI that may remove unwanted words and fix speech errors during live broadcasts: Report
The proposed system raises concerns about authenticity and changes to original speech. Microsoft has recently filed a patent application for an AI-powered technology that could transform how people experience live broadcasts and augmented reality content. According to the details, the system would
Share
Copy Link
Microsoft filed a patent for AI agents that modify spoken words during livestreams in near real-time while adjusting speakers' facial movements to match. The system can remove filler words, translate languages, and censor content based on viewer profiles, but experts warn it could enable sophisticated misinformation.
Microsoft has filed a patent application for an AI system that can modify what people say during livestreams and live video broadcasts in near real-time, then redraw their lips to match the altered speech
1
. The patent, titled "Near Real-Time Artificial Intelligence (AI) Enhancement of Video or Augmented Reality (AR) Presentations of Live Events," was first flagged by patent tracker Patentlyze and describes technology that could fundamentally change how audiences engage with live content2
.
Source: TweakTown
The Microsoft AI patent describes an AI system to edit livestreams by using AI agents that listen to live audio and flag specific words for modification or removal based on preset parameters or viewer profiles, which can include age, location, and native language
3
. Using generative AI, the system then replaces those words in the audio, smooths transitions around each edit, and generates new video frames so the speaker's mouth movements align with the modified speech1
. The edited result plays back after a delay of roughly one to ten seconds3
.The patent application details how AI agents would identify and alter spoken words during live broadcasts through near real-time artificial intelligence enhancement
4
. The system would scan live audio recordings and identify words to modify according to learned patterns and user profiles4
. Microsoft claims the technology would remove filler words like "um" or "ah" from live speech, or erase stutters and speech impediments2
.The system could also eliminate "mumbled words, mispronounced words, misused words, misspoken words, offensive words, insensitive words, or inappropriate words," with replacement words potentially coming from internet searches
2
. Beyond basic corrections, the technology could remove profanity and replace words based on viewer preferences1
. The patent also describes cutting down on "personal words or phrases" like "coined terms" and "colloquial terms" such as "y'all" or phrases like "bite the bullet"4
.A separate claim in the patent describes using the technology for real-time translation during livestreams
1
. The system would allow broadcasts and other live footage to be both heard and seen in a viewer's preferred language, with the speaker's mouth movements adjusted accordingly5
. Unlike YouTube's existing AI audio translation, Microsoft's patent would translate livestreams with matching lip sync1
. The translator claim retains the original recording as ground truth, providing a reference for accuracy1
.The system could run on augmented reality glasses, phones, tablets, or cameras, making the technology accessible across multiple platforms
3
. Listed applications include lectures, presentations, award ceremonies, game shows, cooking shows, and live sports2
.
Source: Futurism
Related Stories
The ability to hide edits by adjusting lip movements suggests viewers could watch altering live video and audio without realizing modifications were made
1
. Real-time AI face swapping is already popular with scammers, so the ability to alter what is being said in livestreams could enable sophisticated misinformation and fraud1
. The patent doesn't specify whether it would tell users which edits were made or why, raising transparency concerns1
.In an era defined by AI-fueled deepfakes and disinformation, the system may represent a new world of filtering tools that subtly alter reality as it takes place on a highly-personalized level
2
. The tool that can change how people listen to lectures could also create distrust if used to modify speeches of political leaders4
. Automatically editing live videos with AI agents could change how audiences fundamentally engage with live footage, potentially moving viewers further into personalized bubbles2
.
Source: CXOToday
The Microsoft AI patent is a published application, not a granted patent
3
. The application was filed on April 29, 2025, and Patentlyze notes the examiner rejected the claims as filed on July 29, 2026, a routine step that Microsoft can respond to3
. Microsoft hasn't said whether it plans to build the technology, and as with any patent, there's no guarantee this ends up inside a Microsoft product3
.This patent shares a basic idea with others involving real-time editing with AI. Microsoft filed another ambitious claim in July aiming to rewrite a game's code to add content based on player behavior
1
. Sony recently filed multiple patents that would use AI to predict upcoming frames and which button a user will press next, or control game time progression and difficulty1
. The frequency of these filings demonstrates strong interest in real-time AI editing across the tech industry1
. Microsoft did not immediately respond to requests for comment about the patent2
.Summarized by
Navi
[1]
[3]
15 Oct 2024•Technology

24 Sept 2026•Technology

20 Nov 2024•Technology
