Google Gemini rolls out AI avatar tool that creates eerily realistic deepfake videos of users

Reviewed byNidhi Govil

3 Sources

Share

Google is widely rolling out its Gemini Avatar feature that lets paid subscribers create AI-powered avatars of themselves. Using facial scans and voice recordings, the tool generates hyperrealistic deepfake videos in minutes. While the feature includes SynthID watermarks and age restrictions, early users report the results are unsettlingly convincing, raising questions about deepfake technology's rapid advancement.

Google Gemini Introduces AI Avatar Creation for Paid Subscribers

Google is expanding access to its Gemini Avatar feature, a tool that enables paid subscribers to create an AI clone of themselves capable of appearing in AI-generated content

1

. First unveiled at Google I/O and spotted during an APK teardown in March, the feature is now entering general availability for Google AI Pro and AI Ultra subscribers

3

. The personalized AI avatar functionality works through the Gemini app, where users can access it under Settings > Avatar and begin the verification process

1

.

Source: Android Authority

Source: Android Authority

The setup takes approximately five minutes and resembles enrolling a face in biometric authentication systems

2

. Users must aim their phone's camera at their face while moving their head from side to side, then speak a series of random numbers aloud so the system can map their facial structure and voice

1

. Once complete, the AI-powered avatar can be summoned directly in Gemini chats by typing commands like @me or @your username

1

.

Gemini Omni Powers Hyperrealistic Deepfake Video Generation

The avatar feature leverages Gemini Omni, Google's new multimodal model that accepts images and videos as inputs and demonstrates enhanced understanding of physics and the real world compared to Veo, Google's previous video model

2

. Early testers report that the resemblance is unsettlingly believable, with facial movements and tone of voice appearing extremely realistic

1

. One user noted that while they could identify the deepfake video as AI-generated, most acquaintances likely wouldn't notice the difference because the avatar doesn't resemble a cartoon but rather a polished digital clone

1

.

Users can generate videos by starting a new Gemini chat, tapping the plus button, adding their avatar from the menu, and submitting prompts such as "Make a video of me at Disneyland" or "Make a video of me in a podcast studio"

2

. Video generation takes a couple of minutes, with users receiving notifications when content is ready

3

. Currently, videos are limited to 10 seconds and cannot be edited after generation

3

. There are also daily limits on how many videos users can create—AI Pro users reported being cut off after just three videos

2

.

Source: PCWorld

Source: PCWorld

Safety Measures and Potential for Misuse Concerns

Recognizing the potential for misuse, Google has implemented several safety measures

1

. Users must be at least 18 years old to access avatar creation, and the account owner must be physically present during the verification process

1

. Every video generated using the system includes Google's invisible SynthID watermark permanently embedded into the file, allowing verification of whether a clip was AI-generated by checking it in Chrome or through Google Search tools

1

.

The feature is limited to users with personal accounts and is not available in the European Economic Area, Switzerland, or the United Kingdom

3

. Currently, it can only generate audio in English

3

. Users can delete their avatar at any time, and Google promises to wipe the selfie and voice data used to create it

2

. Google's guidelines include strict restrictions against generating deepfake content of other people—the tool is meant strictly for creating your own avatar

2

.

Source: Lifehacker

Source: Lifehacker

Despite these safeguards, early users have expressed concerns about the technology's implications. One tester successfully generated a video of themselves "admitting to a crime," demonstrating how easily the tool could be misused

2

. Another noted that while current videos feel lifeless with monotone delivery and lack personality, the question remains how long these telltale signs will persist and who will look deeply enough to identify them

3

. According to Google's announcements, the company is gathering feedback and testing how to bring video editing capabilities—including changing audio and speech—to users responsibly [3](https://lifehacker.com/tech/gemini-made-this-hyperrealistic-deepfake-video-of-me], suggesting an interactive editing interface may arrive in the future.)

Today's Top Stories

TheOutpost.ai

Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.

Instagram logo
LinkedIn logo
Youtube logo
© 2026 TheOutpost.AI All rights reserved