Meta Unveils AI-Powered Video Avatars for Influencers at Connect 2024
3 Sources
3 Sources
[1]
Meta Announces AI Video Avatars for Influencers
Meta CEO Mark Zuckerberg previewed a new feature on Wednesday that will allow creators to make realistic video avatars modeled on themselves that speak and listen to fans who visit the creators' accounts on Messenger, Instagram and WhatsApp. Zuckerberg demonstrated the technology at Meta Connect, the company's annual developer conference, but the artificial intelligence avatars are not yet
[2]
Meta is working on recreating influencers with AI
Meta has big ambitions for using AI to help creators, and it showed two impressive demos of what that could look like onstage at Connect today. One version of this involves fully recreating real influencers as AI figures. Meta CEO Mark Zuckerberg presented a live demo of a creator-based AI persona, which looked like the creator, talked like the creator, and tried to respond to questions like the creator would. It was pretty wild to watch. Another tool it's developing takes Reels and automatically dubs them into another language, maintaining the creator's voice and even changing the movements of their mouth to match. Zuckerberg presented two videos onstage of Reels by Spanish creators being translated and dubbed into English. The demo wasn't live, so it's unclear how well this tech works right now on a typical video, but it was still incredibly impressive to watch. At scale, it seems like this technology has the potential to make videos reach a lot more people, which is something Meta definitely wants to do so it can better compete with platforms like TikTok and YouTube. (Speaking of YouTube, the company has been investing in auto-dubbing, too.) Meta also announced a bunch of other AI-related features at Connect today, including that its AI assistant will be able to talk in the voices of celebrities.
[3]
Mark Zuckerberg Showed New Tech That Uses AI to Fully Recreate People
Today at Meta Connect, the parent company of Facebook, Instagram, and Threads showed off a a technology that is capable of fully recreating influencers as AI figures that can be spoken to as if they were the real person. The technology at play here, as explained by The Verge and Engadget, was showcased for two purposes. Firstly, Meta CEO Mark Zuckerberg showed that its AI is able to dub Reels into other languages including changing the movement of a subject's lips so that it appears to be spoken natively. Not only will the words be translated, but Zuckerberg says the technology will "simulate the speaker's voice in another language," too. No exact timeline for this technology's release was provided at Meta Connect, but Zuckerberg says that it will first roll out to "some creators' videos" in English and Spanish in the United States and Latin America before slowly increasing language support and access over time -- the company did say that it plans to add more languages "soon." Meta's AI translation feature does sound like a good improvement from strictly an accessibility and reach perspective even if there is likely to be some discomfort around the changing of how a person's lips move during speech. That said, if that small change is considered problematic, Meta's next application of the technology is likely to be viewed with significantly more scrutiny. As shown in Instagram Reels shared by The Verge, Zuckerberg presented a live demonstration of speaking with a fully AI-powered version of a real human influencer. The AI version looked and talked like the real person and was able to -- or at least tried to -- respond to questions as it believed the creator would. It was apparently very believable in the demonstration. Meta did not apparently say when it plans to give access to this feature to content creators and influencers, but the company is likely to be very careful with the rollout. It is very possible for this technology to be abused and for many to not be able to tell if the words being spoken were actually something the real person said or if it was just an AI-generated answer.
Share
Share
Copy Link
Meta introduces groundbreaking AI technology for creating realistic video avatars of influencers, enabling auto-dubbing and lip-syncing across languages. The innovation raises both excitement and ethical concerns in the digital content creation landscape.
Meta's AI Video Avatar Technology Unveiled
At the Meta Connect 2024 event, Mark Zuckerberg introduced a revolutionary AI-powered technology that promises to transform the landscape of digital content creation. The new system allows for the generation of highly realistic video avatars of influencers, complete with auto-dubbing and lip-syncing capabilities across multiple languages
1
.How the Technology Works
The AI-driven system can create a lifelike digital representation of an individual based on a limited set of images and voice samples. This avatar can then be manipulated to speak in different languages while maintaining the appearance of natural speech and facial movements
2
.Potential Applications and Impact
This technology has far-reaching implications for content creators and influencers. It enables them to produce multilingual content without the need for traditional dubbing or subtitling methods. Influencers can effectively "clone" themselves, creating content in languages they don't speak and potentially reaching global audiences with unprecedented ease
3
.Ethical Considerations and Concerns
While the technology offers exciting possibilities, it also raises significant ethical questions. The ability to create such realistic digital representations of individuals could potentially be misused for deepfakes or misinformation. Meta has acknowledged these concerns and stated that they are working on safeguards to prevent abuse
2
.Industry Reactions and Future Prospects
The announcement has generated mixed reactions within the tech and content creation industries. Some see it as a game-changer for global communication and entertainment, while others worry about the implications for authenticity and job security in fields like voice acting and translation
1
.Related Stories
Meta's Vision for the Future
Zuckerberg emphasized that this technology is part of Meta's broader vision for the future of digital interaction and the metaverse. The company sees AI-powered avatars as a crucial step towards more immersive and accessible virtual experiences
3
.Regulatory and Privacy Implications
As this technology nears potential public release, it is likely to face scrutiny from regulators and privacy advocates. Questions about consent, data protection, and the rights of individuals over their digital likenesses are expected to become central to the discourse surrounding this innovation
2
.References
Summarized by
Navi
[1]
[2]
Related Stories
Weekly Highlights
1
Anthropic Secures $13B in Funding, Reaching $183B Valuation Amid AI Industry Boom
Business and Economy
2
Tesla Proposes $1 Trillion Pay Package for Elon Musk Tied to Ambitious AI and Robotics Goals
Business and Economy
3
Anthropic's $1.5B AI Copyright Settlement: A Landmark Deal Under Scrutiny
Policy and Regulation
Weekly Highlights
Explore today's top stories
Your Daily Dose of Curated AI News
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.
