Meta Unveils AI-Powered Translation Tool for Instagram and Facebook Reels

From Lip-Syncing To Dubbing -- Mark Zuckerberg-Led Meta's New AI Translation Tool For Instagram And Facebook Reels Makes It Easier For Creators To Maximize Reach - Meta Platforms (NASDAQ:META)

Meta Platforms Inc. META has unveiled a new AI-powered translation tool to redefine the way users interact with Instagram and Facebook Reels. What Happened: Zuckerberg unveiled the tool at the annual Meta Connect event. It uses AI to dub Reels into different languages, complete with automatic lip synchronization. Zuckerberg demonstrated the technology during the keynote, and it appeared to function seamlessly. The tool not only translated the content but also simulated the speaker's voice in another language and synced their lips to match. See Also: "Possible, But Not Probable': Steve Jobs' Witty Transportation Answer In 1973 Resume Earns Him Online Accolades -- Bill Gates $15k Salary No Less Impressive In The Same Era While Meta has not provided a specific timeline for the rollout of this feature, it has been revealed that the tool will initially be available for "some creators' videos" in English and Spanish in the U.S. and Latin America. The tech giant has also indicated that the feature will be expanded to include more languages soon. YouTube also said that it is working on an auto-dubbing feature that translates videos into multiple languages. The feature was available to "a small group of creators" but now the platform plans to expand the boundaries. Subscribe to the Benzinga Tech Trends newsletter to get all the latest tech developments delivered to your inbox. Why It Matters: This development is part of Meta's ongoing efforts to integrate AI into its platforms. At the Meta Connect 2024 event, Zuckerberg also highlighted the company's focus on AI, mixed reality, and glasses, stating that the future of computing and human connection is "pretty awesome." The company also unveiled Orion holographic glasses at the Connect event, a wearable technology that allows users to open browsers, respond to messages, and more. Nvidia Corp. CEO Jensen Huang also made an unexpected appearance in a video previewing the Orion glasses. The Orion glasses, which Zuckerberg has envisioned for a decade, are a significant step towards achieving Meta's dream of Reality Labs. Check out more of Benzinga's Consumer Tech coverage by following this link. Read Next: Elon Musk Reacts After Cathie Wood Labels Gavin Newsom's Threat To Sue Tesla CEO Over Memes 'Unconstitutional': '...But That Didn't Stop Them' Disclaimer: This content was partially produced with the help of AI tools and was reviewed and published by Benzinga editors. Photo courtesy: Meta Market News and Data brought to you by Benzinga APIs

Meta will use AI to create lip-synced translations of creators' Reels

Meta just announced an intriguing tool that uses AI to automatically dub Reels into other languages, complete with lip-sync. This feature was revealed at the annual and was introduced by CEO Mark Zuckerberg. Zuckerberg showed off this feature during the keynote, and everything seemed to work flawlessly. The technology not only translates the content, according to Meta, but will also "simulate the speaker's voice in another language and sync their lips to match." It's worth noting, however, that this didn't seem to be a live demo. It's still pretty impressive. As for a rollout, the company says the feature will arrive first to "some creators' videos" in English and Spanish in the US and Latin America. Meta didn't give a timetable here. It just said the US and Latin America will be getting it first, which indicates that it'll be tied to English and Spanish at launch. The company did mention that more languages are coming soon. That wasn't the only AI tool spotlighted during Meta Connect. The company's AI platform will now allow voice chats, with a selection of celebrity voices to choose from. Meta AI is also getting new image capabilities, as it will be able to change and edit photos directly from text chats within Instagram. Messenger and WhatsApp.

Meta announces an AI translation tool that could change the way you watch Instagram and Facebook Reels forever

Meta just announced a new AI translation tool that will allow you to watch Facebook and Instagram reels recorded in different languages, translated into your own. Taking to the stage at Meta Connect 2024, Mark Zuckerberg revealed a whole host of new Meta AI features and one of the coolest is a work-in-progress that could change the way we all consume portrait video on social media. Meta says the AI translation tool will automatically translate the audio of Reels, so you can enjoy content that's been recorded in a different language. The tool uses automatic dubbing and lip syncing to 'simulate the speaker's voice in another language and sync their lips to match.' The company is currently conducting small tests on its social media platforms where it's translating Reels from English and Spanish for creators based in Latin America and the US -- Meta plans to expand to more languages and creators in the future. Meta put a lot of focus on AI at Meta Connect 2024, introducing loads of new AI features across its social media platforms, but the new AI translation tool is one of the most exciting, and could see the way we consume Instagram and Facebook Reels completely change. By automatically translating content and making it appear natural with dubbing and lip syncing, there could be a future where you get access to content from other countries in your Instagram algorithm that's easily watchable without subtitles. As Meta tries to emphasize Instagram's prowess as a portrait video platform against its rivals like TikTok, this new AI translation tool could prompt creators to opt for Meta's platform due to its wider reach across multiple regions and languages. Meta also announced a new voice mode for Meta AI, which will roll out to US, Canada, Australia, and New Zealand over the next month.