5 Sources
[1]
Meta rolls out AI-powered translations to creators globally, starting with English and Spanish | TechCrunch
Meta is rolling out an AI-powered voice translation feature to all users on Facebook and Instagram globally, the company announced on Tuesday. The new feature, which is available in any market where Meta AI is available, allows creators to translate content into other languages so it can be viewed by a broader audience. The feature was first announced at Meta's Connect developer conference last year, where the company said it would pilot test automatic translations of creators' voices in reels across both Facebook and Instagram. Meta notes that the AI translations will use the sound and tone of the creator's own voice to make the dubbed voice sound authentic when translating the content to a new language. In addition, creators can optionally use a lip sync feature to align the translation with their lip movements, which makes it seem more natural. At launch, the feature supports translations from English to Spanish and vice versa, with more languages to be added over time. These AI translations are available to Facebook creators with 1,000 or more followers and all public Instagram accounts globally, where Meta AI is offered. To access the option, creators can click on "Translate your voice with Meta AI" before publishing their reel. Creators can then toggle the button to turn on translations and choose if they want to include lip syncing, too. When they click "Share now" to publish their reel, the translation will be available automatically. Creators can view translations and lip syncs before they're posted publicly, and can toggle off either option at any time. (Rejecting the translation won't impact the original reel, the company notes.) Viewers watching the translated reel will see a notice at the bottom that indicates it was translated with Meta AI. Those who don't want to see translated reels in select languages can disable this in the settings menu. Creators are also gaining access to a new metric in their Insights panel, where they can see their views by language. This can help them better understand how their content is reaching new audiences via translations -- something that will be more helpful as additional languages are supported over time. Meta recommends that creators who want to use the feature face forward, speak clearly, and avoid covering their mouth when recording. Minimal background noise or music also helps. The feature only supports up to two speakers, and they should not talk over each other for the translation to work. Plus, Facebook creators will be able to upload up to 20 of their own dubbed audio tracks to a reel to expand their audience beyond those in English or Spanish-speaking markets. This is offered in the "Closed captions and translations" section of the Meta Business Suite, and supports the addition of translations both before and after publishing, unlike the AI feature. Meta says more languages will be supported in the future, but did not detail which ones would be next to come or when. "We believe there are lots of amazing creators out there who have potential audiences who don't necessarily speak the same language," explained Instagram head Adam Mosseri, in a post on Instagram. "And if we can help you reach those audiences who speak other languages, reach across cultural and linguistic barriers, we can help you grow your following and get more value out of Instagram and the platform."
[2]
Meta Rolls Out AI Translations for Facebook and Instagram User-Generated Content
Expertise Community solar, state solar policy, solar cost and accessibility, renewable energy, electric vehicles, video games, home internet for gaming. Meta's AI team just pushed new translation tools to Facebook and Instagram, allowing user-generated content to be converted into other languages on the fly. These new tools, which were announced at Meta Connect in 2024, are purportedly meant to bridge the gap between people who speak different languages so that videos and reels can be understood by more audiences internationally. Currently, the one-click translations effectively translate English reels into Spanish (or vice versa), though other languages will be added at a later date. But other languages aren't left out completely for now. A Facebook-only feature lets creators add multiple audio reels to a single video, allowing it to be accessed in as many languages as the uploader provides tracks for. It's unknown whether this feature will come to Instagram at a later date. A representative for Meta did not immediately respond to a request for comment. Additionally, uploaders can opt into an AI lip sync feature that works in tandem with the translations to create what Meta claims are seamless mouth movements in AI-edited videos. The AI lip sync can be turned off using creator controls at any time, which is helpful for anyone who is nervous about AI-generated visual elements in their content. Anyone who creates content for these platforms will also have additional control over how they spread with new tools on the backend. A new metric in the Insights tab will let creators sort through their view count by language, presumably as a way to prove the effectiveness of these AI translations. The suite of AI translation tools follow closely on the heels of a report that signals that Google could soon be adding Duolingo-like AI tools to Google Translate. During the 2025 Google I/O presentation, an on-stage demonstration of Gemini integration for smart glasses showed off what an AI-assisted real-time conversation between people that speak different languages could look like in the near future.
[3]
Meta's AI translation tool can dub your Instagram videos
Meta is bringing its AI translation tool to more users on Facebook and Instagram, which automatically dubs your reels into another language. The feature also uses AI to make its dub match up with the sound of your voice and the movement of your mouth. For now, you can only translate your reels from English to Spanish (and vice versa), similar to what Meta previewed during its Connect event last year. You can enable the tool by selecting the Translate voices with Meta AI toggle on the menu that appears before you publish a reel on Instagram and Facebook. Meta also gives you the option to add lip-syncing to your dubbed video, as well as review it before publishing. Facebook and Instagram will automatically surface translated reels to users in their preferred language. Your videos will also have a tag that discloses that it was translated using Meta AI. The translation tool is rolling out now to Facebook creators with 1,000 or more followers and all public Instagram accounts.
[4]
Meta's AI voice translation feature rolls out globally
On Tuesday, Meta rolled out its new voice dubbing feature globally. The Reels feature uses generative AI to translate your voice, with optional lip-syncing. Mark Zuckerberg first previewed the feature at Meta Connect 2024. At launch, the translations are only available for English to Spanish (and vice versa). The company says more languages will arrive later. At least at first, it's restricted to Facebook creators with 1,000+ followers. However, anyone with a public Instagram account can use it. The tool trains on your original voice and generates a translated audio track to match your tone. The lip-syncing add-on then matches your mouth's movements to the translated speech. The demo clip the company showed last year was spot-on -- eerily so. To use the feature, choose the "Translate your voice with Meta AI" option before publishing a reel. That's also where you can choose to add lip syncing. There's an option to review the AI-translated version before publishing. Viewers will see a pop-up noting that it's an AI translation. Meta says the feature works best for face-to-camera videos. The company recommends avoiding covering your mouth or including excessive background music. It works for up to two speakers, but it's best to avoid overlapping your speech. The company frames the feature as a way for creators to expand their audiences beyond their native tongues. As such, it included a by-language performance tracker, so you can see how well it's doing in each language.
[5]
Meta now offers AI-powered dubbing for video creators - 9to5Mac
Meta announced today a new AI-based translation tool for creators on Instagram and Facebook. The company uses artificial intelligence to automatically dub videos in other languages, with support for lip-syncing and voice cloning that promises to preserve the creator's tone and delivery. Here's how to use it. Right now, the feature supports two-way translations between English and Spanish, and Meta says that "more languages coming in the future". Creators can have their Reels automatically dubbed into the other language, and viewers see the dubbed version in their preferred language, along with a subtle indicator that the video was translated using Meta AI. Meta says that all Instagram users with public accounts and Facebook creators with 1,000+ followers are eligible to use the tool, which is rolling out "in countries where Meta AI is available (excluding the European Union, United Kingdom, South Korea, Brazil, Australia, Nigeria, Turkey, South Africa, Nigeria, Texas and Illinois)." For creators posting on Facebook, this is how you enable the feature: Meta says that once the translation, dubbing, and lip-syncing process is done, you'll be notified so you can review, approve, optionally remove the lip-sync, or delete the translation entirely. You'll also have the option to report translation errors. The company also says that it will provide metrics to help creators understand performance by language so that creators can track which languages their audience is watching. Alternatively, creators can also upload up to 20 translated audio tracks for a single Facebook Reel through the Meta Business Suite platform. Are you a Facebook or Instagram creator? Do you plan on using this feature? Let us know in the comments.
Share
Copy Link
Meta rolls out an AI-driven voice translation feature for Facebook and Instagram creators, enabling automatic dubbing of content from English to Spanish and vice versa, with plans for future language expansions.
Meta has officially launched its AI-powered voice translation feature for creators on Facebook and Instagram globally. This innovative tool, first previewed at Meta Connect 2024, aims to break down language barriers and expand creators' reach across different linguistic audiences 12.
Source: 9to5Mac
The new feature utilizes artificial intelligence to automatically dub videos into other languages while preserving the creator's original voice tone and delivery. Currently, the tool supports translations between English and Spanish, with plans to add more languages in the future 34.
Key aspects of the AI translation feature include:
The feature is now available to:
However, it's important to note that the tool is only accessible in countries where Meta AI is available, with some notable exceptions including the European Union, United Kingdom, and several other regions 5.
Source: CNET
Meta has introduced additional tools to support creators using this feature:
To maintain transparency, viewers will see a notice indicating that the content has been translated using Meta AI. Users also have the option to disable translated reels in specific languages through their settings 13.
Source: TechCrunch
Meta has provided guidelines for creators to achieve the best results:
This AI-powered translation feature represents a significant step in Meta's efforts to connect global audiences and support creator growth. Instagram head Adam Mosseri emphasized the potential for creators to reach audiences across cultural and linguistic barriers 1.
As Meta continues to develop this technology, the addition of more languages and potential expansion to other platforms could further revolutionize content creation and consumption in the social media landscape 23.
Summarized by
Navi
[1]
Databricks raises $1 billion in a new funding round, valuing the company at over $100 billion. The data analytics firm plans to invest in AI database technology and an AI agent platform, positioning itself for growth in the evolving AI market.
11 Sources
Business
13 hrs ago
11 Sources
Business
13 hrs ago
SoftBank makes a significant $2 billion investment in Intel, boosting the chipmaker's efforts to regain its competitive edge in the AI semiconductor market.
22 Sources
Business
21 hrs ago
22 Sources
Business
21 hrs ago
OpenAI introduces ChatGPT Go, a new subscription plan priced at ₹399 ($4.60) per month exclusively for Indian users, offering enhanced features and affordability to capture a larger market share.
15 Sources
Technology
21 hrs ago
15 Sources
Technology
21 hrs ago
Microsoft introduces a new AI-powered 'COPILOT' function in Excel, allowing users to perform complex data analysis and content generation using natural language prompts within spreadsheet cells.
8 Sources
Technology
13 hrs ago
8 Sources
Technology
13 hrs ago
Adobe launches Acrobat Studio, integrating AI assistants and PDF Spaces to transform document management and collaboration, marking a significant evolution in PDF technology.
10 Sources
Technology
13 hrs ago
10 Sources
Technology
13 hrs ago