Google Translate Unveils AI-Powered Live Translation and Language Learning Features

Google Translate takes on Duolingo with new language learning tools | TechCrunch

Google is rolling out a new AI-powered experimental feature in Google Translate designed to help people practice and learn a new language, the company announced on Tuesday. Translate is also gaining new live capabilities to make it easier to communicate in real time with a person speaking a different language. The new language practice feature is designed for both beginners starting to learn conversational skills and advanced speakers looking to brush up on their vocabulary, the company says. To do so, it creates tailored listening and speaking practice sessions that adapt to a user's skill level and unique learning goals. With this new language practice feature, Google is taking on Duolingo, the popular language learning app that uses a gamified approach to help users practice over 40 languages. To access the feature, you'll select the "practice" option in the Google Translate app. From there, you can set their skill level and goals. Google Translate then generates customized scenarios where you can either listen to conversations and tap the words you hear to build comprehension, or you can practice speaking. The exercises track users' daily progress, Google says. The beta experience is rolling out in the Google Translate app for Android and iOS starting Tuesday. The feature is available first for English speakers practicing Spanish and French, as well as for Spanish, French, and Portuguese speakers practicing English. Google is also introducing the ability for users to have back-and-forth conversations with audio and on-screen translations through the Translate app. "Building on our existing live conversation experience, our advanced AI models are now making it even easier to have a live conversation in more than 70 languages -- including Arabic, French, Hindi, Korean, Spanish, and Tamil," Google wrote in a blog post. You can tap the "Live translate" option in the Translate app and then select the language you want to translate by simply speaking. You'll then hear the translation aloud alongside a transcript of your conversation in both languages. The app will translate and switch between the two languages that you and the other person are speaking. Google notes that the feature can identify pauses, accents, and intonations to allow for a natural-sounding conversation. The feature uses Google's voice and speech recognition models to isolate sounds, which means you would be able to use the live capabilities in a loud restaurant or busy airport. These live translation capabilities are available starting Tuesday for users in the U.S., India, and Mexico. "These updates are made possible by advancements in AI and machine learning," Google wrote in its blog post. "As we continue to push the boundaries of language processing and understanding, we are able to serve a wider range of languages and improve the quality and speed of translations. And with our Gemini models in Translate, we've been able to take huge strides in translation quality, multimodal translation, and text-to-speech (TTS) capabilities." Google says that people translate around 1 trillion words across Translate, Search, Lens, and Circle to Search. The company believes these new AI-powered features will help overcome language barriers.

Google's AI Live Translation and Learning Tools Are Here. How to Use Them

Named a Tech Media Trailblazer by the Consumer Technology Association in 2019, a winner of SPJ NorCal's Excellence in Journalism Awards in 2022 and has three times been a finalist in the LA Press Club's National Arts & Entertainment Journalism Awards. Google Translate is getting an AI upgrade designed to make real-time conversations and language learning easier. The update is rolling out this week in the Translate app on iOS and Android. The first tool, for live translations, lets you have a back-and-forth conversation with someone by surfacing audio and text translations as you speak, so you can easily follow along. Advanced Gemini models allow for support of more than 70 languages, including Arabic, French, Hindi, Korean and Spanish. Google says its voice and speech recognition models are trained to isolate sounds, so the live translation feature should also work in noisy environments like an airport or a cafe. I gave the Arabic translation a spin, and it did a good job picking up on even unconventional Iraqi slang. And judging from my intermediate knowledge of Spanish, it also did well translating my rambling. I also like that Translate offers up both a text and audio translations, so you can go with whichever medium you prefer or revisit what was said via the on-screen text. A second feature is designed to help you practice a new language. You can choose whether you currently have a basic, intermediate or advanced understanding of the language you're learning, and then set a goal. For example, I noted I wanted to practice Spanish so I could get around the city and have casual conversations (hearkening to my days at Mobile World Congress in Barcelona when I ambitiously dusted off my high school Spanish). Translate will then surface recommended scenarios like asking for the nearest bus stop, greeting a neighbor or chatting about your hobbies. You can then choose either a listening or speaking exercise. In the listening sessions, you'll tap the words you hear, and in the speaking one, you can practice having a back-and-forth conversation. The language learning feature is currently available for English speakers practicing Spanish and French, and for Spanish, French and Portuguese speakers practicing English. "These updates are made possible by advancements in AI and machine learning," Google Product Manager Matt Sheets said in a blog post. "As we continue to push the boundaries of language processing and understanding, we are able to serve a wider range of languages and improve the quality and speed of translations. And with our Gemini models in Translate, we've been able to take huge strides in translation quality, multimodal translation, and text-to-speech capabilities." This comes as Google adds other language-specific features like Voice Translate on the Pixel 10 series. That feature can also translate what someone is saying in real time but while chatting on the phone, and goes the extra mile of mimicking the sound of their voice, instead of superimposing a robotic one. Gemini Live can also have a back-and-forth conversation in a handful of languages. And last year, Google Translate added 110 new languages thanks to AI advancements. The live translate and language learning capabilities in Google Translate are rolling out now on iOS and Android. Live translations are currently limited to users in the US, India and Mexico. To access the new features, open up the Google Translate app, which you can download in the Apple App Store or Google Play. You'll see a tab for "Live translate" on the bottom left, and another for "Practice," the language learning tool, on the right. When you go into Live translate, you can pick which languages you want to translate and then start talking. The translated audio and text will automatically appear. Tapping into Practice will prompt you to set up the language, level and goal you're looking to meet, and then lead you to tailored exercises.

Google is building a Duolingo rival into the Translate app

Google is putting AI-powered language learning tools into its Translate app. The new feature, rolling out now in beta, can create customized language lessons based on your skill level and your purpose for picking up a new language, such as vacationing in another country. For now, Google Translate can only help English speakers practice Spanish and French, as well as help Spanish, French, and Portuguese speakers practice English. When you tap the new Practice button in the Google Translate app, you can select your skill level and describe your goal. You can also choose from preset scenarios, such as using the language for professional conversations, everyday interactions, talking with friends and family, and more. Google will then use its Gemini AI models to generate a lesson based on your response. If you tell Google that you have intermediate Spanish skills and want to communicate with your host family while studying abroad, Translate might create a recommended scenario to help you learn about meal times. From there, you can either practice speaking about the topic with Translate or listen to conversations and tap the words you recognize. "These exercises track your daily progress and help you build the skills you need to communicate in another language with confidence," Matt Sheets, a product manager at Google, said during a press briefing. The setup sounds a bit similar to Duolingo, which also tailors lesson plans based on your skill level and goals. Additionally, Google has launched a live translation feature in the Translate app, allowing you to have back-and-forth conversations with someone even if you don't speak the same language. The feature translates your speech into your speaker's preferred language by creating an AI-generated transcription and audio translation, and vice versa. Unlike live translation on the Google Pixel 10, the Google Translate app doesn't try to make the AI-generated audio sound like your voice, but Sheets told reporters that the company is "experimenting with different options there." Live translation is currently available to users in the US, India, and Mexico, and works in more than 70 languages, including Arabic, French, Hindi, Korean, Spanish, and Tamil.

Google can translate your voice in real time now - try it free

Users in select countries can access both features for free in the Google Translate app. Google Translate has been a go-to source for people's translating needs for nearly two decades. While AI has been powering the tool since its inception, generative AI's advanced language processing has made it possible for Google to unlock all-new experiences that level it up. Also: I tried every new AI feature on the Google Pixel 10 series - my thoughts as an AI expert You can now speak to Google Translate and have it translate your input in real time to another language, the company said Tuesday. Google also introduced a language learning experience powered by generative AI that gamifies learning a new language. Users can access both for free today. ZDNET has yet to test either feature. For more on the features and how to access, keep reading below. With the new feature, users simply click on "Live translate" in the Translate app for Android or iOS, speak into the mic, and hear the translation out loud. Users will also be able to follow along with a transcript of the conversation onscreen that switches between both languages on the device. These capabilities are already available today for users in US, India, and Mexico, according to Google. Also: You should use Gemini's new 'incognito' chat mode - here's why and what it does The goal is to create a more seamless handoff between in-person exchanges for more natural, free-flowing conversations. Translating languages in real time is one area in which generative AI tools excel because they have enough data to interpret not only the direct translations of the text but also the context around it that gives it its nuanced meanings. Historically, Google Translate has been a platform for helping translate content in a language you don't know. Now, users can also use it to learn more about a new language. The new language practice feature creates tailored sessions for you, adapting to your skill level. Google said that each exercise was developed with learning experts. You will be given the option to listen to conversations, tap on the words you hear, or practice speaking. To access the feature, you just have to hit "practice" on the app, set your skill level and goals, and access your customized session. This feature is being rolled out in beta in the e Translate app for Android and iOS starting today, first available to English speakers practicing Spanish and French, and Spanish, French, and Portuguese speakers practicing English. Also: My top 5 free AI tools for school - and how they can help supercharge your learning The tech industry at large is releasing more AI features timed with back-to-school season. For example, Anthropic launched a new Learning Mode available to everyone in its Claude.ai chatbot and Claude Code, meant to encourage user learning as opposed to answer generation. OpenAI released its own Study Mode, which similarly works with users to arrive at a conclusion (though to varying degrees of success). In perhaps one of the best AI deals available to students right now, Google made its AI Pro plan, which includes all of the best of Google's AI suite of tools, including expanded access to Gemini 2.5 Pro, Deep Research, Veo 3, Jules, and, NotebookLM, free to college students, saving them the $20 per month subscription.

Google Translate Enlists AI for Live Translation and Language Lessons

Duolingo's green owl may be coming up with a lot of foreign words for 'exasperation' right now. Don't miss out on our latest stories. Add PCMag as a preferred source on Google. Google Translate may have started out as a glorified digital dictionary, but it's grown into an increasingly capable interpreter. With the help of AI, it's now ready to serve as a tutor with new live translation and language-lesson features built on the Gemini platform. The first, as shown off in a preview call for journalists on Monday, seems a considerable step up in usefulness from the "Conversation" mode in the current app. Instead of the app listening to somebody else's speech and displaying a translation you can then play back as audio, the new "Live Translate" mode does this in near real time, alternating automatically between parties in a conversation to speak each one's words in the other's language. It evokes the live translation mode that Google demoed in Google Meet at its I/O developer conference in May, except that one requires a subscription while this one is free with Translate, at least for now. It will, however, require a connection (which, if you have an unlocked phone, will be cheaper internationally with the right eSIM). Google says this feature supports more than 70 languages -- fewer than the 251 total, including regional and national dialects, that this app supports after a series of linguistic expansions. But it's first rolling it out only in the US, Mexico, and India. Considering the competition Translate has been facing from AI chatbots, we expect its geographic reach to expand rapidly. Google vs. Duolingo? Google's second news about Translate may enable some users to rely on it less often in conversations with strangers overseas by teaching them other languages in brief, everyday practice lessons. Google is also taking it slow with this feature, labeling it a beta and initially offering it only for English speakers learning French, Spanish, or French, as well as Portuguese and Spanish speakers learning English. Google touts these practice drills as personalized to your own scenario. You can type a plain-language description of what you hope to accomplish, such as "ordering like a local in restaurants during my business trip to Spain," or select broad categories like "Professional conversations," "Everyday interactions," and "Travel and transportation." The demo I saw on Monday was vocabulary-driven. It invited a user to tap words in Spanish that they recognized in a spoken sentence and then try speaking sentences with hints from the app. Leaks about this lesson feature emerged in August when Android Authority unearthed it in a new version of the app and gave it a try. Their report included a screenshot of an introductory screen describing the tutorial mode as being in a "trial period" that "gives you early and unlimited access," implying a subscription requirement at some point or for some level of use. But Google isn't talking about any possible paid modes for this feature yet. These AI-driven lessons seem short of the broader variety of tutoring available in apps like Duolingo, which already offers free and paid modes. But the developers of that widely used app (who experienced their own anti-AI backlash this year) can't be thrilled at the prospect of Google getting into their language-lesson lane. The progress of Translate and other apps like it in offering real-time translation in a variety of foreign languages has already led to suggestions that people will find the entire idea of learning other languages obsolete. When a journalist asked about that, Translate product manager Matt Sheets pushed back against the idea of relying on your phone as your protocol droid. "There's something really powerful about being able to speak directly with someone else yourself," he said. Today's updates are available in Translate's Android and iOS apps.

Google Translate is ready to replace Duolingo in your life

Translate is also getting some upgrades to its live translation mode, all thanks to AI. For all the controversy surrounding AI when it comes to things like content generation, or hallucinating wildly incorrect facts when attempting to answer questions, most of us would agree that it works quite well when it comes to analyzing language. That opens the door for some powerful communication tools, breaking down barriers between people who speak different tongues. But what's the best way to approach that: using AI to translate directly, or using AI to efficiently teach people new use languages? If you're Google Translate, the answer is apparently, "why not both?"

Google Translate Can Now Help You Learn a New Language

Google has a lot of different apps and services, but one that is often overlooked is Google Translate. However, that's about to change, as the company just unveiled a slew of new language learning tools coming to Google Translate, including conversational experiences to help you learn. While Google Translate has always been an app you could use to learn a new language, it's about to get a lot better. Google is rolling out new AI-powered features designed around language learning, and apps like Duolingo better watch out. Google says advancements to its Gemini AI model have improved translation quality, multimodal translation, text-to-speech, and now conversational teaching tools. If you're interested in learning a new language, Google has you covered. Right inside the Google Translate app, you'll find a bunch of new live capabilities that not only make it easier to communicate with people speaking a different language but also allow you to interact with the app yourself and learn at home. You can create customized language lessons based on your skills, which makes it great for beginners, advanced learners, and anyone who wants to brush up on their vocabulary. For now, Google Translate will help you learn Spanish or French and help Spanish, French, and Portuguese speakers practice English, with more potentially coming soon. However, remember that these are experimental features, so we'll have to wait and see how things improve or evolve over time. Here's what Google said: "Google Translate is already a powerful tool for learning a new language. But we've heard from our users that the toughest skill to master is conversation -- specifically, learning to listen and speak with confidence on the topics you care about. So today we're piloting a new language practice feature designed to help you meet your unique learning goals." To get started, download the Google Translate app and tap on "Practice," and you're all set. From here, the app will ask about your skill levels, what you're trying to learn, or your overall goals. You can even tap on preset scenarios, like a conversation at dinner, daily interactions, or common words. Then, its Gemini AI models will do all the heavy lifting and create a language learning model for you to take advantage of. It's like an interactive game, where you can listen to the words and tap each corresponding word, or you can choose to practice speaking the words yourself, with helpful hints and feedback. According to Google, this entire tool was developed with the help of several language learning experts, and it'll even track your daily progress to help you talk and communicate confidently. Additionally, Google Translate will now do a better job with live translation while you're actively conversing with someone who doesn't speak the same language. Instead of taking turns talking and holding the phone, it'll all happen automatically. Google will translate your speech into the preferred language and say it out loud with AI-generated sound and transcripts, making it faster and easier to communicate. Source: Google Blog

I can't believe how much easier travel just got, thanks to Google Translate's latest update

Google Translate is one of those apps you can't live without when traveling abroad. Not only is it great for understanding posted signs or menus in a foreign language, but it can even translate conversations, making it much easier to communicate with people you otherwise couldn't. While the experience is already pretty good, it's now getting even better thanks to some new updates from Google. The brand is making improvements to live translations, making conversations fluid and seamless, while also letting users learn a new language using new tools directly from the Translate app. Things are getting interesting Although welcome, these changes don't come as a complete surprise, as we caught wind of these updates ahead of its official release. While the Translate app has had live translations in place for conversations, the feature is now getting a small boost thanks to AI, and is available now in more than 70 languages. With the new update, the app will now feature a large button with a microphone icon that can be used to translate conversations on the fly. All you have to do is start speaking, and the app will capture what's being said, translate it into text, and also read the translation aloud so that others nearby can hear it in the translated language. What's great is that you can just have a normal conversation between two people and the app will smoothly transition from one language to another without any issues. All of this is now powered by Google's advanced voice and speech recognition models. It's much improved from the older translation feature, with the ability to produce accurate translations even in the busiest locations. If that wasn't enough, Translate will now also have a powerful tool to help you learn a new language as well. Google's new tool will help users to hear and speak a new language with custom learning sessions. You can start these learning sessions at any time in the app by hitting the Practice icon. As you learn, the lessons will evolve to help you progress at a better pace. For the time being, this feature will be in beta, and will be limited to just a few languages. You can give the new Translate app a try just by updating your app in the Google Play Store. This app is also available for iOS as well.

Google Translate adding AI-powered live translation and custom language practice

Thanks to the latest AI and machine learning advancements, Google Translate is adding a new live translate mode and language practice tool. Google credits Gemini AI models in Translate as helping improve translation quality, multimodal translation, and text-to-speech (TTS). We're going far beyond simple language-to-language translation, and delivering an experience that helps you learn, understand and navigate conversations with ease. The new "Live translate" capability lets you have a "back-and-forth conversation in real time with audio and on-screen translations." After launching the new interface, select the languages you want, with 70 supported: Arabic, French, Hindi, Korean, Spanish, Tamil, and more. With a thread-based interface, Google Translate will "smoothly" switch between the pairing by "intelligently identifying conversational pauses," as well as accents and intonations. Meanwhile, advanced voice and speech recognition models have been trained to isolate sounds and work in noisy, real-world environments. Replacing the existing offering, this is rolling out now to Google Translate on Android and iOS for users in the US, Mexico, and India. Meanwhile, Google Translate is getting language learning capabilities. Specifically, Google is focusing on helping you practice conversations. You specify your skill level (below) and goal in an equally conversational manner, or select from presets like "Everyday interactions" or "Travel and transportation." The Translate app will create "tailored listening and speaking practice sessions just for you." After picking a scenario, like "Ask about meal times," you select whether you want to: Google will "track your daily progress and help you build the skills you need to communicate in another language with confidence." This is rolling out beginning today in beta in Google Translate for Android and iOS: "available first for English speakers practicing Spanish and French, as well as for Spanish, French and Portuguese speakers practicing English." During this period, it's free to use.

Google Translate Just Got A Huge Upgrade -- Live Conversations And Language Practice Are Here

Google Translate has long been a go-to app for travelers and anyone interested in learning languages. But, this new update takes the app offering to new levels. Powered by Google's Gemini AI models, Translate is rolling out new live translation tools for real-time conversations and an experimental practice mode designed to help anyone actually master a new language. If you're like me, you've stumbled through conversations abroad. Whether ordering food or asking for directions, getting around comfortably in a foreign country can be frustrating. That's why this update in particular could be a game changer. Google Translate now supports back-and-forth conversations in more than 70 languages, including Arabic, Hindi, Korean, Spanish and Tamil. Open the Translate app on Android or iOS, tap "Live translate," then choose the languages and start speaking. The app automatically identifies pauses, accents and intonations, translating your words aloud and showing transcripts for both sides of the conversation on-screen. Google says its upgraded speech recognition models are tuned for noisy real-world settings, which means it can be easily used in a busy airport or crowded restaurant. The new live conversation feature is available today (Aug 26) in the U.S., India and Mexico. Google is also piloting a new feature to help you go beyond simple word lookups. The "practice" tool creates interactive listening and speaking exercises tailored to your skill level and goals. Instead of memorizing phrases, you can practice real conversational scenarios; complete with hints if you get stuck. Whether you're brushing up on Spanish before a trip or learning French from scratch, Translate adapts to your level. The app tracks your daily progress, helps you build confidence in listening and speaking, and even lets you target vocabulary you care about most. Launching today, the beta is available on Android and iOS. At first, it's available for English speakers practicing Spanish and French, and for Spanish, French and Portuguese speakers practicing English. Google says over 1 trillion words are translated across its services every month, from Translate to Lens to Circle to Search. By infusing Gemini's multimodal reasoning into Translate, the company is offering the benefits of simple text-to-text translation for an easy, natural conversation assistant. This update helps users easily understand the around them, even in foreign countries, while learning a new language along the way. If you've ever wished your phone could act like a real-time interpreter or a personal tutor, Google Translate is suddenly a lot closer to that vision.

Google Translate is using AI to help users learn languages

Google is using Gemini AI to increase the power of Google Translate. Now, Translate allows users to practice new languages by creating personalized listening and speaking practice sessions in their preferred language. Sounds a little bit like Duolingo without its iconic mascot. "Whether you're an early learner looking to begin practicing conversation or an advanced speaker looking to brush up on vocabulary for an upcoming trip, Translate can now create tailored listening and speaking practice sessions just for you," Matt Sheets, a product manager at Google, wrote in a blog post on Tuesday. "These interactive practices are generated on-the-fly and intelligently adapt to your skill level." It's pretty simple to get started. Open the Google Translate app, select "practice," set your skill level and goals, and voila! Translate will create a scenario specifically for you. "In each scenario, you can either listen to conversations and tap the words you hear to build comprehension, or you can practice speaking with helpful hints available when you need them," Sheets wrote. Google Translate will track your progress with each lesson. "Following positive feedback from early testers, we're excited to start rolling out this beta experience more broadly in the Translate app for Android and iOS this week," the blog reads. "It's available first for English speakers practicing Spanish and French, as well as for Spanish, French and Portuguese speakers practicing English." Google also announced other updates to its language learning tools, like real-time translations in the Translate app. All of these updates come from Google's AI and machine learning, which it says have helped the company to make "huge strides in translation quality, multimodal translation, and text-to-speech (TTS) capabilities." "Every month, people translate around 1 trillion words across Google Translate, Search and in visual translations in Lens and Circle to Search," Sheets wrote. "Now, thanks to AI, we're making it even more effortless to overcome language barriers."

New AI-powered live translation and language learning tools in Google Translate

Every month, people translate around 1 trillion words across Google Translate, Search and in visual translations in Lens and Circle to Search. Now, thanks to AI, we're making it even more effortless to overcome language barriers. Using the advanced reasoning and multimodal capabilities of Gemini models, we're bringing two new features to Translate to help with live conversations and language learning. Exploring the world is more meaningful when you can easily connect with the people you meet along the way. To help with this, we've introduced the ability to have a back-and-forth conversation in real time with audio and on-screen translations through the Translate app. Building on our existing live conversation experience, our advanced AI models are now making it even easier to have a live conversation in more than 70 languages -- including Arabic, French, Hindi, Korean, Spanish, and Tamil. To try it out, open the Translate app for Android or iOS, tap on "Live translate," select the languages you want to translate and simply begin speaking. You'll hear the translation aloud and see a transcript of your conversation in both languages on your device. Translate smoothly switches between the two languages you and your language partner are speaking, intelligently identifying conversational pauses, accents and intonations. This allows you to have a natural conversation with just a single tap.

Google Is Now Rolling Out an AI-Powered Duolingo Competitor

In addition, Google Translate now has real-time live translation for the app's Conversation feature. Did you know you can customize Google to filter out garbage? Take these steps for better search results, including adding my work at Lifehacker as a preferred source. Google is rolling out two new AI-powered features for Google Translate this week, and it might not be good news for Duolingo. The app now generates practice sessions for you to either listen or speak along with. These lessons are generated by AI, and, according to Google, "intelligently adapt to your skill level." It follows a different AI-powered experiment Google launched back in April called "Language Lessons," though Google Translate's implementation seems a bit more basic. This feature is rolling out this week on iOS and Android in beta. It doesn't seem to have landed on my Translate app yet, but here's how Google says it'll work: First, Google Translate will ask you how skilled you are in the current language: "Basic," which means you know some words and phrases; "Intermediate," which means you can express opinions and chat about everyday things; and "Advanced," which means you can talk about a myriad of subjects in-depth. (There is also going to be a "Just starting" option, but it's not yet available.) Once you make your choice, you can share your motivation for learning the language -- either something you write yourself, or something you choose from the app. (You can skip this if you want, though I imagine it helps the AI focus on lessons tailored to your learning goals.) From here, the app generates experiences for you to practice with. For example, it might suggest a scenario in which you practice asking about different meal times. If you choose this scenario, you then pick whether you'd like to practice listening or speaking. Your listening practice may play you a short clip of someone speaking in your target language, then have you select words from a list you recognize. Speaking practices may have you saying phrases that appear on-screen. It's simple, but it could be effective. Google says it worked with "learning experts" to develop these tools based on the latest research in language acquisition. If I can learn how to better speak and understand Portuguese for free, that sounds good to me, but only time will tell whether this is on-par with a dedicated language learning app like Duolingo. The other new feature here is an upgrade to the existing "live conversation" feature. The idea is to turn on live conversation and to start speaking to the other person as you normally would. Then, the app translates what you said, and shows that translation to the other person. The new upgrade, however, appears to push the feature a bit further. Now, the app will translate what you're saying in real time, so the other person can read the translation as you're speaking. If they want or need to hear the translation in full, the app will read out for transcript once you're done speaking. Google says this feature works for live conversations in over 70 languages, including Arabic, French, Hindi, Korean, Spanish, and Tamil, and are available in Google Translate for users in the U.S., India, and Mexico. You can see an example of how this new experience works from this video. When I tried it out, the app does seem to translate pretty quickly, which I can only imagine makes conversation easier:

Google Translate's AI upgrade finally makes real-time conversations actually useful - Phandroid

Google Translate is getting a significant AI update that brings live, real-time translations to the forefront of language communication. Moreover, this Google Translate AI upgrade represents a major leap forward from the app's traditional text-based approach. In fact, it introduces features that could genuinely transform how we interact with each other. The centerpiece of this Google Translate AI upgrade is the new live conversation feature. Specifically, it supports two-way conversations with on-screen translations in over 70 languages. As a result, users can engage in natural dialogue without the awkward back-and-forth of traditional translation apps. Furthermore, the system can detect natural pauses and switches between languages seamlessly. This creates a flow that feels remarkably close to having a human interpreter present. What makes this particularly impressive is the technology's ability to function in real-world conditions. Notably, Google Translate's live capabilities use advanced voice and speech recognition models. These models are trained to help isolate sounds. Consequently, you get a high-quality experience in the real world, like in busy airports or noisy cafes. Beyond live translation, Google is also introducing a new pilot feature to help users learn new languages. Therefore, this positions the app as a potential competitor to dedicated language learning platforms. The feature offers personalized practice sessions based on individual skill levels and goals. Additionally, it creates tailored listening and speaking exercises. As a result, Google Translate moves beyond simple translation into active language education. This Google Translate AI upgrade builds on Google's recent efforts to enhance the platform. Last year, the company added over 100 new languages using AI technology. Meanwhile, we've already seen hints of upcoming Gemini AI integration that promises even smarter translations. Currently, the live features are rolling out to users in the US, India, and Mexico.

Google Translate's New AI Feature Will Let You Practice New Languages

Google Translate now also supports two-way real-time audio translation Google Translate is getting an artificial intelligence (AI) upgrade that adds two new utility features. The Mountain View-based tech giant's translation app has so far allowed users to copy-paste to type text and get instant translation across a large selection of languages. Now, the tech giant is using its Gemini AI models to add two new features -- a live translate feature aimed at letting two individuals speaking different languages communicate, and a practice language feature that lets users learn new languages, similar to apps like Duolingo. Google Translate Is Getting Two New AI Features In a blog post, the tech giant detailed the two new features coming to the Google Translate app on both Android and iOS in India, Mexico, and the US. The first feature is Live Translate, which allows users to communicate with people with different native languages. After opening the Translate app, users will now see a new icon at the bottom left side of the interface with the label "Live translate." Tapping on it opens a new page where users can set up the two languages. Then, they can turn on the microphone, and the app begins processing and transcribing the spoken words into the native language and into the translated language. At the top of the interface, there is a message bubble icon, tapping which opens a two-directional layout. This is helpful when the two individuals are facing each other and would still want to see the translation for an effective conversation. Google says the feature uses AI to identify conversational pauses, accents, and intonations. The second feature takes the utility of the Translate app from a simple translation tool to a language coach. Google has added a new "practice" option in the app that allows users to create tailored listening and speaking practice sessions. These sessions can be customised based on whether the user is a beginner or an advanced speaker. "These interactive practices are generated on-the-fly and intelligently adapt to your skill level," the post said. Similar to Duolingo, the practice feature allows users to brush up on a new language by either listening to a conversation and tapping the words they have heard to build comprehension, or practising speaking with hints available. Google claims these sessions were developed by collaborating with learning experts based on the latest studies in language acquisition. Currently available in beta, the initial version of the feature will allow English speakers to practice Spanish and French, and Spanish, French, and Portuguese speakers to practice English.

Google Translate Upgrade: Speak, Translate, and Practice in 70 Languages With Gemini AI

Google Translate Gets a Gemini AI Overhaul for Live Conversations and Language Learning Google Translate has made a giant leap, allowing users to engage in live, two-way conversations in more than 70 languages, such as Hindi, Tamil, Spanish, Arabic, Korean, and many others. Powered by Google's Gemini AI, the app listens to a user, instantly translates what is spoken, and even verbalizes the translated words. Next, a transcript is displayed on screen so that users can keep up with the conversation carefully. This new update has several practical use cases. For example, tourists using busy airports, consumers chatting with international suppliers, or businesspeople holding cross-border meetings can now converse without language difficulties. The feature is optimized to work in noisy settings, picking up phrases clearly even in the presence of background conversations. For the time being, Android and iOS phones in India, the United States, and Mexico have access to this upgrade.