Claude voice mode gets major upgrade with new models and third-party tool integration

Claude Voice Mode Gets an Upgrade, Now Powered by New Models - CNET

Blake has over a decade of experience writing for the web, with a focus on mobile phones, where he covered the smartphone boom of the 2010s and the broader tech scene.... Read full bio Claude's voice mode is getting a sizable upgrade, Anthropic announced on Thursday in a blog post. Your voice prompts are now powered by new models, and it's capable of speaking in different languages. The ability to talk to AI chatbots with your voice is nothing new, but Anthropic's latest updates add a bit more than just understanding you better. Voice mode now runs on Claude Opus, Sonnet and Haiku, when it was previously only available on the latter. Using Haiku made for a great, quick conversation with Claude, but without the ability to dive as deeply as other models can. That's now all changed with Thursday's announcement. You can now also change models in the middle of a voice conversation and switch from voice to text with the need of having to start a new conversation. The last feature may sound small, but it can be meaningful if you've had a deep conversation with AI using your voice, but your current situation changes, and you need to switch to a text-only conversation. Talk to your tools It's not just about better models in voice mode -- you can now also talk to your third-party connections in voice mode to perform actions. Now, you can speak directly with the tools you've connected to Claude, like Gmail, Google Calendar, Slack and Canva. In action, you can ask Claude to push back a meeting if you're running late in Google Calendar or tell it to summarize emails and begin drafting responses to the most important ones. As AI becomes more agentic and takes action on your behalf, even for simple things, just talking into your mic makes that experience more seamless. New language support Anthropic has now expanded voice mode significantly with support for new languages. The full list of languages is now: * English * French * German * Hindi * Indonesian * Italian * Japanese * Korean * Portuguese (Brazilian) * Spanish (Latin America) * Spanish (Spain) At the moment, you'll need to manually tell Claude to switch languages, but you can also do that with your voice, too. You can also do this within menus. The new updates to voice mode are available in beta to all users on mobile, desktop and web. There are limitations for free users -- keeping the voice mode model to Haiku and only one connected tool, but with support for all languages. Paid users can access the newly expanded access to new models and all connected third-party applications. Anthropic says that all usage counts towards your typical usage limits.

Claude's voice mode is getting a lot more useful with support for more models and tools

The new update is rolling out in public beta on mobile, desktop, and the web. If you prefer talking to your AI chatbots, Anthropic has some great news for you. The company launched voice mode in Claude last year and started rolling out multilingual support last month. Now, Anthropic is giving the feature a major update that could make it better than the competition. Anthropic announced a couple of new features for Claude's voice mode in an X post today. First, and most importantly, Claude's voice mode no longer relies exclusively on the Haiku model. It can now also use Claude Opus and Sonnet. That means it could lead to a much better experience, with longer conversations and more complex questions. The company also stated that Claude can now use your connected tools in voice mode as well. So, if you've connected apps like Canva, calendar, Notion, or Slack, you can ask Claude to do things using those tools with just your voice. It should be able to edit your calendar entries, create Notion documents, and more, all inside voice mode. I tried using Claude to check my reminders, and it identified and flagged a reminder I set to book tickets for the upcoming Spider-Man movie. It also gave me a quick overview of the other reminders on my phone. That's already a lot more useful than ChatGPT's voice mode, which just tells me it can "explain" how to check reminders on my iPhone. Claude's voice mode improvements are rolling out to users on mobile, desktop, and the web, including those on the free plan. However, the company did specify that it's a "public beta," so if you aren't seeing the new capabilities in voice mode, you'll likely just need to wait it out.