Google's Gemini AI Powers Advanced Robot Navigation and Interaction

Robots equipped with Google Gemini navigate office spaces - ExBulletin

With the help of a robot, Google has found a new way to show what its Gemini AI model is capable of. This is a robot from Google's Everybody Robots division, which was shut down last year, but apparently the robots still exist, as Google fitted one of them with a yellow bow tie and used Gemini to teach the robot how to respond to commands and navigate around the DeepMind office space. To achieve this, Google is using visual language models (VLMs) that are trained on images and videos in addition to text to help answer questions and perform tasks that require perception. For example, in one video, a Google employee asks the robot to take him somewhere to draw a picture. The robot says it needs a minute to think about it and takes the employee to a whiteboard. In another video, the robot is told to follow instructions on a whiteboard, which has a map showing directions to a place called the Blue Area. The robot follows the directions to the robotics testing area and announces that it successfully followed the instructions on the whiteboard. Press play to see the robot in action and let us know what you think in the comments. What Are The Main Benefits Of Comparing Car Insurance Quotes Online

Watch: A robot navigates an office space with Google Gemini

Google found a new way to demonstrate what its Gemini AI model can do, with help from a robot. This was a robot from Google's Everybody Robots Division, which was shut down last year. But apparently the robots are still around, so Google put a yellow bowtie on one of them then used Gemini to teach the robot how to respond to commands and navigate the DeepMind office space. To accomplish this, Google is using vision language models VLMs that are trained on images and videos along with text, allowing them to answer questions and perform tasks that require perception. For example, in one video a Google employee asks the robot to take him somewhere to draw things. The robot says it needs a minute to think, then it takes the employee to a white board. In another video, the robot is told to follow the directions on the whiteboard, where a map shows directions to get to what's called the Blue Area. The robot follows the directions to a robotics testing area then announces, "I've successfully followed the directions on the whiteboard." Hit play to see the robot in action, then let us know what you think in the comments!

Google Is Now Using Gemini AI To Train Robots 'Navigate The World': Here's How - News18

Google seems to having trouble with AI for search but the tech is making its impact for robots who are being trained using the Gemini model. Google has joined the trend with Gemini designing robots to understand surroundings, handle complex tasks, and remember information. While these developments may not yet equate to having a personal assistant, we are getting closer to truly useful robot helpers for everyday use. Recently, Google's DeepMind team demonstrated how Gemini1.5 enables robots to record important locations and navigate seamlessly in real-world scenarios. In the video shared on Instagram, a team member showed how a robot took them to a whiteboard when asked to show the place where they could draw. After the command, the robot could be heard saying, "Okay, thinking with Gemini. Please give me a minute." While the experiment looks promising, there is a noticeable delay of up to a minute between the robot receiving a request and taking action. Despite this, Google's project offers a sneak peek into how these robots might function in our homes shortly and offices in the near future. Sharing the intriguing clip, the team explained, "With help from Gemini1.5 Pro's long context window, we challenged our helper robots to navigate their way around our busy office." To train the robot, the DeepMind team took the machine through various areas and showed important locations and objects. The robot then creates a mental map to remember these places and items for later use. Although it's still in the early stages, the Gemini robot could offer even more precise details in the future. According to a research paper published by DeepMind, the robot showed a 90 per cent success rate on over 50 user instructions within a 9,000-square-foot area. The team also found out thatGemini1.5 Pro allows the robot to plan actions other than simple navigation. As highlighted in the paper, if a user, who has multiple cans of Coke in their desk, asks if their favorite drink is available in the kitchen, the Gemini"knows that the robot should navigate to the fridge, inspect if there are Cokes, and then return to the user to report the result." Meanwhile, the team plans to explore these capabilities further.