Google's Magic Cue: The AI-Powered Proactive Assistant Coming to Pixel 10

Google Pixel 10's Magic Cue might just be the proactive assistant you've been waiting for

2023-leaked Pixie assistant, which was originally rumored to make its debut with the Pixel 9 series in 2024, never really saw the light of day. Fast-forward to earlier this year, and a credible report alluded that the Pixie assistant had been rebranded, and it is now expected to make its way to the Pixel 10 series as a new app dubbed 'Pixel Sense.' The standalone will reportedly integrate with multiple other Google apps, allowing it to make contextual suggestions for relevant actions when it makes sense. Now, thanks to a newly-found setup screen, the assistant's previously-leaked functionality seems to have been corroborated, alongside the fact that it might see the light of day with the Pixel 10, albeit with an exciting revelation. Related The Google Now replacement we deserve may finally arrive with the Pixel 10 Pixel Sense is coming Posts 9 The AI-powered contextual assistant is going through another rebrand, with it now reportedly embracing the name Magic Cue. As highlighted by leaker Mystic Leaks on their Telegram group, the new tool will be completely optional to use, with users having to manually "Turn on" the feature from relevant screens. "Get helpful info and actions, right when you need them," reads Magic Cue's initial set-up screen. Magic Cue uses AI to show you useful details and time-saving actions based on the app you're using. For example, if a friend asks for your flight number in a chat, Magic Cue can find it from your Gmail - saving you the search. Magic Cue is essentially a proactive version of Gemini Source: Mystic Leaks on Telegram It isn't entirely clear what the app's UI might look like, though, as seen in the short GIF above, it looks like recommended actions and suggestions will appear as a prompt notification stemming and expanding from your Pixel's status bar. The tool will essentially do what Gemini can already achieve, albeit without manual intervention. For example, with Gemini, you can manually ask the AI Assistant to find your flight number from a recent Gmail email, and it will provide relevant information. Magic Cue will essentially do the same, but without you having to manually trigger it. The initial setup screen also highlights how the tool works. Here's what it says: Magic Cue uses AI to offer you personalized suggestions based on app usage data it collects, your recent screen activity, and certain Google app data. It also uses foundational data, such as the email and phone number from your Google Account. You choose the apps Magic Cue can use data from in Magic Cue settings. These could include Gmail, Calendar, Keep, and Tasks data from your primary Google account, and Contacts, Messages and Screenshots on your device. Your Magic Cue app data and recent screen activity are protected in a secure, isolated environment. Unless you choose to share it, that data is kept private. Magic Cue will likely leverage Gemini Nano to bear the brunt of the operation, ensuring that your data is processed on-device and not shared with Google and its servers. If the assistant is headed to the Pixel 10 series, we're sure to learn more about it in the coming weeks as leaks about the flagship devices ramp up and intensify. The Pixel 10 series is expected to be unveiled on August 20. Related Google Pixel 10 series official launch may have been delayed But you don't have to wait too many days Posts 4

Pixel 10 'Magic Cue' leaks as AI that proactively suggests 'info and actions'

Earlier this year, "Pixel Sense" leaked as "predictive suggestions" for this year's flagships. As the Pixel 10 launch nears, the latest leak reveals that it has been renamed to "Magic Cues," while we have an actual example of what it can do. We pieced together earlier this year that Pixel Sense is not a separate assistant that completes with the Gemini app. With the Pixel 9, Google reportedly wanted to create a "Pixie" assistant for Pixel devices, but that plan was scrapped in favor of the Gemini assistant and the Pixel Screenshots app. We now have a much better idea of what Pixel/Sense Magic Cue is. According to a screen capture from Mystic Leaks today, "Magic Cue uses AI to show you useful details and time-saving actions based on the app you're using." For example, if a friend asks for your flight number in a chat, Magic Cue can find it from your Gmail - saving you the search. It's not clear how Magic Cue is actually invoked on the Pixel 10, or what the interface for it looks like. In the scenario above, it presumably looks at your current screen and can discern the question being asked without you having to prompt it. (As is, you can manually bring up the Gemini overlay and ask that question.) The set-up experience for Magic Cue highlights two tentpoles: Magic Cue uses AI, app usage data, "your recent screen activity," "certain Google app data," and Google Account info like email and phone number. Settings will let you "choose the apps Magic Cue can use data," including "Gmail, Calendar, Keep, and Tasks data from your primary Google account, and Contacts, Messages and Screenshots on your device." Google says "Magic Cue app data and recent screen activity are protected in a secure, isolated environment."

The Pixel 10 May Suggest Actions Based on Your App Usage With 'Magic Cue'

It's unclear whether the feature will be exclusive to the Pixel 10 series Google's Pixel 10 series of smartphones is expected to debut later this year, with the company's fifth generation Tensor G5 chip. Previous reports indicated that Google was working on a new AI feature that could provide contextual suggestions based on a user's activity on their smartphone, and a new leak reveals that this feature might be called Magic Cue. Users might be able to use their Pixel smartphone to quickly access information from various Google services and the screenshots on their device. Last week, a tipster leaked screenshots of a new feature called "Magic Cue" on their Telegram channel (via 9to5Google), that has yet to be announced. The description of the feature indicates that it will provide contextual suggestions and even perform certain actions on their behalf in the background, by accessing their information across most of the company's services. Magic Cue on a Pixel smartphone Photo Credit: Mystic Leaks (@mysticleaks) via Telegram The images shared by the tipster also include an example of the Magic Cue feature in action on a Pixel smartphone. If you're texting a friend, and they ask you for your flight number, your phone would be able to use Magic Cue to search your email inbox for the details provided by the airline on your behalf. Magic Cue will work across Google's services, including Calendar, Gmail, Keep, and Tasks. It will also be able to access data stored on a user's smartphone, including their messages and contact information. The screengrab for the Magic Cue feature shared by the leaker also suggests that it will be able to access information from screenshots on the handset. Google's Pixel Screenshots app already uses AI processing to glean important information that can be searched, and it sounds like the Magic Cue feature will be capable of accessing these details automatically. It appears that the Magic Cue feature will also rely on recent screen activity, and app usage data, which could have a negative impact on user privacy, especially when using apps that handle sensitive information. The leaked screenshot contains a privacy disclaimer that states that Google stores recent screen activity and Magic Cue app data in a "secure, isolated environment" on a user's device. The data is said to be kept private unless a user chooses to share it. It's currently unclear whether Google's Magic Cue feature will be limited to the Pixel 10 series of smartphones, or whether it will also be available on the current Pixel 9 lineup and older models. We might learn more about the feature in the coming weeks, as the Pixel 10 series is expected to arrive by September or October, if the company's previous launch schedules are any indication.