2 Sources
[1]
Google 'Magic Cue' AI will read your screen to provide helpful suggestions
Google is expected to debut the feature on the Pixel 10 series next month. The Google Pixel 10 series is launching in a little over three weeks, but as usual, a lot of information has already leaked about it. We previously reported on one of its biggest new features: a powerful contextual AI assistant called Pixel Sense. Last month, alleged screenshots of the assistant were leaked, revealing it might launch under a different name. Whatever it's called, it's clear that Google is working on some kind of new AI assistant, and the latest Android Canary build corroborates this.
[2]
Latest Android Canary build sheds light on Pixel's upcoming proactive assistant
In June, we caught wind of an upcoming Pixel feature called Magic Cue. Apparently an evolution of an AI assistant project for Pixel phones initially conceived as Pixie, Magic Cue will reportedly "show you useful details and time-saving actions based on the app you're using." Now, thanks to reporting by Mishaal Rahman for Android Authority, we've gotten more official confirmation Magic Cue exists from code in the latest Android Canary build. Rahman writes that, in the latest Android Canary build's SystemUI app, Android Authority found code that references the features previously referred to as Magic Cue. An alert titled "Get helpful suggestions" reads that "We use AI to proactively suggest info and actions relevant to what you're doing on screen." There's also text that says you can "see how suggestions are generated." A Magic Cue onboarding flow leaked in June. None of the code in this Android Canary build refers to Magic Cue by name, and non-user-facing parts of the code even make reference to a feature called "ambient cue." But as Rahman explains, the feature may be called ambient cue internally while still launching under the branded name Magic Cue. Related Google now offers Android Canary builds for your Pixel For developers and especially brave enthusiasts Posts Potentially launching on Pixel 10 As we understand it so far, Magic Cue will give Google's AI access to the content of your screen to try to proactively provide information you might need. The setup flow we saw in June gave the example of a friend asking for your flight details in a chat app, and your phone fetching that info from your Gmail account for you, without your having to switch apps. Given bits of Magic Cue are just now showing up in Android Canary -- Google's recently launched replacement for Android Developer Preview builds -- it's not clear when the feature will make its way to Pixel users generally. Google's gearing up to launch its next generation of hardware on August 20; it's likely we'll hear more about Magic Cue then.
Share
Copy Link
Google is developing a new AI assistant called 'Magic Cue' for Pixel devices, designed to provide contextual suggestions based on screen content.
Google is set to introduce a groundbreaking AI assistant feature called 'Magic Cue' for its Pixel devices. This innovative technology is designed to provide users with proactive suggestions based on the content displayed on their screens. The feature, initially known as 'Pixel Sense,' is expected to make its debut with the upcoming Pixel 10 series 1.
Source: Android Authority
Magic Cue utilizes artificial intelligence to analyze the content on a user's screen and offer relevant information and time-saving actions. According to code found in the latest Android Canary build, the feature is described as using "AI to proactively suggest info and actions relevant to what you're doing on screen" 2. This suggests that the AI will have access to the content of the user's screen to provide contextual assistance.
One example of Magic Cue's functionality, as revealed in a leaked setup flow, demonstrates how the AI could streamline information retrieval. If a friend asks for flight details in a chat app, Magic Cue could automatically fetch this information from the user's Gmail account, eliminating the need to switch between applications 2.
Source: Android Police
The feature has gone through several iterations during its development. Initially conceived as 'Pixie,' it later evolved into 'Magic Cue.' Interestingly, the code in the Android Canary build refers to the feature as 'ambient cue,' suggesting that this might be an internal name while 'Magic Cue' serves as the branded name for public release 2.
While specific details about the release are still unclear, the appearance of Magic Cue in the Android Canary build – Google's replacement for Android Developer Preview builds – indicates that development is progressing. The feature is expected to be unveiled alongside the next generation of Google hardware, with a potential launch date of August 20th 2.
As with any AI feature that accesses user data, privacy concerns are likely to arise. The code in the Android Canary build includes an option for users to "see how suggestions are generated," which may indicate Google's commitment to transparency in how the AI processes and uses screen content 2.
Magic Cue represents a significant step forward in contextual AI assistance for mobile devices. By proactively offering relevant information and actions, it has the potential to streamline user interactions and enhance productivity. However, the true impact of this feature will only be known once it's in the hands of users and its capabilities can be fully explored in real-world scenarios.
Summarized by
Navi
[1]
OpenAI CEO Sam Altman proposed a multibillion-pound deal to provide ChatGPT Plus access to all UK citizens, sparking discussions on AI accessibility and government collaboration.
3 Sources
Technology
9 hrs ago
3 Sources
Technology
9 hrs ago
NVIDIA has introduced the Jetson AGX Thor Developer Kit, a compact yet powerful mini PC designed for AI, robotics, and edge computing applications, featuring the new Jetson T5000 system-on-module based on the Blackwell architecture.
2 Sources
Technology
1 hr ago
2 Sources
Technology
1 hr ago
Ex Populus, the company behind Ethereum-based gaming network Xai, has filed a lawsuit against Elon Musk's AI company xAI for trademark infringement and unfair competition, citing market confusion and reputational damage.
2 Sources
Technology
1 hr ago
2 Sources
Technology
1 hr ago
Multiple news outlets, including Wired and Business Insider, have been duped by AI-generated articles submitted under a fake freelancer's name, raising concerns about the future of journalism in the age of artificial intelligence.
4 Sources
Technology
2 days ago
4 Sources
Technology
2 days ago
Google inadvertently revealed a new smart speaker during its Pixel event, sparking speculation about its features and capabilities. The device is expected to be powered by Gemini AI and could mark a significant upgrade in Google's smart home offerings.
5 Sources
Technology
1 day ago
5 Sources
Technology
1 day ago