Google Pixel Phones to Introduce AI-Powered 'Smart Replies' for Call Screening

Pixel phone testing 'AI Replies' for contextual Call screening

Disclaimer: This content generated by AI & may have errors or hallucinations. Edit before use. Read our Terms of use In yet another upgrade to its Call Screen feature, Google is currently working on an 'AI Replies' feature for the Pixel Phone application, 9to5Google reported. Since 2018, Pixel phones have had the option to "screen calls," directing the Google Assistant to converse with incoming callers on the user's behalf. This practice helped identify preliminary information about the caller and further eliminate the access of unknown and spam callers to the user. Later, in October 2023, the feature went through an upgrade with an "Ask if urgent" option for incoming calls from users on the contacts list. Google also rolled out a provision of 'contextual call screen replies' in Android 12 in a bid to "easily respond in a way that fits the situation" last December. This feature, termed "dobby," enabled the Google Assistant to meet out tailored and context-aware responses. For instance, in response to a call asking for a booking confirmation for a table at a restaurant, Google would display options such as "confirm" or "cancel booking," streamlining the call process. However, the 'contextual call screen replies' are only available to a small set of responses. Adding to the preexisting 'Contextual Call Screen', the new feature seeks to leverage AI technology to curate smart replies based on the responses detailed on the Call Screen. The 'AI Replies' feature will provide flexible applications in a plethora of situations. The feature is custom-made to suit more appropriate responses. However, as of now, Google has not disclosed any details regarding the potential release date of this feature. In the past, the tech company has signalled at a "multi-step, multi-turn conversational AI" catered to the Phone app. Besides this, with the launch of the Android 15 Pixel, Google introduced a more human-sounding voice as a part of the Call Screen feature in regions such as Japan and the UK. In another move to inculcate AI into conversations, Reliance Industries revealed the Jio Phone Call AI feature during its Annual General Meeting in August this year. Utilising this feature, individuals could record and store conversations in the Jio Cloud and also transcribe and translate conversations into different languages. Later, attendees of the India Mobile Congress (IMC) in October got the opportunity to interact with the feature, which is currently in its alpha testing stage. This feature was initially accessible to Jio subscribers who could opt-in to the same via the MyJio app. According to an Indian Express report, an in-house AI model made this possible with a 90% accuracy rate. While the recorded conversations are encrypted and stored in the Jio Cloud, it wasn't clear if the same is used for training Jio's AI model. Initially, the Google Call Screen feature was compatible with all Pixel smartphones across select regions. However, the same isn't available in India yet. This further puts into question the timeline of the introduction and release of the 'AI Replies' feature, an addition to the Call Screen feature in India. Moreover, the benefit and practicality of such a feature are questionable, as the Indian audience doesn't typically resonate with a voicemail or a voice answering machine feature. Instead, they choose to answer calls promptly. While the feature may seek to capitalise on the AI boom currently overtaking the technology industry, the inclusion of 'AI replies' on Pixel's phone app is questionable to necessity. To explain, if the 'Contextual Call Screen' coupled with Google Assistant already enables appropriate and concise responses to callers, what other attributes would the 'AI Replies' entail? MediaNama reached out to Google Pixel with the following questions and is awaiting their response. We will update the post as soon as we hear from them.

Google Tests AI Reply Feature to Enhance Call Screening on Pixel Phones

Google is leveraging advanced AI technology to analyze callers' responses in real time, generating relevant replies for Pixel users to choose from Google is reportedly testing a new feature called AI Replies for the Call Screen functionality on its Pixel smartphones. Currently under development, this feature aims to enhance call screening by generating more personalized and dynamic responses based on what the caller says. Call Screen, an existing feature in Google's Pixel Phone app, uses Google Assistant to answer incoming calls, screen the caller, and display their response on the screen. With AI Replies, however, the system is expected to take this a step further by providing smart replies that better reflect the caller's intent. According to Android Authority, Google is leveraging advanced AI technology to analyze callers' responses in real-time, generating relevant replies for Pixel users to choose from. This would move beyond the current standard replies, making interactions more natural and flexible. The feature is reportedly powered by an AI model, which Google may refer to internally as "dobby." There are also indications that Gemini Nano, a large language model already powering some AI features on the Pixel 9 series, could play a key role in delivering these AI-generated replies. The current Call Screen feature, available in select regions but not yet in India, has proven useful for screening unknown callers or handling calls without requiring the user to pick up. It even offers a contextual reply function that allows users to send simple responses when they prefer not to answer. For instance, if an incoming call is about scheduling an appointment, Call Screen can prompt the user with responses such as confirming or declining. However, this feature is somewhat limited, especially when the caller's intent is more complex or requires a nuanced response. Google's reported development of AI Replies aims to address this limitation, enabling a more adaptive interaction by using machine learning to "understand" the caller's words and provide relevant, tailored responses. This feature could be especially useful in professional or customer service scenarios where quick, context-specific replies are needed. Furthermore, the smart replies generated by AI may improve the user experience by saving time and reducing the need for manual replies. The AI model referred to as "dobby" in the code strings uncovered by 9to5Google could be an experimental model, though some believe that Gemini Nano may handle the actual processing. Gemini Nano is a smaller-scale version of Google's larger Gemini LLM, known for its ability to understand and generate contextually relevant responses. While Google has not officially confirmed the release date of AI Replies, reports suggest that this feature could soon be tested more broadly. With these advances, Google is positioning the Pixel Call Screen to become a more interactive and helpful tool, potentially setting a new standard for AI-powered call management. As more AI capabilities emerge on Pixel devices, continues to expand the possibilities of AI integration in day-to-day smartphone usage.

Your Pixel Phone's Call Screen Feature Will Soon Support 'AI Replies'

Google Pixel phones include a Call Screen feature that could soon be upgraded with new artificial intelligence (AI) capabilities, according to a report. The Mountain View-based tech giant is reportedly working on an 'AI Replies' feature which will generate smart replies based on what the caller has said, instead of the standard replies seen in the current version of Call Screen. The feature is currently under development, so it will not be visible in the latest version of the Phone app on Pixel devices, and could be rolled out to the company's devices in the future. The Call Screen feature in the Phone app on Pixel smartphones allows users to set the Google Assistant to receive incoming calls and ask why the call was placed. It is available in select regions (not in India) and works on all Pixel smartphones. Last year, Google added the contextual replies feature to Call Screen, which allowed users to respond to the caller if they did not wish to answer a call. For example, if the Call Screen feature told the user that they were getting an incoming call about booking an appointment to the doctor's office, users could choose between confirming and declining the appointment and the on-device assistant could let the caller know the same. While useful in certain scenarios, the feature is quite limited in the range of responses a user could send, and it does not work if the caller's response is too complex. Now, an Android Authority APK teardown reveals that the company is working on making contextual replies better with "AI Replies". AI Replies in Google Pixel's Call Screen feature Photo Credit: Android Authority/AssembleDebug The publication says that the company might use AI to process the caller's response and show the user more relevant replies. Based on the image, AI Replies is described as "Call Assist suggests new AI-powered smart replies based on the caller's Call Screen responses". 9to5Google also dug into a Pixel smartphone's Phone app to find more evidence of the feature. The publication found code strings suggesting that the AI-generated replies were internally being called "dobby" Another string of code reportedly revealed that the feature will be powered by "dobby LLM". It is believed that this is a codename for Gemini Nano which already powers some of the AI features in the Google Pixel 9 series. However, the company might also use a separate large language model to power the feature. Currently, Google has not shared any information on when AI Replies in Call Screen might be released.

Pixel Phone app could soon offer AI based replies

Several years ago, Google showed off technology that would allow your phone to stay on the line on your behalf, make reservations, and more. Now it seems that Google is taking things further where a future update to the Pixel Phone app could actually allow users to send replies using AI. This is according to an APK teardown by the folks at 9to5Google. Based on the teardown, they found evidence of a new feature called "AI Replies". The description in the code string reads, "Call Assist suggests new AI-powered smart replies based on the caller's Call Screen responses." This could be very useful because there might be times when you can't answer the phone. But what if the call is important? That's where the AI comes in. It can answer and record the call on your behalf, and ask the caller questions about the nature of the call. Based on that, it will relay the caller's message back to the user, and users will have the option of using quick replies that are generated based on the context of the call. We're not sure how effective this feature is given that it isn't available yet. But if it works as advertised, it would be a pretty neat trick. That being said, the feature users Gemini Nano so in terms of availability, it could be limited to the Pixel 8 Pro and Pixel 9 series for now.

Pixel's awesome call screening feature could get smarter replies soon

This would presumably enable more personalized responses than the current contextual reply functionality. One of the best things about Pixel phones is the Call Screen feature. This feature lets Google Assistant answer your calls to find out who's calling and why. Google added contextual replies late last year, and it looks like the firm will soon offer AI replies. Android Authority contributor AssembleDebug tweeted that Google was working on AI replies for the Call Screen feature in the Phone app. The tipster also posted a screenshot of the feature, as seen below. "Call Assist suggests new AI-powered smart replies based on the caller's Call Screen responses," reads a description of the AI replies feature. 9to5Google also dug into the Pixel's Phone app and discovered strings mentioning AI replies. The outlet correctly notes that the current Call Screen feature is referred to as dobby in previous strings. However, the latest strings for AI replies mention "dobby_AI" and "dobby_LLM," hinting at an AI model powering these responses. There's no word on exactly how these AI replies will differ from the contextual replies currently seen in the Call Screen feature, but we're guessing the AI-powered replies will offer more personalized responses.

The Pixel Phone app might soon let you respond to calls with AI messages

If you've got one of the best Pixel phones in your pocket, then you can use the Call Screen feature to have a Google bot answer incoming calls and ask what the call is about - and it looks like more AI trickery is about to be added too. The team at 9to5Google did some digging into the Phone app for Pixels, and found code hinting that advanced AI replies would be available in the future. These would most likely be powered by Google's Gemini AI chatbot. You already get a comprehensive experience from Call Screen as it works today: the caller hears a spoken message asking them to state their business, and you get a text transcript of what they've said. You can then join the call, or send some basic responses - like "call me back" or "thank you" - if you're not available to talk. This new upgrade would make those responses more varied and complex, powered by a large language model. It seems that you would still get the option to choose from a selection of responses on the screen, rather than starting from scratch. Call Screen was only just updated last month, with more context-aware quick replies - ones that aren't just generic responses (so if the call is about an appointment, you might see "confirm" or "cancel" options, for example). It's not clear exactly how the more detailed responses might work, as the 9to5Google team wasn't able to dig out any screenshots or get the feature turned on, but the new answers will most probably be along similar lines to a typical Gemini AI chatbot response. Another bunch of Pixel updates - which Google calls Pixel Drops - should be announced very soon, though this particular new feature might not be included. Google may need more time to refine the way it works, and it's worth noting that the hidden code already includes the standard disclaimer about the unreliability of AI responses.

Pixel Phone app working on contextual 'AI Replies' in Call Screen

Google updated Call Screen with contextual replies last December, and the Pixel Phone app is now readying "AI Replies" powered by large language models. About APK Insight: In this "APK Insight" post, we've decompiled the latest version of an application that Google uploaded to the Play Store. When we decompile these files (called APKs, in the case of Android apps), we're able to see various lines of code within that hint at possible future features. Keep in mind that Google may or may not ever ship these features, and our interpretation of what they are may be imperfect. We'll try to enable those that are closer to being finished, however, to show you how they'll look in case that they do ship. With that in mind, read on. Contextual Call Screen replies today let you "easily respond in a way that fits the situation." For example, if you receive a call asking you to confirm an appointment, Google will show you suggested responses that are personalized to the call, like "Confirm" or "Cancel appointment." This saves you from having to get on the actual call. Google might now take that a step further with "AI Replies." Strings in version 153 (latest beta) of the Phone by Google app reveal how "Call Assist suggests new AI-powered smart replies based on the caller's Call Screen responses." (Call Assist is Google's high-level name for features like Hold for Me and Direct My Call.) The existing Call Screen feature is named "dobby" (a Harry Potter reference). AI Replies are referred to as "dobby_AI" and "dobby_LLM." It will presumably leverage Gemini Nano. Compared to what we have today, this feature will presumably work in more scenarios and provide better responses. Users will have to "Turn on AI replies," with no such setting existing for the current capability. Google in the past has alluded to adding "multi-step, multi-turn conversational AI" to the Phone app. With Android 15 Pixel Drop, Google brought next-gen Call Screen, which has a more human-sounding voice, and contextual replies to countries beyond the US.

Google Pixel's Call Screen could get smarter with AI-powered replies

June Pixel Feature Drop missing for T-Mobile and Verizon Pixel users Key Takeaways Google Pixel's Call Screen could potentially get AI-powered contextual replies. Google Phone app beta hints at Gemini Nano powering AI Replies for smarter suggestions. Pixel Call Screen is still limited to certain countries and needs to be expanded globally. ✕ Remove Ads Call Screen is one of the best features of Pixel phones. It protects you from spammers and unknown callers by enabling Google Assistant to pick up calls on your behalf and find out why the person is calling you. Since its debut in 2018, Google has slowly expanded the feature to more countries and made it smarter, giving it a more natural and human-like voice this year. Now, Google seemingly wants to make Call Screen even better by adding support for AI-powered contextual replies. Related How to use Google Pixel's Call Screen and say goodbye to spam calls Google can tell you who's calling and will ignore robocalls with Call Screen As per code-sleuth AssembleDebug, Call Assist on Pixels could soon gain "AI Replies." This will enable the feature to "suggest "AI-powered smart replies based on the caller's Call Screen responses." As of now, Google Assistant in Call Assist provides contextual reply suggestions, though they are relatively generic. ✕ Remove Ads 9to5Google's teardown of the latest beta release of the Google Phone app (v153) provides more hints at how the feature will work. Based on the strings and references like "dobby_LLM," it appears Google will use Gemini Nano to power AI Replies, allowing it to understand natural language and provide smarter suggestions. There's still a lot that is not known about AI Replies in Call Screen, and it does not appear ready for release yet. But based on today's report, the infusion of AI should make the feature better at understanding what the caller is saying, thereby suggesting more useful replies. ✕ Remove Ads Google needs to expand Pixel Call Screen to more regions Despite its usefulness, Call Screening on Pixels is only available in limited countries. Automatic Call Screen and Call Notes are exclusively available on Pixel phones in the US, with the latter being limited to the Pixel 9 series. Manual call screening is available in several regions, including the UK, Canada, France, and Germany. However, other features like Direct My Call are limited to the US and UK. Similarly, Call Screen is also available on the Pixel Watch but only in the US. Besides the addition of AI, Google should also work on expanding and delivering the same Call Screening experience on its Pixel phones across all regions. ✕ Remove Ads

A new Google Pixel feature could make managing phone calls a breeze | Digital Trends

Contextual replies are one of the best parts of the Google Pixel experience. This feature allows you to respond to a call without actually answering it; the Google Assistant voice asks why they're calling and allows you to answer with generated responses for specific keywords. For example, if someone is calling to confirm an appointment, you can reply with "Confirm." It's a great feature, especially if you aren't fond of talking on the phone. Now an update to contextual replies could take the feature to the next level with AI responses. The team at 9to5Google found snippets of code in the latest beta version of the Phone by Google app that suggest a wider range of capabilities is on the way. Recommended Videos Although details are scarce, the names of variables within the code and the text itself are pretty clear. One string is called "AI Replies," and the font style suggests it's a header. The other is "Turn on AI replies?" and there will presumably be a toggle available. The setting doesn't exist yet, and though the code might be present in the beta, it doesn't mean the feature will be part of the next update. However, it does confirm that Google has its sights set on expanding the contextual call feature to allow Gemini to respond for you. You can already respond to calls with basic prompts like "Confirm" and "Thank you," but AI Replies should greatly expand the types and quality of replies you can select. After that, who knows where the possibilities will stop? It might one day be possible for Gemini to make appointments and reservations for you. Of course, this feature might not be released -- it's best not to count your chickens before they hatch, after all -- but this is one feature we hope to see soon.