Google Messages Rolls Out AI-Powered Sensitive Content Warnings to Blur Unwanted Nude Images

Google Messages can now blur unwanted nudes, remind people not to send them

Google announced last year that it would deploy safety tools in Google Messages to help users avoid unwanted nudes by automatically blurring the content. Now, that feature is finally beginning to roll out. Spicy image-blurring may be enabled by default on some devices, but others will need to turn it on manually. If you don't see the option yet, don't fret. Sensitive Content Warnings will arrive on most of the world's Android phones soon enough. If you're an adult using an unrestricted phone, Sensitive Content Warnings will be disabled by default. For teenagers using unsupervised phones, the feature is enabled but can be disabled in the Messages settings. On supervised kids' phones, the feature is enabled and cannot be disabled on-device. Only the Family Link administrator can do that. For everyone else, the settings are available in the Messages app settings under Protection and Safety. To make the feature sufficiently private, all the detection happens on the device. As a result, there was some consternation among Android users when the necessary components began rolling out over the last few months. For people who carefully control the software installed on their mobile devices, the sudden appearance of a package called SafetyCore was an affront to the sanctity of their phones. While you can remove the app (it's listed under "Android System SafetyCore"), it doesn't take up much space and won't be active unless you enable Sensitive Content Warnings. Now, at least, SafetyCore is doing something, according to 9to5Google. SafetyCore allows your phone to do basic AI image classification so it can identify images that may contain nudity. If your phone spots such an image arriving in your inbox, it will apply a blur filter and present a "speed bump" that lets you decide if you want to see said image. You can also choose to block the number that sent it. Sensitive Content Warnings also remind users who are sending nudes that they may want to rethink that. Like the incoming image speed bump, you can dismiss this one and continue sending unimpeded. It's a lot like Apple's identically named Sensitive Content Warning. Sensitive Content Warnings are coming to all Android devices with Google apps running version 9 or higher, but it's starting with those in the Google Messages beta. Unlike many features, this one is even available to the oft-forgotten Android Go lineup. However, your phone needs to have at least 2GB of RAM, which virtually every working Android phone should have. Content blurring and speed bumps will only appear in the Google Messages app, so you may need to switch to that app on certain phones. If you don't want to wait for the wide rollout, you can join the Messages beta in the Play Store to hurry the process along.

Google Messages starts rolling out sensitive content warnings for nude images

Powered by AI, it will 'detect and blur images that may contain nudity' and provide warnings. Google Messages has started rolling out sensitive content warnings for nudity after first unveiling the feature late last year. The new feature will perform two key actions if the AI-based system detects message containing a nude image: it will blur any of those photo and trigger a warning if your child tries to open, send or forward them. Finally, it will provide resources for you and your child to get help. All detection happens on the device to ensure images and data remain private. Sensitive content warnings are enabled by default for supervised users and signed-in unsupervised teens, the company notes. Parents control the feature for supervised users via the Family Link app, but unsupervised teens aged 13 to 17 can turn it off in Google Messages settings. The feature is off by default for everyone else. With sensitive content warnings enabled, images are blurred and a "speed bump" prompt opens allowing the user to block the sender, while offering a link to a resource page detailing why nudes can be harmful. Next, it asks the user if they still want to open the message with "No, don't view," and "Yes, view" options. If an attempt is made to send an image, it provides similar options. So, it doesn't completely block children from sending nudes, but merely provides a warning. The feature is powered by Google's SafetyCore system which allows AI-powered on-device content classification without sending "identifiable data or any of the classified content or results to Google servers," according to the company. It only just started arriving on Android devices and is not yet widely available, 9to5Google wrote.

Google Messages update finally adds an important safety tool - and teases a feature I'm surprised the app doesn't have already

Google Messages looks set to receive a couple of new tools to make the service more useful and safer to use. And we're excited to try out both once they've rolled out. The first is that Google appears set to add live location sharing to its app. That's according to Android Authority's recent APK teardown. You can currently share your location with another person through Google Maps, but it sends the information as a static Google Maps pin. If you move, you'll need to send your location again, which can make meeting up while you're out and about a challenge. That looks set to change however, as in the latest beta code a single string referencing "live_location_sharing_shortcut" was discovered. For now the feature isn't live, but the string suggests that Google is probably experimenting with live location sharing behind the scenes and could be preparing to release the feature in a future beta. As always, there's a chance Google will never release live location sharing, but here's hoping it does - and sooner rather than later, given how helpful it can be. The other update is one that was announced back in February but finally seems to be live for a few via the latest Messages beta: new Sensitive Content Warnings (via 9to5Google). They'll appear if a Google Messages user sends or receives nude images (if they have the setting switched on), though for adults, it's switched off by default. Meanwhile, accounts owned by people under 18 will have the feature switched on by default. Supervised accounts can't turn the warnings off themselves (though parents can control the setting through the Family Link app), while Unsupervised teens (users aged 13 to 17) can turn the warnings off in their Google Account settings if they choose. To change your settings, you'll want to open Google Messages on your Android device, tap on your profile picture, then tap on Messages settings. Scroll down to find Protection and safety, then Manage sensitive content warnings to then be able to toggle Warnings in Google Messages on or off. Google says these warnings are handled by on-device AI (so the feature "doesn't send identifiable data or any of the classified content or results to Google servers"). If the Android System SafetyCore behind the feature thinks the image might contain nudity, a few things happen. First, if the sender has the feature on, they'll be warned about the risks of sending nude images before being asked to confirm if they do indeed wish to send it. Similar warnings and confirmations will appear if you're trying to share a nude image with another person. The receiver will then (if they have content warnings on) see a blurred image, be warned about how nude images can be harmful, have the option to delete the image before seeing it, the chance to block the number which sent the image, and the option to view the image if they choose. With the feature finally starting to appear, it shouldn't be long before more of us can rely on these AI-powered content warnings to help us stay safer online.

Google Messages now uses AI to blur unsolicited nude pics then offers the sender a friendly reminder not to send them in the first place

Remember everyone, naked pictures sent to others could be leaked at any time, so it's important to make them really good ones. Your Google Messages inbox is about to look like a naughty Anime thanks to the new Sensitive Content Warnings feature rolling out on Android phones. The feature was a long-promised update, designed to keep people a little safer in regards to sensitive images online. Ars Technica spotted that the feature has already been implemented on some Android devices, applying blur filters to images it deems to be sensitive. So, if all of your nudes are starting to look a little blurrier, maybe check your settings before running out for a new prescription. If your Android device hasn't already, it'll soon automatically download an app called Android System SafetyCore. While it looks a little suss, this is a verified app by Google that provides phones access to an AI tool designed to find sensitive images like nudes. If it's an incoming pic, it'll be automatically blurred by the app, and offer an explanation and the option to unblur the image. For the senders of spicy images, it'll throw up a warning reminding people to perhaps rethink what they send and who they send it to. That's always good advice, as it's easy to forget how quickly we lose control of this kind of content once it's sent and it's impossible to know where it will end up, and how it may potentially be used against you. Perhaps Google should include a warning about consent when receiving images and put some kind of bar on resending them too. For now it'll be nice to at least have some warning on unsolicited dick pics for a change. If you really want to, you can uninstall Android System SafetyCore by finding it in the apps list and getting rid of it, but it's pretty small, lightwieght, and looks helpful. It allows for the AI detection to all take place on the device itself, rather than on the cloud which is super important for privacy. This keeps the potentially sensitive images strictly between the sender and receiver as opposed to involving an online third party. It's smart, because it avoids one more way these things can wind up being leaked to the public. It'd be pretty embarrassing to have your nudes go live because Google's Sensitive Content Warnings feature decided to host them all online and then itself became victim to an attack. The other nifty thing is this feature will roll out to more android devices than usual. While generally helpful and useful for people of all ages, this is an app that's clearly got kids' safety in mind. So it's a good thing it'll be coming to many often unsupported phones including those running Android Go that are more likely to be used by young people. It only requires 2GB of RAM to run, so even the most budget devices should be able to handle it as long as they're not too old. Automatic blur and warnings are a pretty great idea. Even if you do want to receive whatever nastiness it is you're into, there's nothing worse than innocently opening your phone on a train and accidentally giving all the other passengers an eye full. Unfortunately, it's likely most folks won't even notice the new feature, and that's not because their nude collecting game is off. Most Android users have their phones set to the standard unrestricted mode, so Sensitive Content Warnings won't be turned on by default. Only supervised child devices will have Sensitive Content Warnings turned on by default, and they have to be disabled by the family account holder. For all those adults out there, pretend or otherwise, you'll have to go into the Google Messages settings and turn the new feature on yourselves if you want that bit more of a buffer against those in the buff.

Google Messages Will Now Blur Nude Photos You Didn't Ask For

It's enabled by default for users under 18 years of age. Parents can access the feature through the Family Link app. Sensitive content, especially nudity, is a huge and alarming issue in the digital space, and big tech has taken various steps to reduce its impact, especially on teens. From safety checks to monitoring images using AI, a lot of ways are already being used on our smartphones. Announced last year, the default Google Messages app is now rolling out a feature to keep sensitive content in check. Spotted by 9to5Google, Google Messages is rolling out a Sensitive Content Warnings feature. It's a feature that automatically blurs nude images in the app. The feature is a part of the Android System SafetyCore and is gradually rolling out to all users. Upon receiving a sensitive image, the feature lets you choose to view or not view it, block the sender without viewing the image, or take you to a page that tells you why nude images can be harmful. The user can also blur it back by tapping the "Remove Preview" option. Moreover, Google Messages prompts users before sending nude imagery, with the risks of sending the same and preventing accidental shares. Upon which they need to tap Confirm and continue before sending. For users over 18 years of age, the feature is opt-in and is disabled by default. And for those below 18 years of age, it is turned on by default and can be turned off in the Google Account settings. Additionally, on the Sensitive content warning page, Google mentions that parents can enable the feature through the Family Link app by going to Controls -> Contacts -> Sensitive content warnings. The feature can be accessed by going to Google Messages settings > Protection & Safety > Manage sensitive content warnings. You can then turn on the toggle to enable it. The page also shows you a link to a webpage that explains how you can protect yourself online. What are your thoughts on this feature? Let us know in the comments below.