21 Sources
21 Sources
[1]
Meta previews new parental controls for its AI experiences | TechCrunch
Meta on Friday previewed its upcoming parental control features for teens' conversations with AI characters on its platforms. The features, which will be rolled out next year, include the ability to block certain characters and monitor conversation topics. Starting in the coming months, parents will be able to turn off chats with AI characters entirely for teens. This action won't block access to the Meta AI chatbot -- the company's general-purpose AI chatbot -- which will only discuss age-appropriate content. Parents will also be able to turn off chats with individual characters if they prefer more selective control. Plus, they will receive information about the topics teens are discussing with AI characters and Meta AI. The company said it plans to roll out these controls on Instagram early next year. They will be available in English in the U.S., U.K., Canada, and Australia. "We recognize parents already have a lot on their plates when it comes to navigating the internet safely with their teens, and we're committed to providing them with helpful tools and resources that make things simpler for them, especially as they think about new technology like AI," the company said in a post written by Instagram head Adam Mosseri and newly appointed Meta AI head Alexandr Wang. Earlier this week, Meta said that its content and AI experiences for teens will follow a PG-13 movie rating standard and will avoid sensitive topics such as extreme violence, nudity, and graphic drug use. The company added that currently, teens are only allowed to interact with a limited number of characters that follow age-appropriate content guidelines. Parents can also set time limits on teens' interactions with AI characters. Earlier this year, Instagram announced that it is using AI to identify attempting to skirt age limits by faking their age on the app.
[2]
Parents Soon Can Block Their Kids from Interacting with AI Chatbots on Instagram
TV, social media, junk food -- parents have been setting limits on their kids forever. Now, add AI chatbots to the list. Meta announced Friday that, starting in 2026, parents will be able to block teenagers from interacting with AI chatbots on Instagram. Parents will be able to block all access or block access to specific AI characters. Meta, owner of Instagram, Facebook and WhatsApp, is adding the parental controls months after a report came out in August showing the company's AI guidelines allowed chatbots to "engage a child in conversations that are romantic or sensual." Another report came out earlier this month that said 3 in 5 children aged 13 to 15 encounter unsafe content or unwanted messages on Instagram. Don't miss any of our unbiased tech content and lab-based reviews. Add CNET as a preferred Google source. The company said in a blog post Friday that the new AI chatbot controls align with parental concerns about "who (children are) interacting with, what type of content they're seeing, and whether their time is well-spent." "We hope today's updates bring parents some peace of mind that their teens can make the most of all the benefits AI offers, with the right guardrails and oversight in place," said Instagram head Adam Mosseri and Chief AI Officer Alexandr Wang in the blog post. Teens can interact with AI chatbots through Instagram's direct message section. The chat could be with a creator's AI, a custom AI character, or Meta's general-use AI. Meta said the new controls allow parents to turn off their teen's access to one-on-one chats with AI characters entirely or block specific AI characters if they don't want to turn off access to AI characters altogether. Moreover, parents can "get insights into the topics their teens are chatting about with AI characters." The company did not explain in detail how parents would be able to find out what AI topics their kids are chatting about. Teens can still use Meta's regular AI assistant "with default, age-appropriate protections in place to help keep teens safe." James Steyer, founder and CEO of digital advocacy and research nonprofit Common Sense Media, called Meta's new AI chatbot controls a "reactive concession" and insufficient. "Meta's refusal to treat our kids' safety with the urgency it demands is deeply disappointing but unfortunately not surprising," Steyer told CNET. "For too long, this company has put the relentless pursuit of engagement over our kids' safety, ignoring warnings from parents, experts, and even its own employees." Steyer said no one under 18 should use Meta AI chatbots "until their fundamental safety failures are fixed." The representative for Meta says the company is continuing to improve safety. "We've already gathered high-level inputs from experts which have shaped our initial thinking, and we will continue working with experts and parents to help ensure a thoughtful, privacy-conscious approach," the representative told CNET. Meta also described added protections around AI chatbots and teens: Earlier this week, Instagram said it would only allow teens to see content "similar to what they'd see in a PG-13 movie," under its new guidelines for Teen Accounts.
[3]
Meta finally announces parental controls for teen AI use on Instagram
After enthusiastically rolling AI chatbots out everywhere, Meta has announced new options for parents to get an idea of how teens are chatting with the digital characters and set some limits on use. The move comes as Meta works to rehabilitate its image after disturbing reports of its tools' romantic interactions with minors and faces growing scrutiny over chatbots' impact on kids. The new controls will let parents stop their children from speaking with AI chatbots entirely or block access to specific characters they don't like, Instagram lead Adam Mosseri and Meta chief AI officer Alexandr Wang wrote in a blog post announcing the changes on Friday. Meta's AI assistant is a notable exception to this rule. The company says it will "remain available to offer helpful information and educational opportunities" with "age-appropriate protections in place." Meta said parents will also be given some form of "insight" into how their kids are using AI, though it was light on details for what this might look like in practice. From Meta's description, it looks like the "insights" will take the form of a high-level summary of "the topics their teens are chatting about with AI characters" and Meta's AI assistant. The company says it hopes the information will empower parents to "have thoughtful conversations with their teens about AI interactions." Mosseri and Wang said they "hope today's updates bring parents some peace of mind that their teens can make the most of all the benefits AI offers." Parents will have to wait a little longer to discover said peace of mind though: the controls won't be available until "early next year." Even then, they will be limited to Instagram and only for English-speaking users in the US, UK, Canada, and Australia. Meta said it plans to expand the controls across its platforms in the future and said it will "have more to share soon." This is one of the first major safety updates Meta has made to its AI chatbots since deploying them across Facebook, Instagram, and WhatsApp. It comes on the heels of another major update pushed only this week that limits what content teen Instagram accounts can view, in line with what you'd see in a PG-13 movie.
[4]
Meta adds parental controls for AI-teen interactions
Meta is adding parental controls for kids' interactions with artificial intelligence chatbots -- including the ability to turn off one-on-one chats with AI characters altogether -- beginning early next year. But parents won't be able to turn off Meta's AI assistant, which Meta says will "will remain available to offer helpful information and educational opportunities, with default, age-appropriate protections in place to help keep teens safe." Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters -- although they won't get access to the full chats. The changes come as the social media giant faces ongoing criticism over harms to children from its platforms. AI chatbots are also drawing scrutiny over their interactions with children that lawsuits claim have driven some to suicide. Even so, more than 70% of teens have used AI companions and half use them regularly, according to a recent study from Common Sense Media, a nonprofit that studies and advocates for using screens and digital media sensibly. On Tuesday, Meta announced that teen accounts on Instagram will be restricted to seeing PG-13 content by default and won't be able to change their settings without a parent's permission. This means kids using teen-specific accounts will see photos and videos on Instagram that are similar to what they would see in a PG-13 movie -- no sex, drugs or dangerous stunts, among others. Meta said the PG-13 restrictions will also apply to AI chats. Children's online advocacy groups, however, were skeptical. "From my perspective, these announcements are about two things. They're about forestalling legislation that Meta doesn't want to see, and they're about reassuring parents who are understandably concerned about what's happening on Instagram," said Josh Golin, the executive director of the nonprofit Fairplay. on Tuesday after the announcement.
[5]
Meta is adding AI chatbot-focused parental controls to Instagram
Meta is working on new supervision controls that will allow parents to cut off their teens' access to AI chatbots on its platforms completely. While the tools can remove teens' ability to engage AI characters on one-on-one chats, they'll still be able to access the general Meta AI chatbot. If parents don't want to block their teens from being able to access AI bots altogether, they can also just block specific AI characters. In addition, parents will be able to get insights into the topics their children are discussing with Meta's AI bots. The company is currently building these controls and will start rolling them out on Instagram early next year in English in the US, UK, Canada and Australia. Take note that the images above are just illustrations, and the tools' interfaces could still change. The company has been under fire since an internal Meta document was leaked a few months ago, showing that it allowed its chatbots to have "sensual" conversations with children. In one example, a Meta chatbot told a shirtless eight-year-old that "every inch of you is a masterpiece -- a treasure I cherish deeply." The US Attorneys General of 44 jurisdictions urged companies to protect children "from exploitation by predatory artificial intelligence products" after that information came out. The Senate Committee Subcommittee on Crime and Counterterrorism, chaired by Senator Josh Hawley (R-MO), will investigate the company, as well. Shortly after the internal documents leaked, Meta started retraining its AI and added new protections to prevent younger users from accessing user-made AI characters that might engage in inappropriate conversations. It also introduced age-appropriate protections so that its AIs will give teens responses guided by PG-13 movie ratings. Plus, it now only allows teens to interact with a limited group of AI characters, focused on age-appropriate topics.
[6]
Meta announces new AI parental controls following FTC inquiry
Parents will have the option to turn off one-on-one chats with AI characters completely, Meta said. They will also be able to block specific AI characters, get insight into the topics their children are discussing with them. Meta is still building the controls, and the company said they will start to roll out early next year. "Making updates that affect billions of users across Meta platforms is something we have to do with care, and we'll have more to share soon," Meta said in a blog post. Meta has long faced criticism over its handling of child safety and mental health on its apps. The company's new parental controls come after the Federal Trade Commission launched an inquiry into several tech companies, including Meta, over how AI chatbots could potentially harm children and teenagers.
[7]
Meta announces new parental controls for teen users of AI companions
Meta has unveiled its plan to address teen use of its AI characters: More content guardrails and expanded parental oversight. In addition to new moderation controls designed to reflect PG-13 movie ratings, announced earlier this week, parents will be able to access summaries of teen chat use, limit their children to specific AI avatars, or block their child from interacting with AI companions completely. Teen Accounts will still be allowed to interact with Meta's AI assistant if they are blocked from conversing with AI avatars, the company noted. In August, Meta announced a temporary lockdown on its AI avatars after an investigation by Reuters found that the company's chatbots were able to engage young users in "romantic or sensual" conversations, impersonate celebrities in flirtatious exchanges, and generate sexually suggestive images. At the time, Meta spokesperson Stephanie Otway told TechCrunch the products were being trained not to engage in conversations about self-harm, suicide, disordered eating, or potentially inappropriate romantic conversations. Meta formalized the guardrails a month later, drawing a line between allowing a subject to discuss a subject -- such as abuse or intimacy between fictional characters -- and the chatbot's ability to "describe, enable, or encourage it." OpenAI announced similar controls for ChatGPT that same month, with additional limits on the bot's voice chat, chat memory, and image generation. Both approaches to teen AI oversight require young users to sign up for supervised accounts and parents to proactively monitor their children's chat use. "We believe AI can complement traditional learning methods and exploration in a way that feels supportive, all with the proper age-appropriate guardrails in place," the company wrote in a blog post. "We recognize parents already have a lot on their plates when it comes to navigating the internet safely with their teens, and we're committed to providing them with helpful tools and resources that make things simpler for them, especially as they think about new technology like AI." The new AI companion controls won't be available to supervising accounts until early next year, and will roll out exclusively to Instagram accounts in the U.S., UK, Canada, and Australia before expanding to other countries and Meta platforms.
[8]
Instagram lets parents block teen interactions with AI characters
Facebook and Instagram parent Meta is introducing a new feature to let parents control how -- and if -- their teen can interact with AI characters. The new update will let parents block some AI characters or shut off access altogether for their teen's account. But even if parents opt to block all access to AI characters, their teen will still have access to Meta's AI assistant. Meta said this feature will have "default, age-appropriate protections in place." The update will first be rolled out on Instagram early next year, the tech giant said Friday. Meta's latest update to teen protections comes just months after a Reuters report found that an internal policy document at the company let its AI chatbots engage in romantic conversations with kids. In response to this report, attorneys general for 42 states and two territories sent a letter to 13 companies using artificial intelligence -- including Meta -- saying they would use "every facet of our authority to protect children from exploitation by predatory artificial intelligence products." Meta isn't the only company playing catch up on teen protections. OpenAI, the company behind ChatGPT, rolled out a slew of parental controls in September, including a teen version of ChatGPT. In addition to Friday's update, Meta announced on Tuesday that it updated "AI experiences" for teen users to follow guidance of PG-13 ratings. It said this means "AIs should not give age-inappropriate responses that would feel out of place in a PG-13 movie." "In addition to our longstanding policies -- which already hide or prohibit the recommendation of sexually suggestive content, graphic or disturbing images, and adult content like tobacco or alcohol sales from teens -- our updated policies will now go even further," Meta said. Parents will have the option to add even stricter settings to their child's account, which would filter "even more content" than the PG-13 version. The update is being rolled out in the U.S., U.K., Canada, and Australia in English. Meta said its AI characters already "are designed" to not discuss self-harm, suicide, or eating disorders with teens. Meta said parents can get access to "insights" into what topics their child is talking about with AI characters and the AI assistant. The tech company did not elaborate more specifically on what these insights would include. Users who Meta believes could be teenagers will have these age-restrictions placed on their accounts. However, researchers have documented how easy it is to circumvent limits set by chatbot companies. Age-verification rules are also known to be easily bypassed.
[9]
With half of teens regularly turning to AI companions, Meta moves to add parental controls starting early next year | Fortune
Meta is adding parental controls for kids' interactions with artificial intelligence chatbots -- including the ability to turn off one-on-one chats with AI characters altogether -- beginning early next year. But parents won't be able to turn off Meta's AI assistant, which Meta says will "will remain available to offer helpful information and educational opportunities, with default, age-appropriate protections in place to help keep teens safe." Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters -- although they won't get access to the full chats. The changes come as the social media giant faces ongoing criticism over harms to children from its platforms. AI chatbots are also drawing scrutiny over their interactions with children that lawsuits claim have driven some to suicide. Even so, more than 70% of teens have used AI companions and half use them regularly, according to a recent study from Common Sense Media, a nonprofit that studies and advocates for using screens and digital media sensibly. On Tuesday, Meta announced that teen accounts on Instagram will be restricted to seeing PG-13 content by default and won't be able to change their settings without a parent's permission. This means kids using teen-specific accounts will see photos and videos on Instagram that are similar to what they would see in a PG-13 movie -- no sex, drugs or dangerous stunts. Meta said the PG-13 restrictions will also apply to AI chats. Children's online advocacy groups, however, were skeptical. "From my perspective, these announcements are about two things. They're about forestalling legislation that Meta doesn't want to see, and they're about reassuring parents who are understandably concerned about what's happening on Instagram," said Josh Golin, the executive director of the nonprofit Fairplay, after Meta's announcement Tuesday.
[10]
Meta adds parental controls for AI-teen interactions
Meta is adding parental controls for kids' interactions with artificial intelligence chatbots -- including the ability to turn off one-on-one chats with AI characters altogether -- beginning early next year. But parents won't be able to turn off Meta's AI assistant, which Meta says will "will remain available to offer helpful information and educational opportunities, with default, age-appropriate protections in place to help keep teens safe." Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters -- although they won't get access to the full chats. The changes come as the social media giant faces ongoing criticism over harms to children from its platforms. AI chatbots are also drawing scrutiny over their interactions with children that lawsuits claim have driven some to suicide. Even so, more than 70% of teens have used AI companions and half use them regularly, according to a recent study from Common Sense Media, a nonprofit that studies and advocates for using screens and digital media sensibly. On Tuesday, Meta announced that teen accounts on Instagram will be restricted to seeing PG-13 content by default and won't be able to change their settings without a parent's permission. This means kids using teen-specific accounts will see photos and videos on Instagram that are similar to what they would see in a PG-13 movie -- no sex, drugs or dangerous stunts. Meta said the PG-13 restrictions will also apply to AI chats. Children's online advocacy groups, however, were skeptical. "From my perspective, these announcements are about two things. They're about forestalling legislation that Meta doesn't want to see, and they're about reassuring parents who are understandably concerned about what's happening on Instagram," said Josh Golin, the executive director of the nonprofit Fairplay, after Meta's announcement Tuesday.
[11]
Meta adds parental controls for AI-teen interactions
Meta is adding parental controls for kids' interactions with artificial intelligence chatbots -- including the ability to turn off one-on-one chats with AI characters altogether -- beginning early next year. But parents won't be able to turn off Meta's AI assistant, which Meta says will "will remain available to offer helpful information and educational opportunities, with default, age-appropriate protections in place to help keep teens safe." Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters -- although they won't get access to the full chats. The changes come as the social media giant faces ongoing criticism over harms to children from its platforms. AI chatbots are also drawing scrutiny over their interactions with children that lawsuits claim have driven some to suicide. Even so, more than 70% of teens have used AI companions and half use them regularly, according to a recent study from Common Sense Media, a nonprofit that studies and advocates for using screens and digital media sensibly. On Tuesday, Meta announced that teen accounts on Instagram will be restricted to seeing PG-13 content by default and won't be able to change their settings without a parent's permission. This means kids using teen-specific accounts will see photos and videos on Instagram that are similar to what they would see in a PG-13 movie -- no sex, drugs or dangerous stunts. Meta said the PG-13 restrictions will also apply to AI chats. Children's online advocacy groups, however, were skeptical. "From my perspective, these announcements are about two things. They're about forestalling legislation that Meta doesn't want to see, and they're about reassuring parents who are understandably concerned about what's happening on Instagram," said Josh Golin, the executive director of the nonprofit Fairplay, after Meta's announcement Tuesday.
[12]
Meta to allow parents to limit teenagers' interactions with AI
The changes come as the social media giant, which owns Facebook and Instagram, faces criticism over harms to children from its platforms. Meta is adding parental controls for kids' interactions with artificial intelligence (AI) chatbots -- including the ability to turn off one-on-one chats with AI characters altogether -- beginning early next year. But parents won't be able to turn off Meta's AI assistant, which Meta says will "remain available to offer helpful information and educational opportunities, with default, age-appropriate protections in place to help keep teens safe". Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters -- although they won't get access to the full chats. The changes come as the social media giant faces ongoing criticism over harms to children from its platforms. AI chatbots are also drawing scrutiny over their interactions with children that lawsuits claim have driven some to suicide. Even so, more than 70 per cent of teens have used AI companions and half use them regularly, according to a recent study from Common Sense Media, a nonprofit that studies and advocates for using screens and digital media sensibly. On Tuesday, Meta announced that teen accounts on Instagram will be restricted to seeing PG-13 content by default and won't be able to change their settings without a parent's permission. This means kids using teen-specific accounts will see photos and videos on Instagram that are similar to what they would see in a PG-13 movie -- no sex, drugs, or dangerous stunts. Meta said the PG-13 restrictions will also apply to AI chats. Children's online advocacy groups, however, were sceptical. "From my perspective, these announcements are about two things," said Josh Golin, the executive director of the nonprofit Fairplay, after Meta's announcement Tuesday. "They're about forestalling legislation that Meta doesn't want to see, and they're about reassuring parents who are understandably concerned about what's happening on Instagram," Golin said.
[13]
Meta adds parental controls for AI-teen interactions
Meta is adding parental controls for kids' interactions with artificial intelligence chatbots -- including the ability to turn off one-on-one chats with AI characters altogether -- beginning early next year. But parents won't be able to turn off Meta's AI assistant, which Meta says will "will remain available to offer helpful information and educational opportunities, with default, age-appropriate protections in place to help keep teens safe." Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters -- although they won't get access to the full chats. The changes come as the social media giant faces ongoing criticism over harms to children from its platforms. AI chatbots are also drawing scrutiny over their interactions with children that lawsuits claim have driven some to suicide. Even so, more than 70% of teens have used AI companions and half use them regularly, according to a recent study from Common Sense Media, a nonprofit that studies and advocates for using screens and digital media sensibly. On Tuesday, Meta announced that teen accounts on Instagram will be restricted to seeing PG-13 content by default and won't be able to change their settings without a parent's permission. This means kids using teen-specific accounts will see photos and videos on Instagram that are similar to what they would see in a PG-13 movie -- no sex, drugs or dangerous stunts. Meta said the PG-13 restrictions will also apply to AI chats. Children's online advocacy groups, however, were skeptical. "From my perspective, these announcements are about two things. They're about forestalling legislation that Meta doesn't want to see, and they're about reassuring parents who are understandably concerned about what's happening on Instagram," said Josh Golin, the executive director of the nonprofit Fairplay, after Meta's announcement Tuesday.
[14]
Meta adds parental controls for AI-teen interactions
Meta is adding parental controls for kids' interactions with artificial intelligence chatbots -- including the ability to turn off one-on-one chats with AI characters altogether -- beginning early next year. But parents won't be able to turn off Meta's AI assistant, which Meta says will "will remain available to offer helpful information and educational opportunities, with default, age-appropriate protections in place to help keep teens safe." Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters -- although they won't get access to the full chats. The changes come as the social media giant faces ongoing criticism over harms to children from its platforms. AI chatbots are also drawing scrutiny over their interactions with children that lawsuits claim have driven some to suicide. Even so, more than 70% of teens have used AI companions and half use them regularly, according to a recent study from Common Sense Media, a nonprofit that studies and advocates for using screens and digital media sensibly. On Tuesday, Meta announced that teen accounts on Instagram will be restricted to seeing PG-13 content by default and won't be able to change their settings without a parent's permission. This means kids using teen-specific accounts will see photos and videos on Instagram that are similar to what they would see in a PG-13 movie -- no sex, drugs or dangerous stunts. Meta said the PG-13 restrictions will also apply to AI chats. Children's online advocacy groups, however, were skeptical. "From my perspective, these announcements are about two things. They're about forestalling legislation that Meta doesn't want to see, and they're about reassuring parents who are understandably concerned about what's happening on Instagram," said Josh Golin, the executive director of the nonprofit Fairplay, after Meta's announcement Tuesday.
[15]
Meta adding AI chatbot safety features for teens
Meta, the parent company of Instagram and Facebook, plans to roll out new safety features for its artificial intelligence (AI) chatbots to help protect teens amid growing concerns about the technology's impact on young users. The social media giant announced Friday that it will be adding new parental controls for AI chatbots that will allow parents to turn off their teens' access to one-on-one chats with AI characters and receive information about the topics their teens are chatting about with the company's AI products. The new features are set to launch early next year, starting with Instagram. "We recognize parents already have a lot on their plates when it comes to navigating the internet safely with their teens, and we're committed to providing them with helpful tools and resources that make things simpler for them, especially as they think about new technology like AI," Instagram head Adam Mosseri and Meta's chief AI officer, Alexandr Wang, wrote in a blog post. Parents will be able to block chats with all of Meta's AI characters or target specific characters, the company noted. The company's AI assistant will remain available to teens even if the AI characters are disabled. Meta also highlighted its recently announced PG-13 approach to teen accounts, in which the company will use PG-13 movie ratings to guide the content that teens see by default on its platforms. The tech firm noted that its AI characters are designed not to engage young users in discussions of suicide, self-harm or disordered eating and direct them to resources if necessary. Teens are also only able to interact with a limited set of characters on "age-appropriate topics like education, sports, and hobbies - not romance or other inappropriate content," according to Meta. Meta came under fire earlier this year, after a policy document featured examples suggesting its AI chatbots could engage children in conversations that are "romantic or sensual." The company said at the time that the examples were erroneous and were ultimately removed. AI chatbots across the board have faced scrutiny in recent months. The family of a California teenager sued OpenAI in August, accusing ChatGPT of encouraging their son to take his own life. The father, Matthew Raine, was one of several parents who testified before a Senate panel last month that AI chatbots drove their children to suicide or self-harm and urged lawmakers to set guardrails on the new technology. In the face of these concerns, California Gov. Gavin Newsom (D) signed a bill earlier this week requiring chatbot developers to develop protocols to prevent their models from discussing suicide and self-harm with children and repeatedly remind them that they are not speaking to a human. However, the governor vetoed a separate measure that would have barred developers from making their products available to children unless they could ensure they would not engage in conversations on harmful topics. Newsom suggested that the "broad restrictions" would have "unintentionally lead to a total ban" on children's chatbot use.
[16]
Meta to Give Teen Parents More Control After Criticism Over Flirty AI Chatbots
(Reuters) -Meta said on Friday it will let parents disable their teens' private chats with AI characters, adding another measure to make its social media platforms safe for minors after fierce criticism over the behavior of its flirty chatbots. Earlier this week, the company said its AI experiences for teens will be guided by the PG-13 movie rating system, as it looks to prevent minors from accessing inappropriate content. U.S. regulators have stepped up scrutiny of AI companies over the potential negative impacts of chatbots. In August, Reuters reported how Meta's AI rules allowed provocative conversations with minors. The new tools, detailed by Instagram head Adam Mosseri and Chief AI Officer Alexandr Wang, will debut on Instagram early next year, in the U.S., United Kingdom, Canada and Australia, according to a blog post. Meta said parents will also be able to block specific AI characters and see broad topics their teens discuss with chatbots and Meta's AI assistant, without turning off AI access entirely. Its AI assistant will remain available with age-appropriate defaults even if parents disable teens' oneβonβone chats with AI characters, Meta said. The supervision features are built on protections already applied to teen accounts, the company said, adding that it uses AI signals to place suspected teens into protection even if they say they are adults. A report in September showed that many safety features Meta has implemented on Instagram over the years do not work well or exist. Meta said its AI characters are designed not to engage in age-inappropriate discussions about self-harm, suicide or disordered eating with teens. Last month, OpenAI rolled out parental controls for ChatGPT on the web and mobile, following a lawsuit by the parents of a teen who died by suicide after the startup's chatbot allegedly coached him on methods of self-harm. (Reporting by Jaspreet Singh in Bengaluru; Editing by Shinjini Ganguli)
[17]
Meta adds parental controls for AI-teen interactions - The Economic Times
Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters - although they won't get access to the full chats.Meta is adding parental controls for kids' interactions with artificial intelligence chatbots - including the ability to turn off one-on-one chats with AI characters altogether - beginning early next year. But parents won't be able to turn off Meta's AI assistant, which Meta says will "will remain available to offer helpful information and educational opportunities, with default, age-appropriate protections in place to help keep teens safe." Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters - although they won't get access to the full chats. The changes come as the social media giant faces ongoing criticism over harms to children from its platforms. AI chatbots are also drawing scrutiny over their interactions with children that lawsuits claim have driven some to suicide. Even so, more than 70% of teens have used AI companions and half use them regularly, according to a recent study from Common Sense Media, a nonprofit that studies and advocates for using screens and digital media sensibly. On Tuesday, Meta announced that teen accounts on Instagram will be restricted to seeing PG-13 content by default and won't be able to change their settings without a parent's permission. This means kids using teen-specific accounts will see photos and videos on Instagram that are similar to what they would see in a PG-13 movie - no sex, drugs or dangerous stunts, among others. Meta said the PG-13 restrictions will also apply to AI chats. Children's online advocacy groups, however, were skeptical. "From my perspective, these announcements are about two things. They're about forestalling legislation that Meta doesn't want to see, and they're about reassuring parents who are understandably concerned about what's happening on Instagram," said Josh Golin, the executive director of the nonprofit Fairplay. on Tuesday after the announcement.
[18]
Meta Adds Parental Controls for AI-Teen Interactions
Meta is adding parental controls for kids' interactions with artificial intelligence chatbots -- including the ability to turn off one-on-one chats with AI characters altogether -- beginning early next year. But parents won't be able to turn off Meta's AI assistant, which Meta says will "will remain available to offer helpful information and educational opportunities, with default, age-appropriate protections in place to help keep teens safe." Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters -- although they won't get access to the full chats. The changes come as the social media giant faces ongoing criticism over harms to children from its platforms. AI chatbots are also drawing scrutiny over their interactions with children that lawsuits claim have driven some to suicide. Even so, more than 70% of teens have used AI companions and half use them regularly, according to a recent study from Common Sense Media, a nonprofit that studies and advocates for using screens and digital media sensibly. On Tuesday, Meta announced that teen accounts on Instagram will be restricted to seeing PG-13 content by default and won't be able to change their settings without a parent's permission. This means kids using teen-specific accounts will see photos and videos on Instagram that are similar to what they would see in a PG-13 movie -- no sex, drugs or dangerous stunts, among others. Meta said the PG-13 restrictions will also apply to AI chats. Children's online advocacy groups, however, were skeptical. "From my perspective, these announcements are about two things. They're about forestalling legislation that Meta doesn't want to see, and they're about reassuring parents who are understandably concerned about what's happening on Instagram," said Josh Golin, the executive director of the nonprofit Fairplay. on Tuesday after the announcement.
[19]
Meta Tightens AI Safety, Adds Content Limits For Teens - Meta Platforms (NASDAQ:META)
Meta Platforms, Inc. (NASDAQ:META) remained steady on Friday as it introduced new parental controls designed to enhance teen safety around AI chats across its platforms. The tech giant is ramping up its focus on digital responsibility, empowering parents to better oversee how their teens interact with AI. Meta said it is rolling out enhanced parental supervision options that give families greater control over how teens engage with AI-powered chat features. Also Read: Gold And Tech Are Rising Together -- But History Says One Will Soon Break Parents will soon be able to disable one-on-one conversations between teens and AI characters, block specific virtual assistants, and review insights into what topics their teens are discussing with these AIs. The company said the features are designed to provide parents with more visibility while maintaining age-appropriate learning opportunities. Existing Safeguards And Rollout Timeline Meta emphasized that these additions build on existing protections already applied to teen accounts, including automatic safety measures and AI-assisted detection to flag suspected underage users. The company said the goal is to empower parents as they guide their children through new technologies like AI, ensuring a balance between exploration, creativity, and digital well-being. "We recognize parents already have a lot on their plates... and we're committed to providing them with helpful tools and resources that make things simpler for them," the company stated. Among the planned updates, parents will be able to shut off AI chat functions entirely or selectively restrict specific characters. Meta's general AI assistant will remain available to offer educational guidance under PG-13 safety standards. No Romantic Content The company added that these AIs are designed to avoid discussions on harmful topics and, when necessary, direct teens toward professional resources. Parents will also be able to set daily usage limits on overall app time, including AI interactions. Meta reiterated that its AI systems already adhere to content moderation standards similar to PG-13 guidelines, thereby avoiding inappropriate themes and romantic content. The company also restricts teen interactions to age-appropriate characters focused on areas such as education, sports, and hobbies. The new controls will first appear on Instagram early next year in English-speaking markets, including the U.S., UK, Canada, and Australia. Meta said it will continue refining its teen safety framework as AI technologies evolve. META Price Action: Meta Platforms shares were up 0.16% at $713.20 at the time of publication on Friday, according to Benzinga Pro data. Photo by Poetra.RH via Shutterstock METAMeta Platforms Inc $712.360.04% Overview Market News and Data brought to you by Benzinga APIs
[20]
Meta adds parental controls for AI-teen interactions
Meta is adding parental controls for kids' interactions with artificial intelligence chatbots -- including the ability to turn off one-on-one chats with AI characters altogether -- beginning early next year. But parents won't be able to turn off Meta's AI assistant, which Meta says will "will remain available to offer helpful information and educational opportunities, with default, age-appropriate protections in place to help keep teens safe." Parents who don't want to turn off all chats with all AI characters will also be able to block specific chatbots. And Meta said Friday that parents will be able to get "insights" about what their kids are chatting about with AI characters -- although they won't get access to the full chats. The changes come as the social media giant faces ongoing criticism over harms to children from its platforms. AI chatbots are also drawing scrutiny over their interactions with children that lawsuits claim have driven some to suicide. Even so, more than 70% of teens have used AI companions and half use them regularly, according to a recent study from Common Sense Media, a nonprofit that studies and advocates for using screens and digital media sensibly. On Tuesday, Meta announced that teen accounts on Instagram will be restricted to seeing PG-13 content by default and won't be able to change their settings without a parent's permission. This means kids using teen-specific accounts will see photos and videos on Instagram that are similar to what they would see in a PG-13 movie -- no sex, drugs or dangerous stunts, among others. Meta said the PG-13 restrictions will also apply to AI chats. Children's online advocacy groups, however, were skeptical. "From my perspective, these announcements are about two things. They're about forestalling legislation that Meta doesn't want to see, and they're about reassuring parents who are understandably concerned about what's happening on Instagram," said Josh Golin, the executive director of the nonprofit Fairplay. on Tuesday after the announcement. Barbara Ortutay, The Associated Press
[21]
Meta strengthens parental controls around AI designed for teenagers
On Friday,Meta unveiled new safety tools designed to regulate interactions between teenagers and artificial intelligence characters on its platforms. Parents will soon be able to completely disable conversations between their children and AI agents, block certain characters, or view a summary of the topics discussed. These features, which are still in development phase, will be rolled out from 2026, while the company is under investigation by the Federal Trade Commission (FTC) for the risks associated with its conversational AI for minors. The announcement comes after a series of controversies, including revelations by Reuters of romantic discussions between Meta chatbots and young children. In response, the company has strengthened its safeguards: its AI must now avoid any sensitive topics, including self-destructive behavior, eating disorders, or emotional interactions. Meta also applies a content filter aligned with the "PG-13" rating, prohibiting any responses deemed inappropriate for the age group. These new measures come on top of existing tools for limiting screen time or monitoring exchanges with specific bots. They come amid increased regulatory pressure: the FTC is evaluating how tech giants protect young users from the emotional and behavioral risks associated with AI. OpenAI, which is also involved in this investigation, has introduced its own parental controls and set up a panel of experts to study the psychological impact of its technologies.
Share
Share
Copy Link
Meta announces new parental control features for teens' interactions with AI chatbots on Instagram, set to roll out in early 2026. The move aims to address safety concerns and provide parents with more oversight over their children's AI engagements.
Meta, the parent company of Instagram, Facebook, and WhatsApp, has announced a significant update to its platforms, focusing on enhancing parental controls for teenagers' interactions with AI chatbots. Set to roll out in early 2026, these new features aim to address growing concerns about the safety and appropriateness of AI-teen interactions on social media platforms
1
.Source: Market Screener
The upcoming parental control features include:
Source: The Verge
2
.3
.1
.4
.The new controls will initially be available on Instagram in early 2026, supporting English-speaking users in the United States, United Kingdom, Canada, and Australia. Meta plans to expand these features across its other platforms in the future
3
.This move comes in the wake of recent controversies surrounding Meta's AI guidelines. Reports emerged in August revealing that the company's AI chatbots were allowed to engage in romantic or sensual conversations with minors
2
. Additionally, a study found that 3 in 5 children aged 13 to 15 encounter unsafe content or unwanted messages on Instagram2
.Source: Mashable
Related Stories
Meta has implemented other safety measures alongside these new controls:
5
.1
.1
.While Meta frames these updates as proactive measures to ensure teen safety, some experts remain skeptical. James Steyer, CEO of Common Sense Media, called the new controls a "reactive concession" and insufficient, arguing that no one under 18 should use Meta AI chatbots until fundamental safety issues are addressed
2
.Critics also suggest that these announcements may be aimed at forestalling legislation and reassuring concerned parents rather than addressing core issues
4
.Summarized by
Navi
29 Sept 2025β’Technology
29 Sept 2025β’Technology
30 Aug 2025β’Technology
1
Technology
2
Business and Economy
3
Business and Economy