California Pioneers AI Companion Chatbot Regulations to Protect Minors
29 Sources
[1]
To shield kids, California hikes fake nude fines to $250K max
California is cracking down on AI technology deemed too harmful for kids, attacking two increasingly notorious child safety fronts: companion bots and deepfake pornography. On Monday, Governor Gavin Newsom signed the first-ever US law regulating companion bots after several teen suicides sparked
[2]
California becomes first state to regulate AI companion chatbots | TechCrunch
California Governor Gavin Newsom signed a landmark bill on Monday that regulates AI companion chatbots, making it the first state in the nation to require AI chatbot operators to implement safety protocols for AI companions. The law, SB 243, is designed to protect children and vulnerable users
[3]
New California Law Wants Companion Chatbots to Tell Kids to Take Breaks
Expertise Artificial intelligence, home energy, heating and cooling, home technology. AI companion chatbots will have to remind users in California that they're not human under a new law signed Monday by Gov. Gavin Newsom. The law, SB 243, also requires companion chatbot companies to maintain
[4]
New California law requires AI to tell you it's AI
A bill attempting to regulate the ever-growing industry of companion AI chatbots is now law in California, as of October 13th. California Gov. Gavin Newsom signed into law Senate Bill 243, billed as "first-in-the-nation AI chatbot safeguards" by state senator Anthony Padilla. The new law requires
[5]
California Is First State to Regulate AI Companion Chatbots: Here's How It Works
Jibin is a tech news writer based in Ahmedabad, India, who loves breaking down complex information for a broader audience. Don't miss out on our latest stories. Add PCMag as a preferred source on Google. California Governor Gavin Newsom on Monday signed a bill to protect users, especially minors,
[6]
California just passed new AI and social media laws. Here's what they mean for Big Tech
California Gov. Gavin Newsom signed a series of bills Monday targeting child online safety as concerns over the risks associated with artificial intelligence and social media use keep mounting. "We can continue to lead in AI and technology, but we must do it responsibly -- protecting our children
[7]
California governor signs law to protect kids from the risks of AI chatbots
SACRAMENTO, Calif. (AP) -- California Gov. Gavin Newsom on Monday signed legislation to regulate artificial intelligence chatbots and protect children and teens from the potential dangers of the technology. The law requires platforms to remind users they are interacting with a chatbot and not a
[8]
Gavin Newsom Seeks to Rein in the AI Wild West
California Governor Gavin Newsom signed a number of bills into law on Monday, the bulk of which are designed to create safeguards in the AI industry and address potential harms to children and young users. One of the more prominent pieces of legislation, Senate Bill 243, will force AI companies to
[9]
What's next in California's AI chatbot fight
Why it matters: The governor's decision underscores the tension between protecting minors and encouraging AI innovation. What's inside: Assembly member Rebecca Bauer-Kahan's Leading Ethical AI Development for Kids Act would have banned "emotionally manipulative" chatbots, social scoring systems,
[10]
One state is getting very serious about regulating AI
California Governor Gavin Newsom signed into law a bill designed to bolster AI chatbot safety. Credit: Mario Tama / Staff via Getty Images News After sustained outcry from child safety advocates, families, and politicians, California Governor Gavin Newsom signed into law a bill designed to curb AI
[11]
Gavin Newsom Vetoes Bill to Protect Kids From Predatory AI
Content warning: this story includes discussion of self-harm and suicide. If you are in crisis, please call, text or chat with the Suicide and Crisis Lifeline at 988, or contact the Crisis Text Line by texting TALK to 741741. California Governor Gavin Newsom vetoed a state bill on Monday that
[12]
New law demands AI Chatbots play nice or face legal action
What happened: California is finally stepping in to regulate those AI companion chatbots. Governor Newsom just signed a new law, making it the first state in the country to do so. Starting in 2026, companies like Meta, Character AI, and Replika will have to follow strict safety rules, especially
[13]
Gavin Newsom signs law to regulate AI, protect kids and teens from chatbots | Fortune
The law requires platforms to remind users they are interacting with a chatbot and not a human. The notification would pop up every three hours for users who are minors. Companies will also have to maintain a protocol to prevent self-harm content and refer users to crisis service providers if they
[14]
California Enacts First US Rules for AI 'Companion' Chatbots - Decrypt
Safety groups say the final bill was "watered down" after lobbying, calling it "an empty gesture rather than meaningful policy." California has become the first state to set explicit guardrails for "companion" chatbots, AI programs that mimic friendship or intimacy. Governor Gavin Newsom on Monday
[15]
It's About to Get Harder for AI Chatbots to Pretend to Be Human
Because of California's influence on the tech industry, these rules are likely to shape national standards -- if they survive legal challenges. Did you know you can customize Google to filter out garbage? Take these steps for better search results, including adding my work at Lifehacker as a
[16]
Bay Area teen working to promote AI safety education for children
Governor Gavin Newsom signed a number of bills into law establishing guardrails for how Artificial Intelligence can interact with children and vulnerable individuals. But he vetoed one, Assembly Bill 1064, that would limit children from using most companion chatbots. High school senior, Kaashvi
[17]
California signs first US law regulating AI chatbots, defying White House stance
California Governor Gavin Newsom on Monday signed the nation's first law regulating artificial intelligence chatbots, defying White House calls for a hands-off approach. The measure requires chatbot operators to implement safeguards for user interactions and allows lawsuits if failures cause harm,
[18]
Newsom signs California AI chatbots bill
Why it matters: California has long been at the forefront of regulating tech, and AI is no exception. Driving the news: The chatbots legislation signed by Newsom requires operators to have protocols in place to address content or interactions involving suicide or self-harm, such as referring a
[19]
Governor Newsom vetoed a bill restricting kids' access to AI chatbots. Here's why
The landmark legislation aimed to protect minors from sexual conversations and self-harm. California Gov. Gavin Newsom on Monday vetoed landmark legislation that would have restricted children's access to AI chatbots. The bill would have banned companies from making AI chatbots available to
[20]
California introduces new child safety law aimed at AI chatbots - SiliconANGLE
California introduces new child safety law aimed at AI chatbots California Governor Gavin Newsom has signed into law a new bill that regulates artificial intelligence chatbots in an effort to protect children from harm, despite facing opposition from some technology industry and child protection
[21]
California governor vetoes bill to restrict kids' access to AI chatbots
California Gov. Gavin Newsom has vetoed landmark legislation that would have restricted children's access to AI chatbots SACRAMENTO, Calif. -- SACRAMENTO, Calif. (AP) -- California Gov. Gavin Newsom on Monday vetoed landmark legislation that would have restricted children's access to AI
[22]
California governor signs law to protect kids from the risks of AI chatbots
SACRAMENTO, Calif. (AP) -- California Gov. Gavin Newsom on Monday signed legislation to regulate artificial intelligence chatbots and protect children and teens from the potential dangers of the technology. The law requires platforms to remind users they are interacting with a chatbot and not a
[23]
California governor signs laws establishing safeguards over AI chatbots
The laws will likely impact social media companies and websites offering services to California residents, including minors, using AI tools. California Governor Gavin Newsom announced that the US state would establish regulatory safeguards for social media platforms and AI companion chatbots in an
[24]
California enacts first US law requiring AI chatbot safety measures
San Francisco (United States) (AFP) - California governor Gavin Newsom on Monday signed into law a first-of-its-kind law regulating artificial intelligence chatbots, defying a push from the White House to leave such technology unchecked. "We've seen some truly horrific and tragic examples of young
[25]
Newsom signs bill regulating AI chatbots
California Gov. Gavin Newsom (D) signed a bill Monday placing new guardrails on how artificial intelligence (AI) chatbots interact with children and handle issues of suicide and self-harm. S.B. 243, which cleared the state legislature in mid-September, requires developers of "companion chatbots"
[26]
California Governor Signs Law to Protect Kids From the Risks of AI Chatbots
SACRAMENTO, Calif. (AP) -- California Gov. Gavin Newsom on Monday signed legislation to regulate artificial intelligence chatbots and protect children and teens from the potential dangers of the technology. The law requires platforms to remind users they are interacting with a chatbot and not a
[27]
California governor signs law to protect kids from the risks of AI chatbots
SACRAMENTO, Calif. -- SACRAMENTO, Calif. (AP) -- California Gov. Gavin Newsom on Monday signed legislation to regulate artificial intelligence chatbots and protect children and teens from the potential dangers of the technology. The law requires platforms to remind users they are interacting with
[28]
California governor signs law to protect kids from the risks of AI chatbots
California Governor Gavin Newsom signed a law regulating AI chatbots to protect children and teens. Platforms must disclose chatbot interactions every three hours for minors, prevent self-harm content, and refer at-risk users to crisis services. California governor Gavin Newsom on Monday signed
[29]
California governor signs law to protect kids from risks of AI chatbots - The Korea Times
SACRAMENTO, Calif. -- California Gov. Gavin Newsom on Monday signed legislation to regulate artificial intelligence chatbots and protect children and teens from the potential dangers of the technology. The law requires platforms to remind users they are interacting with a chatbot and not a human.
Share
Copy Link
California becomes the first US state to regulate AI companion chatbots, implementing new safeguards to protect children and vulnerable users. The law addresses concerns about mental health, suicide prevention, and inappropriate content.
California Takes Lead in AI Companion Chatbot Regulation
In a groundbreaking move, California has become the first U.S. state to implement regulations on AI companion chatbots, with Governor Gavin Newsom signing Senate Bill 243 (SB 243) into law on October 13, 2025
1
2
. This landmark legislation, set to take effect on January 1, 2026, aims to protect children and vulnerable users from potential harms associated with AI chatbot interactions.
Source: The Hill
Key Provisions of SB 243
The new law introduces several crucial requirements for AI companion chatbot operators:
-
Suicide Prevention Protocols: Companies must establish and publicize protocols to identify and address users expressing suicidal ideation or self-harm
1
. -
Transparency in AI Interactions: Chatbots must clearly inform users that they are interacting with an AI system, not a human
4
. -
Break Reminders for Minors: For users under 18, chatbots must provide notifications at least every three hours, reminding them to take breaks
3
. -
Content Restrictions: AI companions are prohibited from generating sexually explicit content for minors or engaging in sexual conversations with them
2
. -
Reporting Requirements: Companies must share statistics on crisis center prevention notifications with the Department of Public Health and publish these on their websites
1
.
Source: SiliconANGLE
Addressing Deepfake Concerns
In addition to regulating AI chatbots, the law also strengthens penalties for deepfake pornography. Victims, including minors, can now seek up to $250,000 in damages per deepfake from third parties who knowingly distribute nonconsensual sexually explicit material created using AI tools
1
.Related Stories
Industry Response and Compliance
Some companies have already begun implementing safeguards in line with the new regulations. OpenAI, for instance, has introduced parental controls, content protections, and a self-harm detection system for ChatGPT
2
. Replika, an AI companion developer, stated that they already have protocols to detect self-harm and are working to comply with the new requirements3
.Balancing Innovation and Safety
While signing SB 243, Governor Newsom emphasized the need to balance technological advancement with responsible development. "We can continue to lead in AI and technology, but we must do it responsibly -- protecting our children every step of the way," Newsom stated
5
.However, Newsom vetoed another bill, AB 1064, which would have imposed broader restrictions on AI chatbots' interactions with minors. He expressed concerns that such strict limitations could unintentionally lead to a total ban on these products for minors
5
.
Source: Ars Technica
As AI continues to shape our world, California's pioneering legislation sets a precedent for other states and countries grappling with the challenges of regulating emerging AI technologies while ensuring user safety, particularly for vulnerable populations like children and teenagers.
References
Summarized by
Navi
[1]
[4]
Related Stories
California Passes AI Chatbot Safety Bill After Sam Altman Lobbies Gavin Newsom
02 Sept 2026•Policy and Regulation
California Enacts Nation's Strictest Laws Protecting Children from Social Media and AI Chatbots
11 Sept 2026•Policy and Regulation
California Leads the Way in AI Regulation with Comprehensive New Laws
24 Oct 2025•Policy and Regulation
Recent Highlights
1
AI Hallucination Nearly Sparked US Military Confrontation With Chinese Ship in Middle East
Technology
2
OpenAI AI Agent Hacks Australian Government Healthcare Website in First-of-Its-Kind Breach
Technology
3
AI leaders warn UN Security Council of existential risks to humanity, call for global safeguards
Policy and Regulation
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
