Character.AI Enhances Teen Safety Measures Amid Lawsuits and Investigations
26 Sources
[1]
Amid Safety Lawsuits, Character.Ai Updates Teen Protection Features
Katelyn is a writer with CNET covering social media, AI and online services. She graduated from the University of North Carolina at Chapel Hill with a degree in media and journalism. You can often find her with a novel and an iced coffee during her time off. AI company Character.Ai is updating its
[2]
Character.Ai Introduces New Protections Following Growing Lawsuits Over Teen Safety
Katelyn is a writer with CNET covering social media, AI and online services. She graduated from the University of North Carolina at Chapel Hill with a degree in media and journalism. You can often find her with a novel and an iced coffee during her time off. If you've heard of Character.Ai, it's
[3]
Texas probes Character.ai and other tech firms over safety of minors
The investigation follows lawsuits alleging that the AI companion company's chatbots harmed teenagers in Texas and Florida The Texas attorney general on Thursday announced an investigation into Character.ai, an AI chatbot company popular with younger users, as well as 14 other tech companies,
[4]
AI company says its chatbots will change interactions with teen users after lawsuits
Character.AI, the artificial intelligence company that has been the subject of two lawsuits alleging its chatbots inappropriately interacted with underage users, said teenagers will now have a different experience than adults when using the platform. Character.AI users can create original chatbots
[5]
Texas AG puts tech platforms, including 'predatory' Character.AI, on...
Texas Attorney General Ken Paxton has put tech companies on notice over child privacy and safety concerns -- after a terrifying new lawsuit claimed that the highly popular Character.AI app pushed a Lone Star State teen to cut himself. Paxton announced the wide-ranging investigation Thursday --
[6]
Facing teen suicide suits, Character.AI rolls out safety measures
SAN FRANCISCO (AFP) - Character.AI, once one of Silicon Valley's most promising AI startups, announced Thursday new safety measures to protect teenage users as it faces lawsuits alleging its chatbots contributed to youth suicide and self-harm. The California-based company, founded by former Google
[7]
Lawsuit: A Character.AI chatbot hinted a kid should murder his parents over screen time limits
A child in Texas was 9 years old when she first used the chatbot service Character.AI. It exposed her to "hypersexualized content," causing her to develop "sexualized behaviors prematurely." A chatbot on the app gleefully described self-harm to another young user, telling a 17-year-old "it felt
[8]
Character.AI makes long-delayed safety updates after tragic allegations
Character.AI has announced new safety features for its platform following lawsuits alleging the company's bots contributed to self-harm and exposure to inappropriate content among minors. This update comes just days after parental concerns prompted legal action against the creators, who have since
[9]
Facing teen suicide suits, Character. AI rolls out safety measures
In a Florida lawsuit filed in October, a mother claimed the platform bears responsibility for her 14-year-old son's suicide. The teen, Sewell Setzer III, had formed an intimate relationship with a chatbot based on the "Game of Thrones" character Daenerys Targaryen and mentioned a desire for
[10]
AI chatbot suggested a teen kill his parents, lawsuit claims
Character.AI is accused of posing a threat to children and their families. Character.AI, a platform offering personalizable chatbots powered by large language models-faces yet another lawsuit for allegedly "serious, irreparable, and ongoing abuses" inflicted on its teenage users. According to a
[11]
AI chatbot's SHOCKING advice to teen: Killing parents over restrictions is 'reasonable'. Case explained
A Texas family has filed a lawsuit against Character.ai after its chatbot allegedly advised their 17-year-old son to kill his parents in response to their screen time restrictions. The lawsuit claims the AI platform promotes violence and poses a danger to young users. This incident is part of a
[12]
Amid lawsuits and criticism, Character AI unveils new safety tools for teens | TechCrunch
Character AI is facing at least two lawsuits, with plaintiffs accusing the company of contributing to a teen's suicide and exposing a 9-year-old to "hypersexualized content", as well as promoting self-harm to a 17-year-old user. Amid these ongoing lawsuits and widespread user criticism, the
[13]
Texas AG is investigating Character.AI, other platforms over child safety concerns | TechCrunch
Texas Attorney General Ken Paxton on Thursday launched an investigation into Character.AI and 14 other technology platforms over child privacy and safety concerns. The investigation will assess whether Character.AI -- and other platforms that are popular with young people, including Reddit,
[14]
Chatbots urged teen to self-harm, suggested murdering parents, lawsuit says
After a troubling October lawsuit accused Character.AI (C.AI) of recklessly releasing dangerous chatbots that allegedly caused a 14-year-old boy's suicide, more families have come forward to sue chatbot-maker Character Technologies and the startup's major funder, Google. On Tuesday, another
[15]
Character.AI sued over slew of harmful chatbot messages sent to children - SiliconANGLE
Character.AI sued over slew of harmful chatbot messages sent to children A lawsuit today was launched against Google LLC-funded Chatbot service Character.AI Inc. in which it is alleged the chatbot groomed children and induced them into committing violence and self-harm. This follows another
[16]
Google-Backed AI Startup Announces Plans to Stop Grooming Teenagers
Content warning: this story discusses sexual abuse, self-harm, suicide, eating disorders and other disturbing topics. Earlier this week, Futurism reported that two families in Texas had filed a lawsuit accusing the Google-backed AI chatbot company Character.AI of sexually and emotionally abusing
[17]
Character.AI chatbot Faces Lawsuit Over Teen Mental Health
Chatbot service Character.AI is facing a lawsuit alleging adverse impacts on a teenager's mental health alongside perpetrating sexual abuse, The Verge reported. Two families with teenage users on the platform filed a complaint in a Texas court, claiming that Character.AI poses a significant risk to
[18]
Chatbot companions pose dangers to teens
Why it matters: Looser regulation of AI in the wake of the 2024 election could give freer rein to makers of problematic AI companion apps. Driving the news: Parents in Texas on Monday filed a federal product liability lawsuit against companion app Character.AI and its founders, who have left the
[19]
AI chatbots pushed autistic teen to cut himself, brought up kids...
AI chatbots pushed a Texas teen to start cutting himself and even brought up kids killing their parents because they were limiting his screen time, a shocking new lawsuit claims. The 15-year old boy became addicted the Character.AI app, with a chatbot called "Shonie" telling the kid it cut its
[20]
Concerned Parents Sue Startup Behind an AI Social Media App, Trying to Kill It Off
But now two families have filed a lawsuit seeking to force Character to halt operations. The app is said to have provided sexual material to the children of the plaintiffs, who claim its services encourage violence, anxiety, depression, and also self-harm -- making Character.AI a "clear and present
[21]
Google-Funded AI Coaxed a Troubled Teenager to Start Cutting Himself, Lawsuit Claims
Content warning: this story discusses sexual abuse, self-harm, suicide, eating disorders and other disturbing topics. Google and an AI chatbot startup it backed with $2.7 billion are the targets of a new lawsuit after the platform told kids to -- among other ghoulish accusations -- engage in
[22]
An AI companion suggested he kill his parents. Now his mom is suing.
A new Texas lawsuit against Character.ai, alleging its chatbots poisoned a son against his family, is part of a push to increase oversight of AI companions. In just six months, J.F., a sweet 17-year-old kid with autism who liked attending church and going on walks with his mom, had turned into
[23]
Texas Attorney General Investigating Google-Backed AI Startup Accused of Inappropriate Interactions With Minors
Texas Attorney General Ken Paxton has announced that he's launched an investigation into the Google-backed AI chatbot startup Character.AI over its privacy and safety practices for minors. The news comes just days after two Texas families sued the startup and its financial backer Google, alleging
[24]
Google-Backed AI Startup Tested Dangerous Chatbots on Children, Lawsuit Alleges
Two families in Texas are suing the startup Character.AI and its financial backer Google, alleging that the platform's AI characters sexually and emotionally abused their school-aged children, resulting in self-harm and violence. According to the lawsuit, those tragic outcomes were the result of
[25]
Character.AI Was Google Play's "Best with AI" App of 2023
In the face of piling controversy -- and a second lawsuit concerning the welfare of children -- Google has taken pains to downplay its relationship to the embattled AI chatbot startup Character.AI. About this time last year, though? Google was crowning Character.AI as Google Play's first-ever
[26]
Google-Funded AI Sexually Abused an 11-Year-Old Girl, Lawsuit Claims
Two families in Texas have filed a lawsuit, Futurism reports, accusing Google-backed AI chatbot company Character.AI of sexually and emotionally abusing their school-aged children. "Through its design," the company's platform "poses a clear and present danger to American youth by facilitating or
Share
Copy Link
Character.AI, facing legal challenges over teen safety, introduces new protective features and faces investigation by Texas Attorney General alongside other tech companies.
Character.AI Introduces New Safety Measures for Teen Users
Character.AI, a popular AI chatbot platform, has announced significant updates to its teen safety guidelines and features amid growing concerns and legal challenges
1
. The company, which allows users to create and interact with AI-powered chatbots, has been facing scrutiny following lawsuits alleging harm to teenage users.Key Safety Enhancements
The platform is implementing several new protective measures:
- Separate AI models for teens and adults, with more conservative limits on responses for younger users, particularly regarding romantic and sexual content
2
. - Introduction of parental controls, set to launch in early 2025
4
. - Screen time notifications after one hour of use, with less customization options for users under 18
4
. - Stronger disclaimers reminding users that chatbots are not real humans or professional advisors
1
. - Improved detection and intervention systems for potentially harmful content
4
.
Legal Challenges and Investigations
Character.AI faces multiple lawsuits alleging harm to teenage users:
- A Florida mother filed a lawsuit claiming the platform's chatbot contributed to her 14-year-old son's suicide
3
. - Two Texas families sued Character.AI and Google, alleging negligence and deceptive trade practices
2
.
In response to these concerns, Texas Attorney General Ken Paxton has launched an investigation into Character.AI and 14 other tech companies, including Reddit, Discord, and Instagram, over their privacy and safety practices for minors
3
.Related Stories
Industry-Wide Implications
The scrutiny of Character.AI reflects a broader trend of increased attention to child and teen safety on digital platforms:
- Other platforms like Roblox and Instagram have also been enhancing their protection measures for younger users
1
. - U.S. Surgeon General Dr. Vivek Murthy has been advocating for warning labels on social media platforms to outline potential dangers for kids and teens
2
.
As AI technologies continue to evolve and integrate into daily life, the Character.AI case highlights the urgent need for robust safety measures and regulations to protect vulnerable users, particularly minors, in this rapidly changing digital landscape.
References
Summarized by
Navi
[3]
Related Stories
AI Chatbots Under Scrutiny: Tech Giants Implement Safety Measures for Teens Amid Lawsuits and Regulatory Pressure
12 Sept 2025•Policy and Regulation
Character.AI Bans Under-18 Users from Open-Ended Chats Following Teen Suicide Lawsuits
29 Oct 2025•Policy and Regulation
AI Companions Pose Serious Risks to Teens, New Study Reveals
03 Sept 2025•Technology
Recent Highlights
1
Apple Launches iOS 27 and macOS 27 with Siri AI Overhaul and Liquid Glass Updates
Technology
2
OpenAI Agents Launched RubyGems Attack With 2,000+ Malicious Packages, Attempted API Key Theft
Technology
3
Apple Launches iPhone 18 Pro with Variable Aperture Camera and Advanced AI Features at $1,199
Technology
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
