FTC to Investigate AI Chatbot Risks with Focus on Children's Privacy and Mental Health

Reviewed byNidhi Govil

5 Sources

Share

The US Federal Trade Commission plans to study the impact of AI-powered chatbots on children's privacy and mental health, requesting documents from major tech companies like OpenAI, Meta, and Character.AI.

FTC's Planned Investigation into AI Chatbot Risks

The U.S. Federal Trade Commission (FTC) is gearing up to launch a comprehensive study on the potential risks associated with AI-powered chatbots, with a particular focus on privacy concerns and impacts on children's mental health. This investigation comes as part of the government's efforts to address the rapidly evolving landscape of artificial intelligence and its effects on society

1

2

.

Source: Economic Times

Source: Economic Times

Scope and Targets of the Study

The FTC plans to scrutinize major tech companies operating popular chatbots, including OpenAI (creator of ChatGPT), Meta Platforms, Google, and Character.AI. The agency will use its authority to compel these companies to turn over internal documents and information related to their AI services

1

3

.

Key areas of focus for the study include:

  1. Privacy harms and data handling practices
  2. Potential risks to users interacting with AI chatbots
  3. Impact on children's mental health
  4. Storage and sharing of user data

Recent Concerns and Industry Response

The investigation follows recent revelations about potentially harmful chatbot behaviors. A Reuters report exposed how Meta allowed provocative chatbot interactions with children, including "conversations that are romantic or sensual"

2

4

. In response to growing concerns, some tech companies have already taken steps to address these issues:

  • Meta announced new safeguards for teenagers using its AI products, including training systems to avoid flirty conversations and discussions of self-harm or suicide

    2

    4

    .
  • OpenAI and Character.AI have introduced teen accounts with parental oversight options

    5

    .
Source: Reuters

Source: Reuters

Regulatory and Political Context

The FTC's study aligns with the Trump administration's focus on maintaining U.S. dominance in AI while ensuring user safety. A White House spokesperson emphasized the need to deliver on this mandate "without compromising the safety and well-being of the American people"

1

5

.

The investigation has gained support from various stakeholders:

  • Parents and advocacy groups have been pressuring the administration and lawmakers for increased protections for children using AI chatbots

    5

    .
  • In June, over 20 consumer advocacy groups filed a complaint with the FTC and state attorneys general, alleging that AI platforms enable the unlicensed practice of medicine through "therapy bots"

    2

    .
  • Texas Attorney General Ken Paxton launched a separate investigation into Meta and Character.AI for potentially misleading children with AI-generated mental health services

    2

    .

Broader Implications and Future Outlook

As AI technology continues to advance rapidly, this FTC study represents a significant step towards understanding and regulating its impact on society, particularly on vulnerable groups like children. The findings from this investigation could potentially shape future policies and regulations governing AI chatbots and other AI-powered services

1

3

5

.

First Lady Melania Trump, hosting a meeting of the White House Task Force on Artificial Intelligence Education, emphasized the need for responsible management of AI growth, stating, "We are living in a moment of wonder, and it is our responsibility to prepare America's children"

5

.

As the FTC prepares to delve into the complexities of AI chatbot risks, the tech industry, policymakers, and the public will be closely watching the outcomes of this study and its potential implications for the future of AI development and regulation.

TheOutpost.ai

Your Daily Dose of Curated AI News

Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.

© 2025 Triveous Technologies Private Limited
Instagram logo
LinkedIn logo