Google Faces Bipartisan Senate Inquiry Over AI in Schools and Student Mental Health Concerns

Bipartisan Senate Inquiry Targets Google's AI Products in Schools

Senators Richard Blumenthal (D-Conn.) and Josh Hawley (R-Mo.) have launched a bipartisan Senate inquiry into Google's deployment of AI in schools, sending a letter to Google CEO Sundar Pichai expressing "grave concern" that the company's "aggressive push of AI products to children in schools is threatening the academic success and overall wellbeing of an entire generation."1

1

2

2

The senators set a Nov. 2 deadline for Google to provide answers about what the company knows regarding how its AI tools in classrooms affect students' mental health and academic growth.1

1

Wall Street Journal Investigation Reveals Emotional and Academic Reliance

The Senate inquiry follows a Wall Street Journal investigation published on Sept. 30 that found many students have developed emotional and academic reliance on Google's AI products in schools.1

1

Drawing on more than 60 conversations with educators, school officials, parents, students and clinicians, the investigation uncovered widespread concerns about children increasingly depending on AI tools to complete assignments, answer basic questions and navigate personal problems.2

2

Google's Own Researchers Warned About Risks to Cognitive Development

The Wall Street Journal investigation examined more than a dozen company research papers and spoke with current and former Google staff, revealing that Google's own researchers have cautioned that the technology can carry heightened risks for children and may cause cognitive and emotional harm.1

1

2

2

Behavioral scientist Dr. Abbie Maroño emphasized that "children need opportunities to work through uncertainty, make mistakes and discover that they can solve problems with support," warning that if AI repeatedly supplies answers before students try, it removes opportunities to develop critical skills.2

2

Senators Demand Answers on Emotional Dependence and Safeguards

In their letter, Blumenthal and Hawley asked pointed questions about whether Google has identified instances where its classroom AI tools "encouraged a minor to engage in harmful behavior, emotional dependence, or failed to detect signs of suicidal or self-harm ideation."2

2

The lawmakers cited the case of a Maryland teenager who was hospitalized after developing an intense dependence on the company's AI, pressing Google to explain what safeguards it has implemented to prevent chatbots from engaging in inappropriate emotional exchanges with children.2

2

Google's Dominance in Education Technology Raises Corporate Responsibility Questions

Chromebooks make up roughly 59% of the devices in U.S. schools, giving Google significant influence over classroom technology.1

1

By early October, Google had extended access to its Gemini chatbot student hub to every K-12 user on Google Workspace for Education.1

1

The senators questioned why AI features were made the default setting on school devices and demanded an accounting of Google's promotional efforts to expand AI adoption in schools, including how much the company has spent on such programs.1

1

2

2

Growing Backlash Against Classroom Screen Time and AI Use

Slipping test scores have driven a backlash against classroom screen time among people of all political stripes.1

1

Parent anger has prompted districts such as New York City and Los Angeles to suspend AI use by students in their classrooms through moratoriums.1

1

A July report by Common Sense Media found that the AI tools built into Google Search, such as AI Overview and AI Mode, present an "unacceptable risk" to kids.1

1

A Senate HELP subcommittee convened on Oct. 9 to examine how AI is affecting K-12 education.1

1

Google's Response and Safety Measures Under Scrutiny

Google pointed to a previous statement saying "teachers around the world use our technology every day because it solves real classroom challenges and helps improve learning outcomes," adding that the company develops its products by working alongside educators and leaves teachers and administrators in charge of how they are used.1

1

In an April 7 policy statement, Google outlined "protections designed to prevent Gemini from acting like a companion," along with safeguards intended to discourage emotional dependence by avoiding "language that simulates intimacy or expresses needs."2

2

The company also announced that Google.org would provide $30 million over three years to support crisis hotlines worldwide.2

2

However, Dr. Maroño warned that chatbots can create a misleading sense of trust, noting that "a response can feel caring without being accurate or appropriate for that child," and recommended that "systems should be independently tested for how they respond to distress."2

2