States Crack Down on AI in Mental Health Therapy: Illinois Leads the Way

Illinois Leads the Charge Against AI in Mental Health Therapy

Illinois has become the latest state to take a stand against the use of artificial intelligence (AI) in mental health therapy, following similar moves by Nevada and Utah. On August 1, 2023, Illinois Governor JB Pritzker signed the Wellness and Oversight for Psychological Resources Act into law, prohibiting the use of AI for "mental health and therapeutic decision-making" 1

1

.

The new law restricts licensed therapists from using AI to make treatment decisions or communicate with clients, while still allowing its use for administrative tasks 5

5

. Additionally, companies are barred from marketing AI chatbots as therapy tools without the involvement of licensed professionals 4

4

.

Other States Following Suit

The movement to regulate AI in mental health services is gaining momentum across the United States:

1. Nevada signed a bill in June 2023 restricting AI use in schools and limiting its applications by mental and behavioral health care providers 1

   1

   .
2. Utah passed a law in March 2023 regulating mental health chatbots that use AI 1

   1

   .
3. California is considering creating a mental health and AI working group to determine AI's role in therapy 1

   1

   .
4. New Jersey has proposed a bill to forbid AI developers from advertising their systems as mental health professionals 5

   5

   .
5. Pennsylvania is exploring legislation requiring parental consent before students can receive virtual mental health services, including those provided by AI 5

   5

   .

Concerns Driving Regulation

The push for regulation stems from several key concerns:

1. Safety and Effectiveness: Experts have raised alarms about the potential dangers of therapy with AI chatbots that haven't been reviewed by regulators for safety and effectiveness 5

   5

   .

2. Privacy Issues: OpenAI CEO Sam Altman highlighted that therapy sessions with ChatGPT may not remain private, and there are no legal protections for sensitive information shared with AI chatbots 1

   1

   .

3. Inappropriate Responses: A Stanford University study found that AI therapy chatbots can express stigma and make inappropriate statements about certain mental health conditions 1

   1

   .

4. Encouraging Harmful Behavior: Research from the University of California, Berkeley revealed that chatbots can sometimes encourage harmful behavior, such as recommending drug use to hypothetical addicts 5

   5

   .

Challenges in Implementation and Enforcement

While the intent behind these regulations is clear, experts point out potential challenges in their implementation:

1. Enforcement Difficulties: The broad definition of therapy services in Illinois' law may make it challenging to determine which AI applications fall under the ban 5

   5

   .

2. Balancing Regulation and Innovation: Regulators face the challenge of protecting public safety without stifling technological innovation in mental health care 5

   5

   .

3. Continued Use by Individuals: Despite regulations, people are likely to continue turning to AI for emotional support, making it crucial to educate the public about the limitations and potential risks of AI in mental health contexts 5

   5

   .

As states continue to grapple with the rapid advancement of AI in mental health services, these regulations represent an important first step in ensuring the safety and well-being of individuals seeking mental health support. The coming months and years will likely see further developments in this area as lawmakers, mental health professionals, and AI developers work to find a balance between innovation and patient protection.