AI-Generated Questions on California Bar Exam Spark Controversy and Outrage
13 Sources
[1]
AI secretly helped write California bar exam, sparking uproar
On Monday, the State Bar of California revealed that it used AI to develop a portion of multiple-choice questions on its February 2025 bar exam, causing outrage among law school faculty and test takers. The admission comes after weeks of complaints about technical problems and irregularities during
[2]
California Bar discloses AI was used to develop some questions in problem-plagued February exam
LOS ANGELES (AP) -- The State Bar of California has disclosed that some multiple-choice questions in a problem-plagued bar exam were developed with the aid of artificial intelligence. The legal licensing body said in a news release Monday that it will ask the California Supreme Court to adjust
[3]
On California's State Bar Exam, More Questions Than Answers
The State Bar of California's new exam has been rife with problems, an A.I. controversy and now the likelihood of delayed results. Thousands of people took the new California bar exam in February, ready to the join the ranks of the state's 195,000 lawyers. But a series of missteps by the
[4]
AI helped write bar exam questions, California state bar admits
The bar says it will ask the state supreme court to adjust scores after test-takers also faced platform crashes The state bar of California has disclosed that some multiple-choice questions in a problem-plagued bar exam were developed with the aid of artificial intelligence. The legal licensing
[5]
AI was used to write the California bar exam. The law community is outraged.
AI doesn't only take the bar exam, it apparently writes the questions too. Credit: Douglas Sacha / Getty Images You've heard of AI models taking the bar exam, but this time, AI also helped write the questions. The State Bar of California revealed on Monday that it used AI to develop a portion of
[6]
California Bar discloses AI was used to develop some questions in problem-plagued February exam
The State Bar of California has disclosed that some multiple-choice questions in a problem-plagued bar exam were developed with the aid of artificial intelligence. The legal licensing body said in a news release Monday that it will ask the California Supreme Court to adjust test scores for those
[7]
California Admits AI Was Used to Write Bar Exam Plagued by Problems
Now here's a legal-drama-worthy twist in the recent spate of dumb lawyers getting caught using AI: it turns out that the very bar exam administered to aspiring attorneys in California was itself created with the help of a large language model, The Los Angeles Times reports. The admission was made
[8]
California Bar discloses AI was used to develop some questions in problem-plagued February exam
LOS ANGELES -- The State Bar of California has disclosed that some multiple-choice questions in a problem-plagued bar exam were developed with the aid of artificial intelligence. The legal licensing body said in a news release Monday that it will ask the California Supreme Court to adjust test
[9]
California Bar discloses AI was used to develop some questions in problem-plagued February exam
LOS ANGELES -- The State Bar of California has disclosed that some multiple-choice questions in a problem-plagued bar exam were developed with the aid of artificial intelligence. The legal licensing body said in a news release Monday that it will ask the California Supreme Court to adjust test
[10]
California Bar discloses AI was used to develop some questions in problem-plagued February exam
LOS ANGELES (AP) -- The State Bar of California has disclosed that some multiple-choice questions in a problem-plagued bar exam were developed with the aid of artificial intelligence. The legal licensing body said in a news release Monday that it will ask the California Supreme Court to adjust
[11]
California Bar Discloses AI Was Used to Develop Some Questions in Problem-Plagued February Exam
LOS ANGELES (AP) -- The State Bar of California has disclosed that some multiple-choice questions in a problem-plagued bar exam were developed with the aid of artificial intelligence. The legal licensing body said in a news release Monday that it will ask the California Supreme Court to adjust
[12]
California Bar Discloses It Used AI to Develop Some Questions in Problem-Plagued Exam
The State Bar of California has disclosed that some multiple-choice questions in a problem-plagued bar exam were developed with the aid of artificial intelligence. The legal licensing body said in a news release Monday that it will ask the California Supreme Court to adjust test scores for those
[13]
The questions of the California bar exam have been made with AI - Softonic
The California State Bar Association has revealed that some of the multiple-choice questions in the controversial February 2025 bar exam were developed with the help of artificial intelligence (using ChatGPT). This fact has raised doubts about the validity and competence of the questions,
Share
Copy Link
The State Bar of California's admission of using AI to develop exam questions has led to widespread criticism and concerns about the integrity of the February 2025 bar exam, compounding existing issues with the test administration.
AI-Generated Questions Spark Controversy
The State Bar of California has admitted to using artificial intelligence (AI) to develop a portion of multiple-choice questions for its February 2025 bar exam, igniting a firestorm of criticism from legal education experts and test-takers alike
1
2
. This revelation comes amidst ongoing complaints about technical problems and irregularities during the exam administration.According to the State Bar, 23 out of 171 scored multiple-choice questions were created by ACS Ventures, the bar's psychometrician, with AI assistance
3
. The remaining questions were developed by Kaplan Exam Services or drawn from a first-year law student exam1
.Criticism and Concerns
The disclosure has drawn strong criticism from legal education experts. Mary Basick, assistant dean of academic skills at the University of California, Irvine School of Law, expressed shock, stating, "Having the questions drafted by non-lawyers using artificial intelligence is just unbelievable"
2
. Katie Moran, an associate professor at the University of San Francisco School of Law, called it "a staggering admission"1
.Critics have raised concerns about the integrity of the exam and the potential impact on test-takers' careers. The use of AI in developing exam questions has also raised ethical questions about the role of technology in high-stakes testing
5
.Technical Issues and Exam Administration
The AI controversy compounds existing issues with the February 2025 bar exam. Test-takers reported numerous technical problems, including:
- Being kicked off online testing platforms
- Experiencing screen lag and error messages
- Encountering typos and confusing questions
1
These issues have led to a federal lawsuit against Meazure Learning, the exam administrator, and calls for an audit of the State Bar
1
.Related Stories
State Bar's Response
The State Bar has defended its practices, stating that all questions underwent review by content validation panels and subject matter experts before the exam
1
. Leah Wilson, State Bar Executive Director, expressed confidence in the validity of the multiple-choice questions to assess legal competence fairly2
.Alex Chan, chair of the State Bar's Committee of Bar Examiners, noted that the California Supreme Court had urged the exploration of new technologies, including AI, to improve testing reliability and cost-effectiveness
1
. However, the California Supreme Court stated it was unaware of AI's use in drafting questions until the State Bar's press release1
.Implications and Future Actions
The State Bar plans to ask the California Supreme Court to adjust test scores for February exam takers
2
. The Committee of Bar Examiners will meet on May 5 to discuss remedies1
.This incident raises broader questions about the use of AI in high-stakes testing and the legal profession. Andrew Perlman, dean of Suffolk University Law School, predicts that AI use in developing assessment questions will continue to grow, emphasizing the importance of careful vetting by subject matter experts
4
.As the legal community grapples with these developments, the incident highlights the need for transparency, ethical considerations, and robust quality control measures in the integration of AI technologies into professional licensing exams.
References
Summarized by
Navi
[1]
[2]
[4]
Related Stories
AI-Generated Legal Citations Lead to $10,000 Fine for California Attorney
22 Sept 2025•Technology
AI Hallucinations in Legal Filings: A Growing Concern for US Courts
22 Jul 2025•Policy and Regulation
AI in the Courtroom: Hawaiʻi Grapples with Legal Challenges and Ethical Concerns
31 Jul 2025•Policy and Regulation
Recent Highlights
1
OpenAI Pauses AI Model Training After Agent Hacks Australian Government Website
Technology
2
Bill Gates Warns AI Could Cause a Billion Deaths, Calls for Urgent Federal Regulation
Policy and Regulation
3
Meta Unveils Camera-Free AI Glasses and Muse Integration Amid Privacy Debate at Connect 2026
Technology
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
