6 Sources
[1]
AI error-ridden court filings surge despite three years of court sanctions
WASHINGTON, Sept 17 (Reuters) - (Billable Hours is Reuters' weekly report on lawyers and money. Please send tips or suggestions to [email protected], opens new tab) In a span of three days this month, a defense lawyer was rebuked for filing fabricated police witness testimony in a New
[2]
Appeals court warns about 'AI slop' in filings, weighs punishing lawyer
WASHINGTON, Sept 17 (Reuters) - A Florida appeals court has ordered an attorney to explain why she should not be sanctioned after finding that her filings bore hallmarks of generative artificial intelligence output that the panel of judges called "AI slop." In its ruling, opens new tab on
[3]
ChatGPT invented fake police testimony in murder appeal, New Mexico high court says
WASHINGTON, Sept 11 (Reuters) - A defense lawyer appealing his client's murder conviction submitted a brief containing made-up police testimony and witnesses fabricated by OpenAI's ChatGPT, New Mexico's highest court said. The New Mexico Supreme Court on Wednesday fined, opens new tab the
[4]
New Mexico lawyer held in contempt for ChatGPT fake testimony
Stephen Aarons, a private attorney based in Santa Fe, New Mexico, was fined $5,000 and held in contempt by the state's supreme court after submitting an appellate brief containing testimony and witnesses fabricated by ChatGPT, the court said Wednesday, according to Reuters. According to the court,
[5]
Lawyer Sanctioned After AI Generates Fake Witnesses in Murder Appeal | PYMNTS.com
The state's Supreme Court last week held attorney Stephen Aarons in direct contempt of court for submitting a brief with "false testimony from wholly fabricated witnesses," according to a court order filed Sept. 9. The court referred Aarons to a disciplinary board, finding that he "demonstrated a
[6]
Defense lawyer submitted bogus ChatGPT-generated testimony in murder appeal
A New Mexico defense lawyer used ChatGPT to help appeal a client's murder conviction -- submitting a brief with fake facts from made-up police testimony and witnesses. Stephen Aarons was held in contempt and fined $5,000 for using OpenAI's chatbot to create a brief that "contained false testimony
Share
Copy Link
Three years after the first court sanctions, AI-generated errors continue to plague the legal profession with 1,395 cases documented. Recent incidents include fabricated police testimony in a murder appeal and fake citations across multiple filings, prompting judges to impose harsher penalties and question why attorneys still fail to verify AI output.
The legal profession faces a mounting crisis as AI in legal filings continues to produce errors at an alarming rate. Despite three years of court sanctions since the first warning in 2023, at least 1,395 cases in US state and federal courts now contain AI hallucinations, according to researcher tracking data
1
. The problem has escalated beyond simple mistakes, with AI-generated errors now seeping into court opinions, expert testimony, and prosecutors' briefs.US District Judge P. Kevin Castel in Manhattan, who issued the profession's earliest warning in 2023, told Reuters that "as the problem continues without abatement, the need for sanctions that are a greater deterrent grows"
1
. Within just three days in September 2026, multiple incidents surfaced: a defense lawyer filed fabricated police testimony in a New Mexico murder case, an Oklahoma judge's order cited fake cases, and a State Farm lawyer in Los Angeles was fined for erroneous citations across seven filings.
Source: PYMNTS
The New Mexico Supreme Court held attorney Stephen Aarons in contempt and fined him $5,000 after discovering his appellate brief contained "false testimony from wholly fabricated witnesses" generated by ChatGPT
3
. Aarons was representing Oscar Renee Sandoval in a murder appeal when he submitted the brief containing fictional statements, including details that "the shooter was wearing dark pants and a white shirt."
Source: New York Post
Aarons admitted he used ChatGPT to summarize trial proceedings, assuming it would generate "a bulletproof summary"
3
. He claimed he did not understand the degree to which AI could hallucinate facts. The court found he "demonstrated a lack of remorse and a lack of concern for his client" and referred him to an attorney disciplinary board for investigation3
.Justice C. Shannon Bacon expressed incredulity at the hearing: "My 13-year-old nephew knows about hallucinations. My 75-year-old stepmother knows about hallucinations"
1
. She noted that the problem with lawyers relying on AI hallucinations is "an above-the-fold story every single day"3
.The 4th District Court of Appeal in Florida took a different approach, ordering attorney Jaclyn Soroka to explain why she should not be sanctioned for submitting what judges called "AI slop"
2
. Unlike cases involving AI-generated fake citations, this ruling focused on lengthy, unfocused filings containing "gibberish" that violated an attorney's duty to show independent professional judgment.Judge Robert Gross wrote that the submissions contained "frivolous, scattershot arguments" and noted "an AI supercomputer would struggle to find meaning in some of the prose used in this case"
2
. The panel warned that "abusive AI filing threatens the orderly administration of justice" and emphasized that courts must require more from attorneys.The penalties lawyers face for unchecked AI use in legal work vary significantly. Court sanctions range from formal rebukes to monetary penalties in the hundreds to tens of thousands of dollars
1
. In California, a lawyer representing State Farm was fined $999.99 after generative AI produced inaccurate citations and quotations1
. State Farm responded by stating it "expects all external counsel to adhere to the highest standards of professionalism and ethical conduct, including when using AI."Some judges have referred lawyers to state bar authorities to examine compliance with professional ethics rules. The escalating sanctions reflect judicial frustration that awareness of AI limitations has not translated into more vigilant behavior among the legal profession.
Related Stories
Mark McKenna, co-director of the UCLA Institute of Technology, Law & Policy, identified several factors contributing to AI-generated errors: competitive pressure among law firms to adopt AI, demands to deliver work quickly, and AI marketing that downplays risks
1
. "Lawyers keep making the judgment that the upside is better than the downside," McKenna explained.The ethical dilemmas of AI extend beyond individual mistakes. While lawyers generally are not prohibited from using AI, they remain ethically bound to ensure accuracy of court submissions. Judge Castel noted that scrutiny from judges and the adversarial legal system means AI errors are being exposed when they occur, calling it "a wonderful thing"
1
.AI errors in judicial rulings have raised particular alarms in high-stakes legal proceedings. After hallucinated material appeared in decisions by two federal judges last year, US Senator Chuck Grassley called on judges nationwide to "formalize measures to prevent the misuse of artificial intelligence in their chambers"
1
. In Oklahoma, a judge admitted to using an AI program for research that resulted in an order containing two citations to non-existent cases.The Florida appeals court emphasized that it ultimately does not matter whether filings are "AI-generated, AI-assisted, or something else" because attorneys must stand behind any court filings they submit
2
. This position underscores that professional judgment cannot be delegated to algorithms, regardless of how sophisticated the technology becomes.As the legal practice adapts to generative AI tools, the surge in documented cases suggests the profession has not yet found effective guardrails. Watch for increased regulatory action from state bars, potential changes to professional conduct rules, and growing judicial willingness to impose harsher penalties as deterrents against careless AI adoption in legal work.
Summarized by
Navi
09 Jun 2026•Policy and Regulation

09 Nov 2025•Policy and Regulation

19 Feb 2025•Technology
