AI-Generated Lawyer Avatar Sparks Controversy in New York Courtroom

Curated by THEOUTPOST

On Mon, 14 Apr, 4:01 PM UTC

2 Sources

Share

A 74-year-old plaintiff's attempt to use an AI-generated lawyer avatar in a New York courtroom backfires, raising questions about the use of artificial intelligence in legal proceedings.

AI-Generated Lawyer Causes Stir in New York Courtroom

In a surprising turn of events, a New York courtroom became the stage for an unprecedented clash between artificial intelligence and legal tradition. Jerome Dewald, a 74-year-old plaintiff, attempted to use an AI-generated lawyer avatar during his court appearance, catching the judge and court officials off guard 12.

The Controversial Presentation

Dewald, who was representing himself in an employment dispute with insurance company MassMutual Metro, had received permission from the court to play a video presentation. However, he failed to disclose that the video would feature an AI-generated avatar named James 1. As the video began playing, the well-groomed, sweater-wearing AI avatar addressed the court:

"Now may it please the court, I come here today a humble pro se before a panel of five distinguished justices" 2.

Judge's Swift Intervention

Associate Justice Sallie Manzanet-Daniels quickly intervened, expressing confusion and displeasure upon realizing that the "lawyer" was not a real person 12. The judge chastised Dewald for not disclosing the nature of his presentation beforehand, stating:

"It would have been nice to know that when you made your application. You did not tell me that, sir" 1.

Dewald's Explanation and Intentions

Dewald, who operates a startup called Pro Se Pro, claimed that his intention was not to promote his business but to use the avatar as an aid during the proceedings 1. He cited a previous bout with throat cancer as the reason for needing assistance with extended speaking 2. However, the judge was unconvinced, noting that Dewald had already engaged in verbal conversations with court staff for over 30 minutes 2.

AI in the Courtroom: A Growing Concern

This incident highlights the growing debate surrounding the use of AI in legal settings. Recent controversies have emerged involving lawyers using AI tools like ChatGPT without realizing the potential for generating fictional case law 2. Dewald himself acknowledged the skepticism towards AI in courtrooms, mentioning concerns about "hallucinations" and false information 1.

Aftermath and Apology

Following the incident, Dewald wrote a letter of apology to the court 1. He explained to The Register that while he had initially planned to use an AI-generated avatar of himself, technical difficulties led him to use a stock avatar from a company called Tavus 12.

Implications for Future Legal Proceedings

This case raises important questions about the role of AI in legal proceedings and the need for clear guidelines on its use in courtrooms. As AI technology continues to advance, the legal system will likely face more challenges in balancing innovation with traditional court practices and ensuring the integrity of legal proceedings.

Continue Reading
AI Avatar's Court Appearance Sparks Controversy and

AI Avatar's Court Appearance Sparks Controversy and Judicial Rebuke

An AI entrepreneur's attempt to use an AI-generated avatar for legal representation in a New York court backfires, raising questions about the role of AI in legal proceedings and the boundaries of courtroom technology.

The Verge logotheregister.com logoAP NEWS logoGizmodo logo

15 Sources

The Verge logotheregister.com logoAP NEWS logoGizmodo logo

15 Sources

AI Hallucinations in Legal Filings: Morgan & Morgan Warns

AI Hallucinations in Legal Filings: Morgan & Morgan Warns Lawyers of Consequences

Morgan & Morgan, a major US law firm, warns its attorneys about the risks of using AI-generated content in court filings after a case involving fake citations. The incident highlights growing concerns about AI use in the legal profession.

Ars Technica logoU.S. News & World Report logoMarket Screener logoEconomic Times logo

9 Sources

Ars Technica logoU.S. News & World Report logoMarket Screener logoEconomic Times logo

9 Sources

Arizona Supreme Court Pioneers AI Avatars for Public

Arizona Supreme Court Pioneers AI Avatars for Public Communication

The Arizona Supreme Court introduces AI-generated avatars, Victoria and Daniel, to deliver news about court rulings, aiming to improve public understanding and trust in the judicial system.

AP NEWS logoFast Company logoABC News logoThe Seattle Times logo

8 Sources

AP NEWS logoFast Company logoABC News logoThe Seattle Times logo

8 Sources

Stanford Professor Accused of Citing AI-Generated Studies

Stanford Professor Accused of Citing AI-Generated Studies in Deepfake Legislation Testimony

Stanford professor Jeff Hancock faces allegations of citing non-existent, potentially AI-generated studies in his expert testimony supporting Minnesota's proposed deepfake legislation, raising questions about AI's impact on legal proceedings and academic integrity.

Dataconomy logoPC Magazine logoGizmodo logoTechSpot logo

6 Sources

Dataconomy logoPC Magazine logoGizmodo logoTechSpot logo

6 Sources

Misinformation Expert's Affidavit Compromised by

Misinformation Expert's Affidavit Compromised by ChatGPT-Generated False Citations

Stanford professor Jeff Hancock admits to using ChatGPT for organizing citations in a legal document supporting Minnesota's anti-deepfake law, leading to AI-generated false information in the affidavit.

Benzinga logoWccftech logo

2 Sources

Benzinga logoWccftech logo

2 Sources

TheOutpost.ai

Your one-stop AI hub

The Outpost is a comprehensive collection of curated artificial intelligence software tools that cater to the needs of small business owners, bloggers, artists, musicians, entrepreneurs, marketers, writers, and researchers.

© 2025 TheOutpost.AI All rights reserved