Supreme Court declares citing AI-generated fake verdicts as misconduct with legal consequences

3 Sources

Share

India's Supreme Court has escalated AI hallucinations from technical errors to misconduct after a judge cited four fake AI-generated judgments in a property dispute. The ruling marks the first time the apex court has declared that using fabricated case laws warrants disciplinary action and legal consequences, not merely correction.

Supreme Court Takes Strict Stance on Fake AI-Generated Legal Judgments

India's Supreme Court has declared that judges citing AI-generated fake case laws commit misconduct that warrants legal consequences, marking a significant escalation in how the country's legal institutions address AI use in the judiciary

3

. A bench of Justices P S Narasimha and Alok Aradhe stated on February 27 that "a decision based on such non-existent and fake alleged judgments is not an error in the decision making. It would be a misconduct and legal consequence shall follow"

2

. The court has issued notices to the Attorney General, Solicitor General, and the Bar Council of India, while appointing senior advocate Shyam Divan to assist in examining the matter

2

.

Source: MediaNama

Source: MediaNama

Trial Court in Andhra Pradesh Triggers Institutional Concern

The controversy centers on an August 2024 order by a junior civil judge in Vijaywada city, Andhra Pradesh, who dismissed objections in a property dispute by citing four past legal judgments—all later found to be AI-generated

1

. The trial court had appointed an advocate-commissioner to survey disputed property, and when defendants objected to the report, the judge relied on fabricated precedents to reject their concerns

1

. When defendants challenged the order in the state's high court, pointing out the fake citations, the high court acknowledged the error but accepted it was made in "good faith" and upheld the decision anyway

1

. The high court reasoned that "the citations may be non-existent, but if the learned trial court has considered the correct principles of law and its application to the facts of the case is also correct, mere mentioning of incorrect or non-existent rulings/citations in the order cannot be a ground to set aside the order"

1

.

Supreme Court Emphasizes Integrity of the Judicial Process

The Supreme Court found this approach inadequate and stayed the lower court's order, declaring the case a matter of "institutional concern" because it directly affects the integrity of the adjudicatory process

1

. The court noted that "this case assumes considerable institutional concern, not because of the decision that was taken on the merits of the case, but about the process of adjudication and determination"

3

. By labeling citing AI-generated fake case laws as misconduct rather than an error, the apex court has significantly escalated consequences and signaled that accountability of deploying AI tools in legal settings will be scrutinized

3

. The matter is scheduled for detailed hearing on March 10, with the court directing that the trial court shall not proceed based on the advocate-commissioner's report pending disposal

2

.

Source: ET

Source: ET

Growing Pattern of AI Hallucinations in Indian Courts

This Andhra Pradesh case represents the latest in a troubling series of incidents where AI hallucinations have disrupted court proceedings across India. In December 2024, the Bengaluru bench of the Income Tax Appellate Tribunal issued an order in the Buckeye Trust case citing three Supreme Court judgments and one Madras High Court ruling—none of which existed—in a Rs 669 crore trust taxation dispute

3

. The tribunal recalled the order within a week after sources indicated the tax department's representative had used ChatGPT without verification

3

. In October 2024, the Bombay High Court quashed a Rs 27.91 crore income tax assessment after discovering that the National Faceless Assessment Centre had relied on three non-existent judicial decisions

3

. The junior judge in the current case told the court this was her first time using an AI tool and she believed the citations to be "genuine," stating that "the mistake occurred solely due to the reliance on an automatic source"

1

.

Legal Consequences Differ for Judges and Lawyers

The Supreme Court's declaration that fake AI-generated verdicts constitute misconduct carries substantially different penalties depending on whether judges or lawyers are involved. For judges, misconduct can trigger removal under Article 124(4) of the Constitution, but Parliament can remove judges only through impeachment requiring a majority of both Houses—a bar so high that no judge has been successfully impeached in India's 75-year constitutional history

3

. Alternatively, the Chief Justice can advise judges to resign voluntarily, retire, or stop assigning them judicial work

3

. For lawyers, however, the Bar Council of India's Disciplinary Committee can impose more immediate disciplinary actions including reprimand, suspension from practice for a specified period, or removal from the roll, with a suspended advocate losing the right to practice in any court across India

3

.

Regulating AI Use Remains Challenge for Legal Institutions

The ruling comes three months after the Supreme Court's Centre for Research and Planning released a White Paper on Artificial Intelligence and the Judiciary in November 2024, which outlined principles for AI use in the judiciary but did not establish binding accountability frameworks

3

. The document explicitly warned about AI hallucinations, where generative systems fabricate facts or court citations that appear legally credible but are false

3

. The White Paper stressed the need for human oversight and the importance of keeping institutional safeguards "firmly in place"

1

. In another case last month, the Supreme Court raised concerns over the trend of lawyers using AI tools to draft petitions, with legal news website LiveLaw quoting the court as saying "it is absolutely uncalled for"

1

. On February 17, a bench headed by Chief Justice Surya Kant expressed serious concern over lawyers filing petitions drafted with AI tools containing non-existent judgments such as "Mercy vs Mankind"

2

. India's legal institutions are grappling alongside others worldwide with regulating AI use—in October 2024, two federal judges in the US were called out for AI tool errors in their rulings, while in June 2024, the High Court of England and Wales warned lawyers not to use AI-generated case material after a series of cases cited fictitious rulings

1

.

Today's Top Stories

TheOutpost.ai

Your Daily Dose of Curated AI News

Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.

© 2026 Triveous Technologies Private Limited
Instagram logo
LinkedIn logo