Home Latest Supreme Court flags rising threat of AI-generated fake judgments, urges caution

Supreme Court flags rising threat of AI-generated fake judgments, urges caution

New Delhi: The Supreme Court of India has expressed concern over the growing use of AI-generated fake judgments in court proceedings, warning that the issue poses a serious challenge to the justice system.

A bench of Justices Rajesh Bindal and Vijay Bishnoi said the threat is no longer limited to India but has become a global concern. “Everyone needs to remain cautious about this,” the bench observed.

The remarks came during the hearing of a special leave petition filed by a director of Heart and Soul Entertainment Limited, seeking removal of certain observations made by the Bombay High Court.

The High Court had earlier noted that the petitioner relied on a judgment generated using ChatGPT, which did not exist. Despite efforts, the court and its registry were unable to trace the cited ruling.

The Bombay High Court had imposed a fine of ₹50,000 on the petitioner, directing the amount to be deposited in the Bombay High Court Employees Medical Fund. It had also warned against presenting non-existent material and unnecessary documents, stating that such practices delay justice and will attract strict action, including proceedings through the Bar Council if lawyers are involved.

While the Supreme Court removed certain remarks from the High Court order, it emphasised that misuse of AI-generated content is a serious and emerging issue across jurisdictions.

The court also noted similar instances in trial courts, including a case in Andhra Pradesh where fake AI-generated judgments were submitted. Earlier this month, the apex court had issued notices to the Attorney General, Solicitor General and the Bar Council of India to explore measures to address the issue.

Separately, the court had also flagged concerns over the misuse of AI in matrimonial disputes, where fabricated evidence is increasingly being used to level false allegations.