India's Supreme Court has taken stern action after discovering a judge used fake AI-generated orders in a property dispute case. The junior judge in Andhra Pradesh cited four non-existent judgments that were later confirmed to be AI-generated. The top court called this a matter of institutional concern, stating fake AI-generated orders directly impact the integrity of the judicial process.

The judge admitted it was her first time using an AI tool and believed the citations were genuine. However, India's highest court disagreed, staying the lower court's order and calling the use of AI in judgments "misconduct" rather than just an error. This incident reflects growing challenges worldwide as courts grapple with AI's limitations, including its tendency to "hallucinate" and invent sources.

Similar AI-related judicial errors have occurred in the US and UK, highlighting a global concern. India's Supreme Court had already published a white paper on AI in the judiciary with best practices, emphasizing the need for human oversight. The court has now issued notices to the Attorney General, Solicitor General, and Bar Council of India to address these systemic issues.