Judge kills entire case when both lawyers submit AI filings (gizmodo.com)

A Mississippi judge recently dismissed a court case and sanctioned both parties' lawyers for submitting filings filled with AI-generated inaccuracies. The dispute centered on unpaid legal fees claimed by lawyer Tom Withers against the city of Aberdeen. In an effort to bolster their legal arguments, both sides’ attorneys relied on large language models (LLMs) for research and drafting documents, but failed to verify the accuracy of the AI-generated content. This led to a bizarre situation where professional legal arguments were based on AI-fabricated facts. Judge Sharion Aycock took the unprecedented step of halting the proceedings and banning two lawyers from practicing before her court for two years. Additionally, all four lawyers incurred fines ranging from $1,000 to $3,500. This incident highlights a growing issue in the legal field, where the reliance on AI tools is increasingly resulting in "AI hallucinations" within court documents. Legal researcher Damien Charlotin has recorded nearly 1,600 instances of AI-generated citations in legal filings, underscoring the need for lawyers to tread carefully when incorporating AI technology in their work. This case serves as a cautionary tale for the AI/ML community, emphasizing the importance of rigorous verification in legal contexts.