New Tool Catches AI Hallucinations In Legal Briefs - Above the Law

"Whether any specific citation was generated by AI - indeed, whether any specific citation is even wrong as opposed to merely debatable - opposing counsel now has every incentive to scrutinize any citation out of the firm with a jeweler's loupe. After that article, BriefCatch founder Ross Guberman offered a sneak peek at RealityCheck, the company's new authority verification tool."

"Running it against the original brief from the October Gordon Rees story that the firm already acknowledged to contain hallucinations, the RealityCheck tool delivered exactly what you'd want as opposing counsel. Or, ideally, the senior partner reviewing your own brief before signing your name to a bunch of hallucinatory nonsense."

"Lawyers, ideally, painstakingly review every case in every filing. But, at this point, you can't even trust the Department of Justice to check its briefs, let alone your adversaries. RealityCheck isn't trying to replace the process of cite checking, but it is trying to provide a superpowered hallucination check for lawyers."

Law firm Gordon Rees faced multiple incidents involving AI-generated hallucinations in legal filings, including fabricated citations and unsupported references. These problems highlight broader risks of using AI tools like ChatGPT without proper verification in legal work. BriefCatch developed RealityCheck, an authority verification tool designed to catch hallucinations and citation errors before filings are submitted. The tool functions as an automated cite-checking mechanism that supplements traditional legal review processes. RealityCheck successfully identified hallucinations in Gordon Rees's October filing, demonstrating its effectiveness. As AI adoption in legal practice increases, such verification tools become essential safeguards to maintain professional standards and prevent reputational damage from erroneous filings.

Read at Above the Law