AI Legal Research Tools Hallucinating

The Legal Engineer · Advanced ·⚖️ LegalTech & AI for Legal Professionals ·2y ago

Key Takeaways

Analyzes AI legal research tools hallucination rates using Stanford University research on Thomson Reuters and LexisNexis tools

Original Description

You will be shocked to hear that 33% of the time AI legal research tools offered by Thomson Reuters (WestLaw) and LexisNexis hallucinate. These new shocking stats come from research that Stanford University recently conducted. These figures wouldn't be astonishing with the number of AI research tools on the market, but these are just the figures of two of the most established law software companies. The controversial part of this study is that these companies specifically CaseText, Thomson Reuters, and LexisNexis are marketing their legaltech tools as "hallucinating free, and reducing hallucinations to nearly zero." I mean, who is going to check them on that or hold them accountable? It goes without saying that as an attorney or legal professional, you must always supervise and verify AI outputs. But, these stats are important for legal professionals to know how weak their assisting tools are, and we still have a long way to go in getting near-perfect legal tools or replacing lawyers.
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
The Legal Void: Why OHADA Has No Answer for Algorithmic Trading
OHADA's securities law lacks provisions for algorithmic trading, creating a legal void that needs to be addressed to accommodate modern trading practices
Medium · Machine Learning
📰
Swatch wants $170m from Samsung over copied watch faces
Swatch seeks $170m from Samsung for copying watch faces, highlighting the importance of intellectual property protection in the tech industry
The Next Web AI
📰
Sarah Wynn-Williams sues Meta over efforts to keep her quiet
Learn how a former Meta executive is fighting back against the company's efforts to silence her, highlighting the importance of whistleblower protection and free speech in the tech industry
The Next Web AI
📰
Change in Registered Office: Why Companies Must Update Their Official Address Properly
Companies must update their registered office address properly to maintain compliance with regulatory requirements, avoiding potential legal and financial consequences.
Medium · Startup
Up next
ICH Q10 Explained: What It Means for Your Pharma QMS
Software Connect
Watch →