{"id":153287,"date":"2026-05-29T15:28:17","date_gmt":"2026-05-29T23:28:17","guid":{"rendered":"https:\/\/xira.com\/p\/2026\/05\/29\/back-to-basics\/"},"modified":"2026-05-29T15:28:17","modified_gmt":"2026-05-29T23:28:17","slug":"back-to-basics","status":"publish","type":"post","link":"https:\/\/xira.com\/p\/2026\/05\/29\/back-to-basics\/","title":{"rendered":"Back To Basics"},"content":{"rendered":"
\"\"
<\/figcaption><\/figure>\n

Something jumped out at me early at the recent LegalTech Connect Law Firm Research & Innovation Conference<\/a> with the legal research community.\u00a0Greg Lambert<\/a> asked how many attendees have encountered partners who don\u2019t know their Westlaw or Lexis passwords.\u00a0That question resonated throughout the room as most had experienced this.\u00a0<\/p>\n

It\u2019s general knowledge that partners rarely conduct legal research, but if they don\u2019t know how to log in to a legal research platform, what process are firms using for partners to access the underlying sources in a brief?\u00a0\u00a0<\/p>\n

Over the past year, we\u2019ve seen a steady stream of headlines about AI hallucinations where fake cases, fabricated quotes, and misstated facts made it through a review process and into court filings.<\/p>\n

Technology Isn\u2019t The Issue; It\u2019s A Process Problem<\/strong><\/p>\n

While lawyers are responsible for their work, there is a tendency to blame the breakdown on the introduction of AI technology into the process.\u00a0I think a better explanation is that AI exposed a flaw that already existed in most processes.<\/p>\n

For decades, law firm drafting was built on partner guidance and associate writing, with a senior associate taking a pass and then the partner reviewing in a supervisory role. Citation tools such as Shepard\u2019s or KeyCite are used by the associate along the way. But in practice, how, what, and when does the supervising attorney review the work?\u00a0<\/p>\n

If a case was reviewed earlier in the process, is it checked again at the end of the process, including the quotation pulled from the case?\u00a0<\/p>\n

Before AI, a mistake that squeaked through a gap in the process didn\u2019t matter as much because potential errors were minor and could be corrected as errata if necessary. But that doesn\u2019t work anymore. Human authorship is being augmented by AI-generated content and editing that can alter facts, fabricate quotes, and invent citations to nonexistent cases.\u00a0<\/p>\n

AI Exposes The Gaps That Were Always There<\/strong><\/p>\n

Anyone who uses AI grammar-checking software or Microsoft Copilot on a regular basis has had the experience of \u201cuncorrecting\u201d its revisions that are more grammatically correct but also change the meaning of a statement. Associates are still learning and may miss subtle errors introduced by these powerful new tools.<\/p>\n

What was correct at an earlier stage of a document may very well be changed by AI in a later version.\u00a0<\/p>\n

Errata Versus Fabrication<\/strong><\/p>\n

The central issue here is that an AI hallucination is a fabrication. Fake cases are one issue, but more recent issues in filings include fake quotations<\/a>.\u00a0 A complete review of everything, including foundational facts, needs to be conducted at the end of the process before filing.\u00a0\u00a0<\/p>\n

The tried-and-true workflows that once assumed human authorship must change.\u00a0<\/p>\n

Drafting And Review Should Be Inseparable<\/strong><\/p>\n

Remember your high school science class? There are protons, neutrons, and electrons within an atom, but the atom itself cannot be separated. AI highlights this in document creation.\u00a0 The drafting and review processes are atomic.\u00a0 They can\u2019t be separated without some kind of nuclear reaction.\u00a0\u00a0<\/p>\n

AI creates efficiencies in drafting, but it imposes new burdens on the review process and highlights assumptions about who reviews what and when.\u00a0<\/p>\n

The process now needs to track who verifies citations, when verification occurs, and how it is communicated across the team drafting and reviewing the document.\u00a0 The same should happen for quotations and fact-checking.\u00a0\u00a0<\/p>\n

Zero Trust principles<\/strong><\/p>\n

In Cybersecurity, there is a concept called Zero Trust.\u00a0 It\u2019s basically \u201cnever trust, always verify\u201d.\u00a0 Unfortunately, AI systems are probabilistic.\u00a0 They are literally guessing the next part of a word that fits a pattern. This means that hallucinations are a feature of the system\u2019s design rather than a bug. There are techniques to minimize hallucinations<\/a>, but they can\u2019t be eliminated.\u00a0<\/p>\n

\u201cBack to Basics\u201d review processes<\/strong><\/p>\n

The consequences of AI incorporated into drafting are that errors can become fabrications that are well beyond the scope of errata.<\/p>\n

Before the Internet, it was common to print out all authorities and keep them in binders for access and review. \u00a0 But the digital equivalent to that physical binder has been lost in some firms.\u00a0<\/p>\n

There are solutions available to help organize and improve processes. Creating hyperlinks within documents to a repository of referenced authoritative sources can help expedite review. If a link doesn\u2019t exist to a case, then it\u2019s a red flag that it may not exist. Clicking on a link can help review and verify that quotes or facts are correct, too.<\/p>\n

Firms should take action now<\/strong><\/p>\n

AI Policy is not a process.\u00a0 Firms need to operationalize how attorneys can comply with the policy and provide the processes and tools needed to make it easier to meet the standards of Rule 11 Ethical responsibility.\u00a0<\/p>\n

The California Bar recently solicited comments<\/a> on changes to the rules of professional conduct as they pertain to AI.\u00a0 And there is some discussion proposing an actual Hyperlink Rule<\/a> to ensure sources are linked in filings.\u00a0 Firms shouldn\u2019t wait for regulators to tell them what to do.\u00a0<\/p>\n

Conclusion<\/strong><\/p>\n

AI may have introduced gross fabrication into legal work, but it also removed the illusion that review processes were ever airtight.<\/p>\n

There are more advanced solutions possible, including some I have suggested <\/a>in prior writings on hallucinations. But before the industry considers more advanced solutions, it should ensure it addresses the basics first.\u00a0<\/p>\n

The firms that recognize and rebuild their review processes and tightly couple them to the drafting process will be in a much better position than those that treat this as a problem caused by technology or a problem to be solved with policy alone.<\/p>\n

AI was used in the review of this article.<\/em><\/p>\n

\n

Ken Crutchfield has over forty years of experience in legal, tax, and other industries. Throughout his career, he has focused on growth, innovation, and business transformation.\u00a0His consulting practice advises investors, legal tech startups and others. As a strategic thinker who understands markets and creating products to meet customer needs, he has worked in start-ups and large enterprises. He has served in General Management capacities in six businesses. Ken has a pulse on the trends affecting the market. Whether it was the Internet in the 1980s or Generative AI, he understands technology and how it can impact business. Crutchfield started his career as an intern with LexisNexis and has worked at Thomson Reuters, Bloomberg, Dun & Bradstreet, and Wolters Kluwer. Ken has an MBA and holds a B.S. in Electrical Engineering from The Ohio State University.<\/em><\/strong><\/p>\n

The post Back To Basics<\/a> appeared first on Above the Law<\/a>.<\/p>\n

\"\"
<\/figcaption><\/figure>\n

Something jumped out at me early at the recent LegalTech Connect Law Firm Research & Innovation Conference<\/a> with the legal research community.\u00a0Greg Lambert<\/a> asked how many attendees have encountered partners who don\u2019t know their Westlaw or Lexis passwords.\u00a0That question resonated throughout the room as most had experienced this.\u00a0<\/p>\n

It\u2019s general knowledge that partners rarely conduct legal research, but if they don\u2019t know how to log in to a legal research platform, what process are firms using for partners to access the underlying sources in a brief?\u00a0\u00a0<\/p>\n

Over the past year, we\u2019ve seen a steady stream of headlines about AI hallucinations where fake cases, fabricated quotes, and misstated facts made it through a review process and into court filings.<\/p>\n

Technology Isn\u2019t The Issue; It\u2019s A Process Problem<\/strong><\/p>\n

While lawyers are responsible for their work, there is a tendency to blame the breakdown on the introduction of AI technology into the process.\u00a0I think a better explanation is that AI exposed a flaw that already existed in most processes.<\/p>\n

For decades, law firm drafting was built on partner guidance and associate writing, with a senior associate taking a pass and then the partner reviewing in a supervisory role. Citation tools such as Shepard\u2019s or KeyCite are used by the associate along the way. But in practice, how, what, and when does the supervising attorney review the work?\u00a0<\/p>\n

If a case was reviewed earlier in the process, is it checked again at the end of the process, including the quotation pulled from the case?\u00a0<\/p>\n

Before AI, a mistake that squeaked through a gap in the process didn\u2019t matter as much because potential errors were minor and could be corrected as errata if necessary. But that doesn\u2019t work anymore. Human authorship is being augmented by AI-generated content and editing that can alter facts, fabricate quotes, and invent citations to nonexistent cases.\u00a0<\/p>\n

AI Exposes The Gaps That Were Always There<\/strong><\/p>\n

Anyone who uses AI grammar-checking software or Microsoft Copilot on a regular basis has had the experience of \u201cuncorrecting\u201d its revisions that are more grammatically correct but also change the meaning of a statement. Associates are still learning and may miss subtle errors introduced by these powerful new tools.<\/p>\n

What was correct at an earlier stage of a document may very well be changed by AI in a later version.\u00a0<\/p>\n

Errata Versus Fabrication<\/strong><\/p>\n

The central issue here is that an AI hallucination is a fabrication. Fake cases are one issue, but more recent issues in filings include fake quotations<\/a>.\u00a0 A complete review of everything, including foundational facts, needs to be conducted at the end of the process before filing.\u00a0\u00a0<\/p>\n

The tried-and-true workflows that once assumed human authorship must change.\u00a0<\/p>\n

Drafting And Review Should Be Inseparable<\/strong><\/p>\n

Remember your high school science class? There are protons, neutrons, and electrons within an atom, but the atom itself cannot be separated. AI highlights this in document creation.\u00a0 The drafting and review processes are atomic.\u00a0 They can\u2019t be separated without some kind of nuclear reaction.\u00a0\u00a0<\/p>\n

AI creates efficiencies in drafting, but it imposes new burdens on the review process and highlights assumptions about who reviews what and when.\u00a0<\/p>\n

The process now needs to track who verifies citations, when verification occurs, and how it is communicated across the team drafting and reviewing the document.\u00a0 The same should happen for quotations and fact-checking.\u00a0\u00a0<\/p>\n

Zero Trust principles<\/strong><\/p>\n

In Cybersecurity, there is a concept called Zero Trust.\u00a0 It\u2019s basically \u201cnever trust, always verify\u201d.\u00a0 Unfortunately, AI systems are probabilistic.\u00a0 They are literally guessing the next part of a word that fits a pattern. This means that hallucinations are a feature of the system\u2019s design rather than a bug. There are techniques to minimize hallucinations<\/a>, but they can\u2019t be eliminated.\u00a0<\/p>\n

\u201cBack to Basics\u201d review processes<\/strong><\/p>\n

The consequences of AI incorporated into drafting are that errors can become fabrications that are well beyond the scope of errata.<\/p>\n

Before the Internet, it was common to print out all authorities and keep them in binders for access and review. \u00a0 But the digital equivalent to that physical binder has been lost in some firms.\u00a0<\/p>\n

There are solutions available to help organize and improve processes. Creating hyperlinks within documents to a repository of referenced authoritative sources can help expedite review. If a link doesn\u2019t exist to a case, then it\u2019s a red flag that it may not exist. Clicking on a link can help review and verify that quotes or facts are correct, too.<\/p>\n

Firms should take action now<\/strong><\/p>\n

AI Policy is not a process.\u00a0 Firms need to operationalize how attorneys can comply with the policy and provide the processes and tools needed to make it easier to meet the standards of Rule 11 Ethical responsibility.\u00a0<\/p>\n

The California Bar recently solicited comments<\/a> on changes to the rules of professional conduct as they pertain to AI.\u00a0 And there is some discussion proposing an actual Hyperlink Rule<\/a> to ensure sources are linked in filings.\u00a0 Firms shouldn\u2019t wait for regulators to tell them what to do.\u00a0<\/p>\n

Conclusion<\/strong><\/p>\n

AI may have introduced gross fabrication into legal work, but it also removed the illusion that review processes were ever airtight.<\/p>\n

There are more advanced solutions possible, including some I have suggested <\/a>in prior writings on hallucinations. But before the industry considers more advanced solutions, it should ensure it addresses the basics first.\u00a0<\/p>\n

The firms that recognize and rebuild their review processes and tightly couple them to the drafting process will be in a much better position than those that treat this as a problem caused by technology or a problem to be solved with policy alone.<\/p>\n

AI was used in the review of this article.<\/em><\/p>\n

\n

Ken Crutchfield has over forty years of experience in legal, tax, and other industries. Throughout his career, he has focused on growth, innovation, and business transformation.\u00a0His consulting practice advises investors, legal tech startups and others. As a strategic thinker who understands markets and creating products to meet customer needs, he has worked in start-ups and large enterprises. He has served in General Management capacities in six businesses. Ken has a pulse on the trends affecting the market. Whether it was the Internet in the 1980s or Generative AI, he understands technology and how it can impact business. Crutchfield started his career as an intern with LexisNexis and has worked at Thomson Reuters, Bloomberg, Dun & Bradstreet, and Wolters Kluwer. Ken has an MBA and holds a B.S. in Electrical Engineering from The Ohio State University.<\/em><\/strong><\/p>\n

The post Back To Basics<\/a> appeared first on Above the Law<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

Something jumped out at me early at the recent LegalTech Connect Law Firm Research & Innovation Conference with the legal research community.\u00a0Greg Lambert asked how many attendees have encountered partners who don\u2019t know their Westlaw or Lexis passwords.\u00a0That question resonated throughout the room as most had experienced this.\u00a0 It\u2019s general knowledge that partners rarely conduct […]<\/p>\n","protected":false},"author":3,"featured_media":153288,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[16],"tags":[],"class_list":["post-153287","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-above_the_law"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/xira.com\/p\/wp-content\/uploads\/2026\/05\/GettyImages-186475526-L1XJod.jpg?fit=511%2C335&ssl=1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/153287","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/comments?post=153287"}],"version-history":[{"count":0,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/153287\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/media\/153288"}],"wp:attachment":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/media?parent=153287"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/categories?post=153287"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/tags?post=153287"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}