{"id":120813,"date":"2025-05-29T10:03:32","date_gmt":"2025-05-29T18:03:32","guid":{"rendered":"https:\/\/xira.com\/p\/2025\/05\/29\/the-real-error-is-human-ai-cant-cure-carelessness\/"},"modified":"2025-05-29T10:03:32","modified_gmt":"2025-05-29T18:03:32","slug":"the-real-error-is-human-ai-cant-cure-carelessness","status":"publish","type":"post","link":"https:\/\/xira.com\/p\/2025\/05\/29\/the-real-error-is-human-ai-cant-cure-carelessness\/","title":{"rendered":"The Real Error Is Human: AI Can\u2019t Cure Carelessness"},"content":{"rendered":"
\"\"
<\/figcaption><\/figure>\n

How many fake cases does it take before we stop blaming the tool and start blaming the lawyer? It seems as if not a day goes by without another false case citation making headlines. In courtrooms across the world, judges are grappling<\/a> with a deluge of error-ridden filings. Lawyers in firms big and small are making these mistakes, resulting in harshly worded judicial orders, stern reprimands, and even sanctions.<\/p>\n

Some claim it\u2019s a technology problem, asserting that generative artificial intelligence (AI) tools are providing errors, resulting in false case citations. While it\u2019s true that generative AI is prone to including incorrect output, that\u2019s not the reason the fake cases end up in court filings. Instead, the fault lies with legal practitioners.<\/p>\n

This technology is revealing the ugly underbelly of legal practice: Lawyers have been overwhelmed by client and billable hour demands for many years, and, as a result, have taken shortcuts resulting in carelessly prepared work product. Before the advent of AI, judges gave attorneys the benefit of the doubt, assuming that they\u2019d misread the case or failed to check a case citation, resulting in misspellings or transposed digits.<\/p>\n

But when faced with fictional case names, citations, and quotes, the conclusion is inescapable: some lawyers simply don\u2019t read the documents prepared for them \u2014 whether by AI or another person \u2014 before filing them with the court. This irrefutable and unacceptable situation is leading many judges to be justifiably upset.<\/p>\n

You need look no further than the standing order<\/a> issued earlier this month by United States Magistrate Judge for the Northern District of Texas, Dallas Division David L. Horan. At the outset, Horan made it clear that the order was directed at both attorneys and pro se litigants, both of whom \u201care beginning to make the jump from \u2026 (legal research) databases into the world of Artificial Intelligence.\u201d<\/p>\n

He explained that the court did not oppose the use of AI to draft filings, and instead acknowledged that when \u201cdone right, AI can be incredibly beneficial for attorneys and the public.\u201d<\/p>\n

However, generative AI output combined with carelessness is significantly hampering the administration of justice: \u201cWhile one party can create a fake legal brief at the click of a button, the opposing party and court must parse through the case names, citations, and points of law to determine which parts, if any, are true. As AI continues to proliferate, this creation-response imbalance places significant strain on the judicial system.\u201d<\/p>\n

The judge was clear: careless practitioners are the problem, not the technology. While AI can provide false output, the burden is on the litigant to review the document for accuracy: \u201c(A)n attorney [or pro se party] who submits fake cases clearly has not read those nonexistent cases \u2026 It is one thing to use AI to assist with initial research \u2026 It is an entirely different thing, however, to rely on the output of a generative AI program without verifying the current treatment or validity \u2014 or, indeed, the very existence \u2014 of the case presented.\u201d<\/p>\n

In other words, due diligence is required before filing a submission with the court. This includes reading and verifying the content and all cases referenced therein. Horan explained that doing so is the bare minimum: \u201cConfirming a case is good law is a basic, routine matter and something to be expected from a practicing attorney.\u201d<\/p>\n

That\u2019s why verifications are required on all documents filed with the court: \u201cBy presenting to the court a pleading, written motion, or other paper \u2014 whether by signing, filing, submitting, or later advocating it \u2014 an attorney or unrepresented party certifies that to the best of the person\u2019s knowledge, information, and belief, formed after an inquiry reasonable under the circumstances \u2026 the claims, defenses, and other legal contentions are warranted by existing law.\u201d<\/p>\n

When litigants submit filings that are rife with errors and non-existent caselaw, the blame lies with them, not the technology. That failing is inexcusable and leads to a waste of court resources: \u201cThat the AI-generated excerpts appeared valid to an attorney or pro se participant does not relieve him of his duty to conduct a reasonable inquiry into the law \u2026 An attempt to persuade a court or oppose an adversary by relying on fake opinions is an abuse of the adversary system.\u201d<\/p>\n

Put simply, the solution to false citations isn\u2019t better technology; it\u2019s better lawyering. Generative AI is a great resource, but it can\u2019t replace professional judgment or due diligence. As courts grow less tolerant of these missteps, the message is clear: You can\u2019t outsource responsibility. If you sign it, you own it.<\/p>\n

Or, as Judge Horan aptly concluded: \u201cThe use of artificial intelligence must be accompanied by the application of actual intelligence in its execution.\u201d<\/p>\n

\n

Nicole Black<\/em><\/strong><\/a> is a Rochester, New York attorney and Principal Legal Insight Strategist at\u00a0AffiniPay<\/a>, parent company of MyCase, LawPay, CASEpeer, and Docketwise. She\u2019s been <\/strong><\/em>blogging<\/em><\/strong><\/a> since 2005, has written a <\/strong><\/em>weekly column<\/em><\/strong><\/a> for the Daily Record since 2007, is the author of <\/strong><\/em>Cloud Computing for Lawyers<\/em><\/strong><\/a>, co-authors <\/strong><\/em>Social Media for Lawyers: the Next Frontier<\/em><\/strong><\/a>, and co-authors <\/strong><\/em>Criminal Law in New York<\/em><\/strong><\/a>. She\u2019s easily distracted by the potential of bright and shiny tech gadgets, along with good food and wine. You can follow her on Twitter at <\/strong><\/em>@nikiblack<\/em><\/strong><\/a> and she can be reached at <\/strong><\/em>niki.black@mycase.com<\/em><\/strong><\/a>.<\/strong><\/em><\/p>\n

The post The Real Error Is Human: AI Can\u2019t Cure Carelessness<\/a> appeared first on Above the Law<\/a>.<\/p>\n

\"\"
<\/figcaption><\/figure>\n

How many fake cases does it take before we stop blaming the tool and start blaming the lawyer? It seems as if not a day goes by without another false case citation making headlines. In courtrooms across the world, judges are grappling<\/a> with a deluge of error-ridden filings. Lawyers in firms big and small are making these mistakes, resulting in harshly worded judicial orders, stern reprimands, and even sanctions.<\/p>\n

Some claim it\u2019s a technology problem, asserting that generative artificial intelligence (AI) tools are providing errors, resulting in false case citations. While it\u2019s true that generative AI is prone to including incorrect output, that\u2019s not the reason the fake cases end up in court filings. Instead, the fault lies with legal practitioners.<\/p>\n

This technology is revealing the ugly underbelly of legal practice: Lawyers have been overwhelmed by client and billable hour demands for many years, and, as a result, have taken shortcuts resulting in carelessly prepared work product. Before the advent of AI, judges gave attorneys the benefit of the doubt, assuming that they\u2019d misread the case or failed to check a case citation, resulting in misspellings or transposed digits.<\/p>\n

But when faced with fictional case names, citations, and quotes, the conclusion is inescapable: some lawyers simply don\u2019t read the documents prepared for them \u2014 whether by AI or another person \u2014 before filing them with the court. This irrefutable and unacceptable situation is leading many judges to be justifiably upset.<\/p>\n

You need look no further than the standing order<\/a> issued earlier this month by United States Magistrate Judge for the Northern District of Texas, Dallas Division David L. Horan. At the outset, Horan made it clear that the order was directed at both attorneys and pro se litigants, both of whom \u201care beginning to make the jump from \u2026 (legal research) databases into the world of Artificial Intelligence.\u201d<\/p>\n

He explained that the court did not oppose the use of AI to draft filings, and instead acknowledged that when \u201cdone right, AI can be incredibly beneficial for attorneys and the public.\u201d<\/p>\n

However, generative AI output combined with carelessness is significantly hampering the administration of justice: \u201cWhile one party can create a fake legal brief at the click of a button, the opposing party and court must parse through the case names, citations, and points of law to determine which parts, if any, are true. As AI continues to proliferate, this creation-response imbalance places significant strain on the judicial system.\u201d<\/p>\n

The judge was clear: careless practitioners are the problem, not the technology. While AI can provide false output, the burden is on the litigant to review the document for accuracy: \u201c(A)n attorney [or pro se party] who submits fake cases clearly has not read those nonexistent cases \u2026 It is one thing to use AI to assist with initial research \u2026 It is an entirely different thing, however, to rely on the output of a generative AI program without verifying the current treatment or validity \u2014 or, indeed, the very existence \u2014 of the case presented.\u201d<\/p>\n

In other words, due diligence is required before filing a submission with the court. This includes reading and verifying the content and all cases referenced therein. Horan explained that doing so is the bare minimum: \u201cConfirming a case is good law is a basic, routine matter and something to be expected from a practicing attorney.\u201d<\/p>\n

That\u2019s why verifications are required on all documents filed with the court: \u201cBy presenting to the court a pleading, written motion, or other paper \u2014 whether by signing, filing, submitting, or later advocating it \u2014 an attorney or unrepresented party certifies that to the best of the person\u2019s knowledge, information, and belief, formed after an inquiry reasonable under the circumstances \u2026 the claims, defenses, and other legal contentions are warranted by existing law.\u201d<\/p>\n

When litigants submit filings that are rife with errors and non-existent caselaw, the blame lies with them, not the technology. That failing is inexcusable and leads to a waste of court resources: \u201cThat the AI-generated excerpts appeared valid to an attorney or pro se participant does not relieve him of his duty to conduct a reasonable inquiry into the law \u2026 An attempt to persuade a court or oppose an adversary by relying on fake opinions is an abuse of the adversary system.\u201d<\/p>\n

Put simply, the solution to false citations isn\u2019t better technology; it\u2019s better lawyering. Generative AI is a great resource, but it can\u2019t replace professional judgment or due diligence. As courts grow less tolerant of these missteps, the message is clear: You can\u2019t outsource responsibility. If you sign it, you own it.<\/p>\n

Or, as Judge Horan aptly concluded: \u201cThe use of artificial intelligence must be accompanied by the application of actual intelligence in its execution.\u201d<\/p>\n

\n

Nicole Black<\/em><\/strong><\/a> is a Rochester, New York attorney and Principal Legal Insight Strategist at\u00a0AffiniPay<\/a>, parent company of MyCase, LawPay, CASEpeer, and Docketwise. She\u2019s been <\/strong><\/em>blogging<\/em><\/strong><\/a> since 2005, has written a <\/strong><\/em>weekly column<\/em><\/strong><\/a> for the Daily Record since 2007, is the author of <\/strong><\/em>Cloud Computing for Lawyers<\/em><\/strong><\/a>, co-authors <\/strong><\/em>Social Media for Lawyers: the Next Frontier<\/em><\/strong><\/a>, and co-authors <\/strong><\/em>Criminal Law in New York<\/em><\/strong><\/a>. She\u2019s easily distracted by the potential of bright and shiny tech gadgets, along with good food and wine. You can follow her on Twitter at <\/strong><\/em>@nikiblack<\/em><\/strong><\/a> and she can be reached at <\/strong><\/em>[email\u00a0protected]<\/em><\/strong><\/a>.<\/strong><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

How many fake cases does it take before we stop blaming the tool and start blaming the lawyer? It seems as if not a day goes by without another false case citation making headlines. In courtrooms across the world, judges are grappling with a deluge of error-ridden filings. Lawyers in firms big and small are […]<\/p>\n","protected":false},"author":3,"featured_media":120796,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[16],"tags":[],"class_list":["post-120813","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-above_the_law"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/xira.com\/p\/wp-content\/uploads\/2025\/05\/GettyImages-532031035-QfcAgt.jpeg?fit=724%2C483&ssl=1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/120813","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/comments?post=120813"}],"version-history":[{"count":0,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/120813\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/media\/120796"}],"wp:attachment":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/media?parent=120813"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/categories?post=120813"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/tags?post=120813"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}