{"id":136528,"date":"2025-11-07T15:58:10","date_gmt":"2025-11-07T23:58:10","guid":{"rendered":"https:\/\/xira.com\/p\/2025\/11\/07\/prosecutorial-error-ai-hallucinations-are-popping-up-in-criminal-cases\/"},"modified":"2025-11-07T15:58:10","modified_gmt":"2025-11-07T23:58:10","slug":"prosecutorial-error-ai-hallucinations-are-popping-up-in-criminal-cases","status":"publish","type":"post","link":"https:\/\/xira.com\/p\/2025\/11\/07\/prosecutorial-error-ai-hallucinations-are-popping-up-in-criminal-cases\/","title":{"rendered":"Prosecutorial Error: \u2018AI Hallucinations\u2019 Are Popping Up In Criminal Cases"},"content":{"rendered":"<p>When it comes to public defense, it seems like the only news is bad news. We are seeing nationwide shortages of public defenders. In some places, the demand for public defenders is so dire that their <a href=\"https:\/\/abovethelaw.com\/2023\/09\/public-defender-schedules-are-so-swamped-it-probably-isnt-constitutional\/\" rel=\"nofollow noopener\" target=\"_blank\">workload has become a constitutional issue<\/a> and people are being allowed to walk because no one is there to represent them:<\/p>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube\">\n<div class=\"wp-block-embed__wrapper\">\n<\/div>\n<\/figure>\n<p>As far as the other side? I\u2019ll put it this way: they have so many resources that they can afford to prosecute someone for throwing a sandwich. With all the time and discretion on their hands, you\u2019d imagine that prosecutors are taking their time to do the paperwork required to send someone to jail. Turns out even they are being swayed by the large language modeling of all things legal. And while that might be cool when it comes to grunt work, human intelligence should be in the driver\u2019s seat on matters of fundamental liberty. <a href=\"https:\/\/www.govtech.com\/artificial-intelligence\/california-prosecutor-says-ai-caused-errors-in-criminal-case\" rel=\"nofollow noopener\" target=\"_blank\">Gov Tech<\/a> has coverage:<\/p>\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>Northern California prosecutors used artificial intelligence to write a criminal court filing that contained references to nonexistent legal cases and precedents, Nevada County District Attorney Jesse Wilson said in a statement.<br \/>\u2026<br \/>\u201cA prosecutor recently used artificial intelligence in preparing a filing, which resulted in an inaccurate citation,\u201d Wilson said in the statement to The Sacramento Bee. \u201cOnce the error was discovered, the filing was immediately withdrawn.\u201d<\/p>\n<\/blockquote>\n<p>As bad as this is, the harms could be managed if it were a one-off. Unfortunately, it looks like we\u2019re starting at serial prosecutorial error:<\/p>\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\u201cThe Nevada County District Attorney\u2019s Office has, in at least three criminal cases in recent weeks, filed briefing citing to fabricated (legal) authority,\u201d wrote lawyers for the nonprofit Civil Rights Corps, which is representing Kjoller along with a Nevada County public defender.<\/p>\n<\/blockquote>\n<p>While we\u2019re on the topic of prosecutorial error, few things should set off bigger alarms than repeated Brady violations. Lazy AI usage pales in comparison to the shame of <a href=\"https:\/\/deathpenaltyinfo.org\/two-new-law-review-articles-highlight-cause-and-effect-of-brady-violations\" rel=\"nofollow noopener\" target=\"_blank\">over 200 people being sentenced to death because prosecutors withheld exonerating evidence<\/a>. Nonetheless, it blows my mind that the team that is already in the lead on resources is using shortcuts to get guilty pleas and verdicts.<\/p>\n<p><em>Maybe<\/em> it should be fair game to let ChatGPT do part of being a lawyer for you. But whenever you submit your filings, whatever is in them should be on you. That\u2019s your responsibility, regardless of whether an intern or a large language model got sloppy and made up a case to make it easier for you to imprison someone.<\/p>\n<p><a href=\"https:\/\/www.govtech.com\/artificial-intelligence\/california-prosecutor-says-ai-caused-errors-in-criminal-case\" rel=\"nofollow noopener\" target=\"_blank\">California Prosecutor Says AI Caused Errors in Criminal Case <\/a>[Gov Tech]<\/p>\n<p><strong>Earlier<\/strong>: <a href=\"https:\/\/abovethelaw.com\/2023\/09\/public-defender-schedules-are-so-swamped-it-probably-isnt-constitutional\/\" rel=\"nofollow noopener\" target=\"_blank\">Public Defender Schedules Are So Swamped It Probably Isn\u2019t Constitutional<\/a><\/p>\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n<figure class=\"wp-block-image alignright is-resized\"><img data-recalc-dims=\"1\" decoding=\"async\" loading=\"lazy\" width=\"512\" height=\"288\" src=\"https:\/\/i0.wp.com\/abovethelaw.com\/wp-content\/uploads\/sites\/4\/2025\/06\/Chris-Williams-2025.jpg?resize=512%2C288&#038;ssl=1\" alt=\"\" class=\"wp-image-1162378\" title=\"\"><figcaption><\/figcaption><\/figure>\n<p><strong>Chris Williams became a social media manager and assistant editor for Above the Law in June 2021. Prior to joining the staff, he moonlighted as a minor Memelord\u2122 in the Facebook group\u00a0Law School Memes for Edgy T14s . \u00a0He endured Missouri long enough to graduate from Washington University in St. Louis School of Law. He is a former boatbuilder who is learning to swim,\u00a0is interested in critical race theory, philosophy, and humor, and has a love for cycling that occasionally annoys his peers. You can reach him by email at\u00a0<a href=\"mailto:cwilliams@abovethelaw.com\" target=\"_blank\" rel=\"noreferrer noopener\">cwilliams@abovethelaw.com <\/a>and by tweet at\u00a0<a href=\"https:\/\/twitter.com\/WritesForRent\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">@WritesForRent<\/a>.<\/strong><\/p>\n<p>The post <a href=\"https:\/\/abovethelaw.com\/2025\/11\/prosecutorial-error-ai-hallucinations-are-popping-up-in-criminal-cases\/\" rel=\"nofollow noopener\" target=\"_blank\">Prosecutorial Error: \u2018AI Hallucinations\u2019 Are Popping Up In Criminal Cases<\/a> appeared first on <a href=\"https:\/\/abovethelaw.com\/\" rel=\"nofollow noopener\" target=\"_blank\">Above the Law<\/a>.<\/p>\n<p>When it comes to public defense, it seems like the only news is bad news. We are seeing nationwide shortages of public defenders. In some places, the demand for public defenders is so dire that their <a href=\"https:\/\/abovethelaw.com\/2023\/09\/public-defender-schedules-are-so-swamped-it-probably-isnt-constitutional\/\" rel=\"nofollow noopener\" target=\"_blank\">workload has become a constitutional issue<\/a> and people are being allowed to walk because no one is there to represent them:<\/p>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube\"><iframe loading=\"lazy\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/aUhjbzSY20w?feature=oembed\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"> <\/iframe><\/figure>\n<p>As far as the other side? I\u2019ll put it this way: they have so many resources that they can afford to prosecute someone for throwing a sandwich. With all the time and discretion on their hands, you\u2019d imagine that prosecutors are taking their time to do the paperwork required to send someone to jail. Turns out even they are being swayed by the large language modeling of all things legal. And while that might be cool when it comes to grunt work, human intelligence should be in the driver\u2019s seat on matters of fundamental liberty. <a href=\"https:\/\/www.govtech.com\/artificial-intelligence\/california-prosecutor-says-ai-caused-errors-in-criminal-case\" rel=\"nofollow noopener\" target=\"_blank\">Gov Tech<\/a> has coverage:<\/p>\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>Northern California prosecutors used artificial intelligence to write a criminal court filing that contained references to nonexistent legal cases and precedents, Nevada County District Attorney Jesse Wilson said in a statement.<br \/>\u2026<br \/>\u201cA prosecutor recently used artificial intelligence in preparing a filing, which resulted in an inaccurate citation,\u201d Wilson said in the statement to The Sacramento Bee. \u201cOnce the error was discovered, the filing was immediately withdrawn.\u201d<\/p>\n<\/blockquote>\n<p>As bad as this is, the harms could be managed if it were a one-off. Unfortunately, it looks like we\u2019re starting at serial prosecutorial error:<\/p>\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\u201cThe Nevada County District Attorney\u2019s Office has, in at least three criminal cases in recent weeks, filed briefing citing to fabricated (legal) authority,\u201d wrote lawyers for the nonprofit Civil Rights Corps, which is representing Kjoller along with a Nevada County public defender.<\/p>\n<\/blockquote>\n<p>While we\u2019re on the topic of prosecutorial error, few things should set off bigger alarms than repeated Brady violations. Lazy AI usage pales in comparison to the shame of <a href=\"https:\/\/deathpenaltyinfo.org\/two-new-law-review-articles-highlight-cause-and-effect-of-brady-violations\" rel=\"nofollow noopener\" target=\"_blank\">over 200 people being sentenced to death because prosecutors withheld exonerating evidence<\/a>. Nonetheless, it blows my mind that the team that is already in the lead on resources is using shortcuts to get guilty pleas and verdicts.<\/p>\n<p><em>Maybe<\/em> it should be fair game to let ChatGPT do part of being a lawyer for you. But whenever you submit your filings, whatever is in them should be on you. That\u2019s your responsibility, regardless of whether an intern or a large language model got sloppy and made up a case to make it easier for you to imprison someone.<\/p>\n<p><a href=\"https:\/\/www.govtech.com\/artificial-intelligence\/california-prosecutor-says-ai-caused-errors-in-criminal-case\" rel=\"nofollow noopener\" target=\"_blank\">California Prosecutor Says AI Caused Errors in Criminal Case <\/a>[Gov Tech]<\/p>\n<p><strong>Earlier<\/strong>: <a href=\"https:\/\/abovethelaw.com\/2023\/09\/public-defender-schedules-are-so-swamped-it-probably-isnt-constitutional\/\" rel=\"nofollow noopener\" target=\"_blank\">Public Defender Schedules Are So Swamped It Probably Isn\u2019t Constitutional<\/a><\/p>\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n<figure class=\"wp-block-image alignright is-resized\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"512\" height=\"288\" src=\"https:\/\/i0.wp.com\/abovethelaw.com\/wp-content\/uploads\/sites\/4\/2025\/06\/Chris-Williams-2025.jpg?resize=512%2C288&#038;ssl=1\" alt=\"\" class=\"wp-image-1162378\" title=\"\"><figcaption><\/figcaption><\/figure>\n<p><strong>Chris Williams became a social media manager and assistant editor for Above the Law in June 2021. Prior to joining the staff, he moonlighted as a minor Memelord\u2122 in the Facebook group\u00a0Law School Memes for Edgy T14s . \u00a0He endured Missouri long enough to graduate from Washington University in St. Louis School of Law. He is a former boatbuilder who is learning to swim,\u00a0is interested in critical race theory, philosophy, and humor, and has a love for cycling that occasionally annoys his peers. You can reach him by email at\u00a0<a href=\"https:\/\/abovethelaw.com\/cdn-cgi\/l\/email-protection#84e7f3ede8e8ede5e9f7c4e5e6ebf2e1f0ece1e8e5f3aae7ebe9\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">[email\u00a0protected] <\/a>and by tweet at\u00a0<a href=\"https:\/\/twitter.com\/WritesForRent\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">@WritesForRent<\/a>.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>When it comes to public defense, it seems like the only news is bad news. We are seeing nationwide shortages of public defenders. In some places, the demand for public defenders is so dire that their workload has become a constitutional issue and people are being allowed to walk because no one is there to [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":136529,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[16],"tags":[],"class_list":["post-136528","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-above_the_law"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/xira.com\/p\/wp-content\/uploads\/2025\/11\/Chris-Williams-2025-qd1iAb.jpg?fit=512%2C288&ssl=1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/136528","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/comments?post=136528"}],"version-history":[{"count":0,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/136528\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/media\/136529"}],"wp:attachment":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/media?parent=136528"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/categories?post=136528"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/tags?post=136528"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}