{"id":117872,"date":"2025-05-05T16:02:50","date_gmt":"2025-05-06T00:02:50","guid":{"rendered":"https:\/\/xira.com\/p\/2025\/05\/05\/californias-bar-exam-fiasco-enters-next-stage-of-stupid\/"},"modified":"2025-05-05T16:02:50","modified_gmt":"2025-05-06T00:02:50","slug":"californias-bar-exam-fiasco-enters-next-stage-of-stupid","status":"publish","type":"post","link":"https:\/\/xira.com\/p\/2025\/05\/05\/californias-bar-exam-fiasco-enters-next-stage-of-stupid\/","title":{"rendered":"California\u2019s Bar Exam Fiasco Enters Next Stage Of Stupid"},"content":{"rendered":"
\"\"
<\/figcaption><\/figure>\n

Well, that didn\u2019t take long. After spending years trying to claw its way out from under the bankrupting burden<\/a> placed on the state\u2019s bar examiners by the National Conference of Bar Examiners (NCBE), California will now go running right back into its arms. Or financially bloody maw, as the case may be. In a decision announced late last week<\/a>, the California Supreme Court ordered the state to ditch its newly independent exam and return to the NCBE\u2019s Multistate Bar Examination (MBE) for at least the July 2025 administration.<\/p>\n

The February exam was an absolute disaster<\/a>. The test was thrown together at warp speed, thanks to dilly-dallying while the financial crunch loomed. Once the examiners finally pulled the trigger, the state\u2019s in-house test creation team had a fraction of the time and resources needed, the administration process proved buggy and incoherent, and then they had to admit that AI played a vague role in developing a few questions<\/a> triggering the exact freakout you\u2019d expect at the Venn diagram overlap of \u201cbar exams\u201d and \u201cAI.\u201d<\/p>\n

It\u2019s not like they asked ChatGPT to come up with questions and then slapped those on the test. In fact, the AI assistance came from the psychometrician side meaning it probably just brainstormed smoother phrasings. And everything got checked by subject matter experts before landing on the exam anyway, making the use of AI on 23 of the 171 questions more of a tempest in a teapot, but that didn\u2019t stop headlines like \u201cCalifornia\u2019s Bar Exam: Brought to You by ChatGPT\u2019s Drunk Cousin.\u201d<\/p>\n

Because the whole exam sucked, the state Supreme Court responded by lowering the passing score retroactively to 534<\/a> and had already declared that remote testing was not ready for primetime and that July would be in person with all the costs \u2014 to both the state examiners and the applicants<\/em> \u2014 that entails. Because remember, California already scaled back its testing locations<\/a> in a bid to save money, which should be read as \u201cCalifornia already increased the travel and lodging burdens on applicants in a bid to save its<\/em> money.\u201d<\/p>\n

Having already decided to return to an in-person exam in July \u2014 eliminating the primary culprit in February\u2019s debacle \u2014 the court flushed the progress made on a new exam too. Thus, the state returns to square one in the effort to eventually develop a remote testing solution.<\/p>\n

And so the NCBE, the non-profit with some $175M in assets<\/a>, will pass Go and will collect considerably more than $200.<\/p>\n

One sideshow in the California bar exam\u2019s recent misadventures is the decision to remove several veteran subject matter experts from the process of vetting the new questions. The ousted experts assert that this compromised the process while the examiners maintain they still found sufficient expertise to keep the test sound. In any event, the reason given for excluding these experts was the fear that it would introduce intellectual property issues if folks on NCBE vetting committees started vetting rival questions. Sort of underlining the whole problem with building a testing environment where one entity writes all the questions across the country<\/em>.<\/p>\n

But how essential is the vetting process when the old test also notoriously fails<\/a> to accomplish the task that is its sole justification: identifying \u201cminimum competence.\u201d It\u2019s a test that labors under the insane, antiquated notion that the practice of law is defined by an M&A lawyer memorizing the rules of evidence for a closed-book exam. This is a test that failed one of the most decorated litigators in the country<\/a>. And it\u2019s a test that delivers a lawyer population demonstrably no better or worse at serving the public as having no test at all<\/a>.<\/p>\n

Which is neither here nor there as far as which entity writes the questions. But the odds of meaningful reform improve when we open ourselves up to providers who don\u2019t have deep, vested interests in maintaining business as usual.<\/p>\n

This is a triumph of short-term optics over long-term reform \u2014 a return to the status quo masquerading as stability.<\/p>\n

\n

\"Headshot\"Joe Patrice<\/a>\u00a0is a senior editor at Above the Law and co-host of Thinking Like A Lawyer<\/a>. Feel free to\u00a0email<\/a> any tips, questions, or comments. Follow him on\u00a0Twitter<\/a>\u00a0or Bluesky<\/a> if you\u2019re interested in law, politics, and a healthy dose of college sports news. Joe also serves as a Managing Director at RPN Executive Search<\/a>.<\/em><\/strong><\/p>\n

The post California\u2019s Bar Exam Fiasco Enters Next Stage Of Stupid<\/a> appeared first on Above the Law<\/a>.<\/p>\n

\"\"
<\/figcaption><\/figure>\n

Well, that didn\u2019t take long. After spending years trying to claw its way out from under the bankrupting burden<\/a> placed on the state\u2019s bar examiners by the National Conference of Bar Examiners (NCBE), California will now go running right back into its arms. Or financially bloody maw, as the case may be. In a decision announced late last week<\/a>, the California Supreme Court ordered the state to ditch its newly independent exam and return to the NCBE\u2019s Multistate Bar Examination (MBE) for at least the July 2025 administration.<\/p>\n

The February exam was an absolute disaster<\/a>. The test was thrown together at warp speed, thanks to dilly-dallying while the financial crunch loomed. Once the examiners finally pulled the trigger, the state\u2019s in-house test creation team had a fraction of the time and resources needed, the administration process proved buggy and incoherent, and then they had to admit that AI played a vague role in developing a few questions<\/a> triggering the exact freakout you\u2019d expect at the Venn diagram overlap of \u201cbar exams\u201d and \u201cAI.\u201d<\/p>\n

It\u2019s not like they asked ChatGPT to come up with questions and then slapped those on the test. In fact, the AI assistance came from the psychometrician side meaning it probably just brainstormed smoother phrasings. And everything got checked by subject matter experts before landing on the exam anyway, making the use of AI on 23 of the 171 questions more of a tempest in a teapot, but that didn\u2019t stop headlines like \u201cCalifornia\u2019s Bar Exam: Brought to You by ChatGPT\u2019s Drunk Cousin.\u201d<\/p>\n

Because the whole exam sucked, the state Supreme Court responded by lowering the passing score retroactively to 534<\/a> and had already declared that remote testing was not ready for primetime and that July would be in person with all the costs \u2014 to both the state examiners and the applicants<\/em> \u2014 that entails. Because remember, California already scaled back its testing locations<\/a> in a bid to save money, which should be read as \u201cCalifornia already increased the travel and lodging burdens on applicants in a bid to save its<\/em> money.\u201d<\/p>\n

Having already decided to return to an in-person exam in July \u2014 eliminating the primary culprit in February\u2019s debacle \u2014 the court flushed the progress made on a new exam too. Thus, the state returns to square one in the effort to eventually develop a remote testing solution.<\/p>\n

And so the NCBE, the non-profit with some $175M in assets<\/a>, will pass Go and will collect considerably more than $200.<\/p>\n

One sideshow in the California bar exam\u2019s recent misadventures is the decision to remove several veteran subject matter experts from the process of vetting the new questions. The ousted experts assert that this compromised the process while the examiners maintain they still found sufficient expertise to keep the test sound. In any event, the reason given for excluding these experts was the fear that it would introduce intellectual property issues if folks on NCBE vetting committees started vetting rival questions. Sort of underlining the whole problem with building a testing environment where one entity writes all the questions across the country<\/em>.<\/p>\n

But how essential is the vetting process when the old test also notoriously fails<\/a> to accomplish the task that is its sole justification: identifying \u201cminimum competence.\u201d It\u2019s a test that labors under the insane, antiquated notion that the practice of law is defined by an M&A lawyer memorizing the rules of evidence for a closed-book exam. This is a test that failed one of the most decorated litigators in the country<\/a>. And it\u2019s a test that delivers a lawyer population demonstrably no better or worse at serving the public as having no test at all<\/a>.<\/p>\n

Which is neither here nor there as far as which entity writes the questions. But the odds of meaningful reform improve when we open ourselves up to providers who don\u2019t have deep, vested interests in maintaining business as usual.<\/p>\n

This is a triumph of short-term optics over long-term reform \u2014 a return to the status quo masquerading as stability.<\/p>\n

\n

\"Headshot\"Joe Patrice<\/a>\u00a0is a senior editor at Above the Law and co-host of Thinking Like A Lawyer<\/a>. Feel free to\u00a0email<\/a> any tips, questions, or comments. Follow him on\u00a0Twitter<\/a>\u00a0or Bluesky<\/a> if you\u2019re interested in law, politics, and a healthy dose of college sports news. Joe also serves as a Managing Director at RPN Executive Search<\/a>.<\/em><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

Well, that didn\u2019t take long. After spending years trying to claw its way out from under the bankrupting burden placed on the state\u2019s bar examiners by the National Conference of Bar Examiners (NCBE), California will now go running right back into its arms. Or financially bloody maw, as the case may be. In a decision […]<\/p>\n","protected":false},"author":3,"featured_media":117823,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[16],"tags":[],"class_list":["post-117872","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-above_the_law"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/xira.com\/p\/wp-content\/uploads\/2025\/05\/Headshot-300x200-kOmhEh.jpeg?fit=300%2C200&ssl=1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/117872","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/comments?post=117872"}],"version-history":[{"count":0,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/117872\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/media\/117823"}],"wp:attachment":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/media?parent=117872"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/categories?post=117872"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/tags?post=117872"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}