In our enthusiasm to adopt and use GenAI, are we ignoring a critical problem: what are the tools doing to our critical thinking skills? And just why are experienced partners better at using GenAI than younger lawyers?<\/p>\n
I attended an interesting panel discussion on Monday at the American Association of Law Librarians<\/a> (AALL) conference in Portland. It was entitled I Hate Hallucinations: How to Combat Misconceptions Around GenAI Accuracy.<\/em> It was advertised to be a discussion on the misconception of GenAI inaccuracies, how to reduce hallucinations, how to ask GenAI questions the right way to reduce risk, and what the future holds. The panelists included Andrea Guldalian<\/a>, Director of Library Services at Duane Morris, Saskia Mehlhorn<\/a>, Director of Knowledge Services at Norton Rose Fulbright, and Patrick Parsons<\/a>, the Director of the Law Library at the University of Pittsburgh School of Law.<\/p>\n The Critical Discussion<\/strong><\/p>\n But despite the session description, the conversation quickly pivoted to something more fundamental: the implicit dangers of GenAI and the problems the profession faces in the training of young lawyers. (I recently discussed this issue in an article<\/a> on the development of gut instinct in the days of GenAI.) This part of the discussion raised some troublesome and challenging issues.<\/p>\n These issues can be clearly seen in the context of legal research. Here\u2019s the reasoning of the panel. First, the use of GenAI for everyone but particularly law students and young lawyers is tempting because it\u2019s so easy. Parsons summed it up this way: \u201cIt\u2019s too easy and really tempting to just rely on what it gives you.\u201d The other problem is that GenAI is really good at doing rote tasks, summarizing and manipulating data, and easing the everyday burdens. But legal research is different.<\/p>\n It\u2019s the Process, Stupid<\/strong><\/p>\n Parsons believes, and so do I, that legal research is a process. \u201cLegal research is not finding the law. It\u2019s not a one-sentence answer.\u201d Legal research involves finding a case, reading a case, reading similar cases, reading cases that come to an opposite conclusion, and understanding not just the holding of the case but the context and nuance. None of the GenAI tools can do this, at least not yet.<\/p>\n The danger, of course, is that the more younger lawyers \u2014 and for that matter, the rest of us rely \u2014 on GenAI for the rote tasks, the more we are tempted to use it for more complicated things like legal research to get quick answers. \u201cLegal research is not just finding a quote,\u201d said Parsons.<\/p>\n Certainly, in my years of practice, I saw plenty of lawyers who tried to take the easy way out with research pre-GenAI. These were the ones who relied on headnotes instead of reading the cases. This often led to disastrous results when their opposition (me) actually read their cases. But today, it\u2019s even easier and more tempting than ever.<\/p>\n The Problem is the Problem<\/strong><\/p>\n Which raises another more fundamental concern. Sound legal research (and solving many other complicated problems) involves thinking through the problem on the front end. There is a well-known adage that has been applied to things from therapy to business management: \u201cthe problem\u2026is the problem.\u201d<\/p>\n One of my mentors used to always ask me: what\u2019s the first thing you do in any case? It\u2019s not reading cases or, in today\u2019s parlance, asking ChatGPT for an answer. It\u2019s sitting back and looking out at the Ohio River (our offices overlooked the River). What he meant of course was thinking through the problem was the key. Or as Albert Einstein put it, \u201cIf I had an hour to solve a problem, I\u2019d spend 55 minutes thinking about the problem and 5 minutes thinking about solutions.\u201d<\/p>\n But here\u2019s what\u2019s going on now, according to the panel: as Mehlhorn put it, \u201cCritical thinking has left the house. Too often younger lawyers don\u2019t think through the problem, they just want information quickly.\u201d<\/p>\n Senior Lawyers Better at Using GenAI? What?<\/strong><\/p>\n The erosion of critical thinking skills makes another panelist\u2019s observation particularly telling: an observation that on first blush seems surprising but really shouldn\u2019t be. Mehlhorn observed that it was the more senior lawyers who are the best users of AI products. Why? Mehlhorn says it\u2019s because they know what they are looking for. In other words, they have a better grip on the problem. They also know when an answer looks right. And when it looks wrong.<\/p>\n How do they know these things? I think it\u2019s because of their experience with the research process that Parsons talked about, over and over again, so that they perhaps subconsciously see patterns, as I discussed in my article. It\u2019s this pattern that triggers what I referred to as \u201cgut instinct.\u201d But as someone smarter than me observed after reading my article, it\u2019s not gut instinct but wisdom.<\/p>\n The Real Challenge<\/strong><\/p>\n But here is the danger and the challenge we as a profession are facing. As we rely more and more on GenAI tools, we risk losing the process that develops the critical thinking skills, the wisdom that more experienced lawyers have.<\/p>\n We have to find some ways to first instill among our young lawyers the respect for critical thinking and the process necessary to solve legal problems. We have to develop ways to ensure that they develop and use those skills and processes.<\/p>\n We have to make sure that with all the benefits of GenAI, we don\u2019t come to expect and even demand that quick answer. That isolated and seemingly reliant quote. We need to demand that they show us that they have thought through the problem, not asked ChatGPT for an easy answer.<\/p>\n The solution isn\u2019t to abandon GenAI. But we need to be intentional about preserving and encouraging the critical thinking skills that make good lawyers. This means building training programs that emphasize process over speed, creating mentorship opportunities where senior lawyers can pass on their pattern recognition skills, and perhaps most importantly, giving young lawyers permission to take the time to think.<\/p>\n Let\u2019s Not Kid Ourselves<\/strong><\/strong><\/p>\n As with everything, reliance and use of GenAI comes with a price. We are only starting to see that price. We have to find ways to minimize and control that price else our future lawyers won\u2019t be humans. They will be robots with simplistic non-answers to complicated problems that go nowhere.<\/p>\n Just as it has always been, the future of law depends on lawyers who can think. A GenAI tool that spends 55 minutes thinking about a problem would be a laughingstock today. Let\u2019s not give our profession the same treatment.<\/p>\n Stephen Embry is a lawyer, speaker, blogger and writer. He publishes\u00a0TechLaw Crossroads<\/a>\u00a0(Opens in a new window), a blog devoted to the examination of the tension between technology, the law, and the practice of law<\/strong><\/em>.<\/p>\n The post GenAI And Critical Thinking: The Problem Is The Problem<\/a> appeared first on Above the Law<\/a>.<\/p>\n In our enthusiasm to adopt and use GenAI, are we ignoring a critical problem: what are the tools doing to our critical thinking skills? And just why are experienced partners better at using GenAI than younger lawyers?<\/p>\n I attended an interesting panel discussion on Monday at the American Association of Law Librarians<\/a> (AALL) conference in Portland. It was entitled I Hate Hallucinations: How to Combat Misconceptions Around GenAI Accuracy.<\/em> It was advertised to be a discussion on the misconception of GenAI inaccuracies, how to reduce hallucinations, how to ask GenAI questions the right way to reduce risk, and what the future holds. The panelists included Andrea Guldalian<\/a>, Director of Library Services at Duane Morris, Saskia Mehlhorn<\/a>, Director of Knowledge Services at Norton Rose Fulbright, and Patrick Parsons<\/a>, the Director of the Law Library at the University of Pittsburgh School of Law.<\/p>\n The Critical Discussion<\/strong><\/p>\n But despite the session description, the conversation quickly pivoted to something more fundamental: the implicit dangers of GenAI and the problems the profession faces in the training of young lawyers. (I recently discussed this issue in an article<\/a> on the development of gut instinct in the days of GenAI.) This part of the discussion raised some troublesome and challenging issues.<\/p>\n These issues can be clearly seen in the context of legal research. Here\u2019s the reasoning of the panel. First, the use of GenAI for everyone but particularly law students and young lawyers is tempting because it\u2019s so easy. Parsons summed it up this way: \u201cIt\u2019s too easy and really tempting to just rely on what it gives you.\u201d The other problem is that GenAI is really good at doing rote tasks, summarizing and manipulating data, and easing the everyday burdens. But legal research is different.<\/p>\n It\u2019s the Process, Stupid<\/strong><\/p>\n Parsons believes, and so do I, that legal research is a process. \u201cLegal research is not finding the law. It\u2019s not a one-sentence answer.\u201d Legal research involves finding a case, reading a case, reading similar cases, reading cases that come to an opposite conclusion, and understanding not just the holding of the case but the context and nuance. None of the GenAI tools can do this, at least not yet.<\/p>\n The danger, of course, is that the more younger lawyers \u2014 and for that matter, the rest of us rely \u2014 on GenAI for the rote tasks, the more we are tempted to use it for more complicated things like legal research to get quick answers. \u201cLegal research is not just finding a quote,\u201d said Parsons.<\/p>\n Certainly, in my years of practice, I saw plenty of lawyers who tried to take the easy way out with research pre-GenAI. These were the ones who relied on headnotes instead of reading the cases. This often led to disastrous results when their opposition (me) actually read their cases. But today, it\u2019s even easier and more tempting than ever.<\/p>\n The Problem is the Problem<\/strong><\/p>\n Which raises another more fundamental concern. Sound legal research (and solving many other complicated problems) involves thinking through the problem on the front end. There is a well-known adage that has been applied to things from therapy to business management: \u201cthe problem\u2026is the problem.\u201d<\/p>\n One of my mentors used to always ask me: what\u2019s the first thing you do in any case? It\u2019s not reading cases or, in today\u2019s parlance, asking ChatGPT for an answer. It\u2019s sitting back and looking out at the Ohio River (our offices overlooked the River). What he meant of course was thinking through the problem was the key. Or as Albert Einstein put it, \u201cIf I had an hour to solve a problem, I\u2019d spend 55 minutes thinking about the problem and 5 minutes thinking about solutions.\u201d<\/p>\n But here\u2019s what\u2019s going on now, according to the panel: as Mehlhorn put it, \u201cCritical thinking has left the house. Too often younger lawyers don\u2019t think through the problem, they just want information quickly.\u201d<\/p>\n Senior Lawyers Better at Using GenAI? What?<\/strong><\/p>\n The erosion of critical thinking skills makes another panelist\u2019s observation particularly telling: an observation that on first blush seems surprising but really shouldn\u2019t be. Mehlhorn observed that it was the more senior lawyers who are the best users of AI products. Why? Mehlhorn says it\u2019s because they know what they are looking for. In other words, they have a better grip on the problem. They also know when an answer looks right. And when it looks wrong.<\/p>\n How do they know these things? I think it\u2019s because of their experience with the research process that Parsons talked about, over and over again, so that they perhaps subconsciously see patterns, as I discussed in my article. It\u2019s this pattern that triggers what I referred to as \u201cgut instinct.\u201d But as someone smarter than me observed after reading my article, it\u2019s not gut instinct but wisdom.<\/p>\n The Real Challenge<\/strong><\/p>\n But here is the danger and the challenge we as a profession are facing. As we rely more and more on GenAI tools, we risk losing the process that develops the critical thinking skills, the wisdom that more experienced lawyers have.<\/p>\n We have to find some ways to first instill among our young lawyers the respect for critical thinking and the process necessary to solve legal problems. We have to develop ways to ensure that they develop and use those skills and processes.<\/p>\n We have to make sure that with all the benefits of GenAI, we don\u2019t come to expect and even demand that quick answer. That isolated and seemingly reliant quote. We need to demand that they show us that they have thought through the problem, not asked ChatGPT for an easy answer.<\/p>\n The solution isn\u2019t to abandon GenAI. But we need to be intentional about preserving and encouraging the critical thinking skills that make good lawyers. This means building training programs that emphasize process over speed, creating mentorship opportunities where senior lawyers can pass on their pattern recognition skills, and perhaps most importantly, giving young lawyers permission to take the time to think.<\/p>\n Let\u2019s Not Kid Ourselves<\/strong><\/strong><\/p>\n As with everything, reliance and use of GenAI comes with a price. We are only starting to see that price. We have to find ways to minimize and control that price else our future lawyers won\u2019t be humans. They will be robots with simplistic non-answers to complicated problems that go nowhere.<\/p>\n Just as it has always been, the future of law depends on lawyers who can think. A GenAI tool that spends 55 minutes thinking about a problem would be a laughingstock today. Let\u2019s not give our profession the same treatment.<\/p>\n Stephen Embry is a lawyer, speaker, blogger and writer. He publishes\u00a0TechLaw Crossroads<\/a>\u00a0(Opens in a new window), a blog devoted to the examination of the tension between technology, the law, and the practice of law<\/strong><\/em>.<\/p>\n The post GenAI And Critical Thinking: The Problem Is The Problem<\/a> appeared first on Above the Law<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":" In our enthusiasm to adopt and use GenAI, are we ignoring a critical problem: what are the tools doing to our critical thinking skills? And just why are experienced partners better at using GenAI than younger lawyers? I attended an interesting panel discussion on Monday at the American Association of Law Librarians (AALL) conference in […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[16],"tags":[],"class_list":["post-127631","post","type-post","status-publish","format-standard","hentry","category-above_the_law"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/127631","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/comments?post=127631"}],"version-history":[{"count":0,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/127631\/revisions"}],"wp:attachment":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/media?parent=127631"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/categories?post=127631"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/tags?post=127631"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n
\n