{"id":147127,"date":"2026-03-26T02:00:00","date_gmt":"2026-03-26T10:00:00","guid":{"rendered":"https:\/\/xira.com\/p\/2026\/03\/26\/when-chatgpt-becomes-co-counsel-a-cautionary-tale-about-ai-and-the-unauthorized-practice-of-law\/"},"modified":"2026-03-26T02:00:00","modified_gmt":"2026-03-26T10:00:00","slug":"when-chatgpt-becomes-co-counsel-a-cautionary-tale-about-ai-and-the-unauthorized-practice-of-law","status":"publish","type":"post","link":"https:\/\/xira.com\/p\/2026\/03\/26\/when-chatgpt-becomes-co-counsel-a-cautionary-tale-about-ai-and-the-unauthorized-practice-of-law\/","title":{"rendered":"When ChatGPT Becomes Co-Counsel: A Cautionary Tale About AI and the Unauthorized Practice of Law"},"content":{"rendered":"<p>Brooke Lively | It finally happened. OpenAI got sued for the unauthorized practice of law. Is it a preview of the legal profession&#8217;s AI-shaped future \u2014 and what should lawyers tell their clients now?<br \/>\nThe post When ChatGPT Becomes Co-Counsel: A Cautionary Tale About AI and the Unauthorized Practice of Law appeared first on Articles, Tips and Tech for Law Firms and Lawyers.<\/p>\n<p><strong><em>Now that OpenAI is being sued for practicing law without a license, what should lawyers be telling clients about using generative AI? <\/em><\/strong><\/p>\n<figure class=\"wp-block-image size-full\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"770\" height=\"495\" src=\"https:\/\/i0.wp.com\/www.attorneyatwork.com\/wp-content\/uploads\/2026\/03\/AI-and-Unauthorized-Practice-of-Law.jpg?resize=770%2C495&#038;ssl=1\" alt=\"Pixelated lawyer portrait representing AI and unauthorized practice of law.\" class=\"wp-image-100050660\" title=\"\"><figcaption><\/figcaption><\/figure>\n<div class=\"wp-block-yoast-seo-table-of-contents yoast-table-of-contents\">\n<h2>Table of contents<\/h2>\n<ul>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/ai-unauthorized-practice-of-law\/#h-what-triggered-the-lawsuit\" data-level=\"2\" rel=\"nofollow noopener\" target=\"_blank\">What Triggered the Lawsuit?<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/ai-unauthorized-practice-of-law\/#h-hey-chatgpt-is-my-lawyer-gaslighting-me\" data-level=\"2\" rel=\"nofollow noopener\" target=\"_blank\">\u2018Hey ChatGPT, Is My Lawyer Gaslighting Me?\u2019<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/ai-unauthorized-practice-of-law\/#h-and-the-broader-issue\" data-level=\"2\" rel=\"nofollow noopener\" target=\"_blank\">And the Broader Issue?<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/ai-unauthorized-practice-of-law\/#h-so-what-should-lawyers-tell-clients-now\" data-level=\"2\" rel=\"nofollow noopener\" target=\"_blank\">So, What Should Lawyers Tell Clients Now?<\/a>\n<ul>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/ai-unauthorized-practice-of-law\/#h-1-ai-is-a-drafting-tool-not-a-legal-advisor\" data-level=\"3\" rel=\"nofollow noopener\" target=\"_blank\">1. AI is a drafting tool, not a legal advisor<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/ai-unauthorized-practice-of-law\/#h-2-filing-ai-generated-documents-has-consequences\" data-level=\"3\" rel=\"nofollow noopener\" target=\"_blank\">2. Filing AI-generated documents has consequences<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/ai-unauthorized-practice-of-law\/#h-3-ai-often-agrees-with-the-question-you-ask\" data-level=\"3\" rel=\"nofollow noopener\" target=\"_blank\">3. AI often agrees with the question you ask<\/a><\/li>\n<\/ul>\n<\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/ai-unauthorized-practice-of-law\/#h-chatgpt-as-co-counsel\" data-level=\"2\" rel=\"nofollow noopener\" target=\"_blank\">ChatGPT as Co-Counsel<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/ai-unauthorized-practice-of-law\/#h-more-law-practice-tips-from-brooke-lively\" data-level=\"2\" rel=\"nofollow noopener\" target=\"_blank\">More Law Practice Tips from Brooke Lively<\/a><\/li>\n<\/ul>\n<\/div>\n<p>Well, it finally happened. OpenAI got sued for practicing law without a license.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-what-triggered-the-lawsuit\">What Triggered the Lawsuit? <\/h2>\n<p>Apparently the same thing that has happened for millennia: A client who didn\u2019t like their lawyer\u2019s advice went looking for a second opinion. But this time from ChatGPT.<\/p>\n<p>Instead of hiring new counsel, she hired the algorithm. And it shows how that small behavioral shift is already producing some very strange legal situations.<\/p>\n<p>At the center of the lawsuit filed by <a href=\"https:\/\/www.abajournal.com\/news\/article\/openai-sued-for-practicing-law-without-a-license\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Nippon Life Insurance Co. of America against OpenAI<\/a>, the creator of ChatGPT, is a former policyholder, Graciela Dela Torre.<\/p>\n<p>The case reads less like an insurance dispute and more like a preview of the profession\u2019s AI-shaped future.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-hey-chatgpt-is-my-lawyer-gaslighting-me\">\u2018Hey ChatGPT, Is My Lawyer Gaslighting Me?\u2019<\/h2>\n<p id=\"h-ai-says-i-canhere-s-the-short-version\">The Nippon Life lawsuit brings a new urgency to the conversation surrounding AI and the unauthorized practice of law. Here\u2019s the short version of the dispute.<\/p>\n<p>Dela Torre reached a settlement with Nippon and signed a release. The case was closed. Done. Over. Later, she wanted to reopen negotiations. Her attorney pointed out a minor detail: She had already released the claims. Legally speaking, that tends to end the conversation.<\/p>\n<p>Unconvinced, she uploaded her lawyer\u2019s letter and case materials into ChatGPT and asked a question many professionals have heard in some form: \u201cAm I being gaslighted?\u201d<\/p>\n<p>ChatGPT reportedly said yes.<\/p>\n<p>At that point, things escalated. Dela Torre fired her attorney and began representing herself \u2014 with ChatGPT as co-counsel. She drafted and <em>filed<\/em> 21 motions, one subpoena, and eight notices and statements. In a case that was already closed.<\/p>\n<p>The court denied the motions. Undeterred, she returned to ChatGPT and drafted an entirely new lawsuit.<\/p>\n<p>Eventually, Nippon sued OpenAI, alleging its technology engaged in the unlicensed practice of law.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-and-the-broader-issue\">And the Broader Issue?<\/h2>\n<p>Whether that claim succeeds is ultimately up to the courts. But the broader issue is clear: Clients now have access to tools that generate legal arguments instantly, whether or not those arguments are correct, relevant or procedurally viable. And those tools are persuasive.<\/p>\n<p>Large language models produce confident, coherent answers. They do not say, \u201cYou signed a release. This is over.\u201d They generate language that sounds like reasoning. They also respond within the framing of the question they are given.<\/p>\n<p>To a frustrated client, that can feel like validation. From the client\u2019s perspective, it\u2019s simple:<\/p>\n<p class=\"has-background\"><strong><em>My lawyer says I can\u2019t. The AI says I can.<\/em><\/strong><\/p>\n<p class=\"has-background\"><strong><em>Maybe my lawyers just don\u2019t want to fight \u2014 or worse, maybe they\u2019re wrong.<\/em><\/strong><\/p>\n<p>The result is more than awkward conversations. It\u2019s filings. Motions. New lawsuits. All of which the courts and opposing counsel must now sort through.<\/p>\n<p>This is likely only the beginning.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-so-what-should-lawyers-tell-clients-now\">So, What Should Lawyers Tell Clients Now?<\/h2>\n<h3 class=\"wp-block-heading\" id=\"h-1-ai-is-a-drafting-tool-not-a-legal-advisor\">1. AI is a drafting tool, not a legal advisor<\/h3>\n<p>AI is very good at producing language. It can outline, summarize, and draft quickly. What it cannot reliably do is determine whether a claim is viable, whether jurisdiction exists or whether a release ends the matter. It predicts patterns in text. That is not the same thing as practicing law.<\/p>\n<p>Clients should understand the difference.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-2-filing-ai-generated-documents-has-consequences\">2. Filing AI-generated documents has consequences <\/h3>\n<p>Courts are already seeing AI-drafted filings that cite nonexistent cases or make arguments that do not apply. Judges are not amused. Once a document is filed, it becomes part of the record. A motion built on fictional authority can damage credibility very quickly. What feels empowering in a chat window can be reckless in a courtroom.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-3-ai-often-agrees-with-the-question-you-ask\">3. AI often agrees with the question you ask<\/h3>\n<p>AI systems are designed to be responsive and supportive. If someone arrives convinced they\u2019ve been wronged, the model often explores that premise. That can sound like agreement. Ask a GAI platform, \u201cAm I being gaslighted?\u201d and the response may thoughtfully explain why the situation could feel that way. But the model is not weighing evidence or applying procedural rules. It is responding to the narrative embedded in the question. <\/p>\n<p>The AI did not decide the lawyer was wrong. It simply followed the story it was given.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-chatgpt-as-co-counsel\">ChatGPT as Co-Counsel<\/h2>\n<p>The Dela Torre episode is amusing on the surface. Twenty-one motions in a closed case will do that. But it also signals a shift.<\/p>\n<p>Clients now have instant access to tools that sound authoritative, respond confidently and never send an invoice. For lawyers, that means generative AI has become the newest participant in many client matters.<\/p>\n<p>ChatGPT may not be opposing counsel, but GAI is definitely in the room.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-more-law-practice-tips-from-brooke-lively\">More Law Practice Tips from Brooke Lively<\/h2>\n<p>For more tips on building a profitable law firm, read:<\/p>\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.attorneyatwork.com\/flat-fee-pricing-for-legal-services-add-20-percent\/\" id=\"100049904\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Flat-Fee Pricing for Legal Services: Why You Should Add 20% and Not Feel Bad About It<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/what-i-got-wrong-about-private-equity-in-law-firms\/\" rel=\"nofollow noopener\" target=\"_blank\">Mea Culpa: What I Got Wrong About Private Equity in Law Firms<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/growing-pains-bad-client-service-costs-law-firms-money\/\" rel=\"nofollow noopener\" target=\"_blank\">Growing Pains: Why Client Service Is Absolutely a Law Firm CFO\u2019s Problem<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/law-firm-metrics-why-law-firms-struggle-with-data-chaos-and-what-to-do-about-it\/\" rel=\"nofollow noopener\" target=\"_blank\">Law Firm Metrics: Why Law Firms Struggle with Data Chaos (and What to Do About It)<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/the-hidden-cost-of-complacency-why-keeping-underperforming-billers-is-killing-your-firm\/\" rel=\"nofollow noopener\" target=\"_blank\">The Hidden Cost of Complacency: Why Keeping Underperforming Billers Is Killing Your Firm<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/law-firm-profit\/\" rel=\"nofollow noopener\" target=\"_blank\">Law Firm Profits: 5 Ways You May Be Sabotaging Your Firm\u2019s Growth<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/law-firm-financial-systems\/\" rel=\"nofollow noopener\" target=\"_blank\">Are Your Law Firm\u2019s Financial Systems Ready to Scale?<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/understanding-law-firm-profits\/\" rel=\"nofollow noopener\" target=\"_blank\">Law Firm Profits and Year-End Taxes: Avoiding a Surprise Tax Bill<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/designing-attorney-compensation-plans\/\" rel=\"nofollow noopener\" target=\"_blank\">The Best Compensation Plans Use the Law of Thirds<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/law-firm-overhead\/\" rel=\"nofollow noopener\" target=\"_blank\">Law Firm Overhead: What It Is \u2014 and What It Isn\u2019t<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/building-a-law-firm-that-pays-you-first\/\" rel=\"nofollow noopener\" target=\"_blank\">Building a Law Firm That Pays You First<\/a><\/li>\n<li><a href=\"https:\/\/www.attorneyatwork.com\/understanding-law-firm-profits\/\" rel=\"nofollow noopener\" target=\"_blank\">Understanding Law Firm Profits \u2014 And What to Do With Them<\/a><\/li>\n<\/ul>\n<p>Image \u00a9\u00a0<a href=\"https:\/\/istockphoto.com\/\" rel=\"nofollow noopener\" target=\"_blank\">iStockPhoto.com<\/a>.<\/p>\n<figure class=\"wp-block-image\"><a href=\"https:\/\/www.attorneyatwork.com\/subscribe\/\" rel=\"nofollow noopener\" target=\"_blank\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/www.attorneyatwork.com\/wp-content\/uploads\/2023\/06\/AttorneyatWork-Logo-%C2%AE-2021-1.jpg?w=1080&#038;ssl=1\" alt=\"\" class=\"wp-image-100019522\" title=\"\"><\/a><\/figure>\n<p><strong>Sign up for Attorney at Work\u2019s daily practice tips newsletter\u00a0<a href=\"https:\/\/www.attorneyatwork.com\/subscribe\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">here<\/a>\u00a0and\u00a0<a href=\"https:\/\/feeds.transistor.fm\/attorney-at-work-today\" rel=\"nofollow noopener\" target=\"_blank\">subscribe to our podcast<\/a>, Attorney at Work Today.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Brooke Lively | It finally happened. OpenAI got sued for the unauthorized practice of law. Is it a preview of the legal profession&#8217;s AI-shaped future \u2014 and what should lawyers tell their clients now? The post When ChatGPT Becomes Co-Counsel: A Cautionary Tale About AI and the Unauthorized Practice of Law appeared first on Articles, [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[17],"tags":[],"class_list":["post-147127","post","type-post","status-publish","format-standard","hentry","category-legal_matters"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/147127","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/comments?post=147127"}],"version-history":[{"count":0,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/posts\/147127\/revisions"}],"wp:attachment":[{"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/media?parent=147127"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/categories?post=147127"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/xira.com\/p\/wp-json\/wp\/v2\/tags?post=147127"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}