The first part is an automated time entry program that turns every task a lawyer performs in Legora into a time entry. Reportedly, it will provide the client, the matter, and what was done for subsequent review.\u00a0<\/p>\n
That part of the partnership isn\u2019t all that remarkable. Other vendors and providers have offered similar time entry programs for some time. Presumably the pitch is that those tools may not work as well with Legora.\u00a0But Legora itself announced<\/a> a similar integration with Intapp Time not long ago.\u00a0<\/strong><\/p>\n And I can just hear a Legora\/Laurel representative going, \u201cBut ours is so much better.\u201d Maybe it is. Maybe it\u2019s the greatest thing to happen to timekeeping since the invention of the six-minute increment. I can\u2019t really speak to that but do know that other products are out there.\u00a0<\/p>\n The Bigger Piece<\/strong><\/p>\n The more interesting part of the announcement is something considerably more than an automated time entry program. And it raises some questions that may make firms a little uncomfortable.\u00a0<\/p>\n According to the Legora press release<\/a>, \u201cLaurel and Legora will jointly develop ways to measure how Legora is used, and the value that AI-powered legal work brings to law firms.\u201d\u00a0<\/p>\n The Legora press release goes on to say that the goal is to give law firm leaders \u201ca clearer view of how their lawyers work, how much they rely on Legora, what work is done on Legora, and the value that Legora delivers.\u201d\u00a0<\/p>\n Laurel is even more blunt in its release<\/a>: \u201cEvery firm adopting legal AI eventually asks the same thing. They know what it costs, but what are they getting back?\u2026 Laurel and Legora will keep working together beyond the timesheet, developing ways to measure how AI-powered legal work is used and what it is worth to a firm\u2026\u201d<\/p>\n What Legora and Laurel are promising is to give law firm management the ability to determine the ROI on their purchase of Legora. The ROI for most AI platforms has indeed proven elusive, except for administrative and nonbillable work where AI replaces human work. I can only assume those trying to determine Legora\u2019s ROI have faced the same difficulty. Hence the effort.<\/p>\n I get it. Law firms spend a lot of money on an AI tool. So it might be nice to be able to say, \u201cHere is the value that we got for it\u201d to those partners who may be scratching their heads and saying, \u201cWhat the hell did we spend so much money on?\u201d\u00a0<\/p>\n ROI. To Who?<\/strong><\/p>\n But calculating the ROI, which is assumed to be the time saved by AI, presents some interesting issues for firms. As I have written<\/a>, for firms billing by the hour, the ROI of AI platforms that replace substantive legal work really accrues to the client. Or should.\u00a0<\/p>\n The whole premise is that the AI will do work, perhaps much of which had previously been done by paralegals or associates. That\u2019s billable work, and for firms that use the billable hour model, that\u2019s hardly a return on investment. To the contrary, it\u2019s a loss.\u00a0Try explaining at the next partners\u2019 meeting that you\u2019ve just spent a ton of money on something that reduces their year-end\u00a0 shares. And be ready for the question: is it too late to back out of this deal? Time saved is not necessarily money earned.<\/p>\n The Legora\/Laurel partnership presumably will measure the time saved by Legora AI. Which is easily convertible to dollars. The question then becomes: What does a law firm do with those dollars? Does it pass them on to the client? And what if clients want to see those numbers?\u00a0<\/p>\n As in, \u201cWe want to see the savings your tools came up with so we can determine whether our bills reflect that reduction.\u201d What happens when the tool for justifying the technology investment becomes negotiating leverage for the client? Once you start measuring AI\u2019s value, the next question is who gets to keep it.<\/p>\n There Is Value. For a Different Model<\/strong><\/p>\n The real value in knowing these numbers, however, is to use them under a different sort of billing system.\u00a0Like flat fee or outcome-based systems. There, knowing the value of what the AI tools have provided becomes critical. Either in calculating the fee or in running a cost-benefit analysis that compares the savings to the outcome.\u00a0<\/p>\n That\u2019s a good thing. Especially if it pushes firms to adopt those models and the clients accept them. (Don\u2019t be too hasty to conclude all clients will want alternative billing. They\u2019re not dumb. If they believe AI is dramatically reducing the time required to perform legal work, some may develop a sudden intense affection for hourly billing.)\u00a0<\/p>\n A Tricky Calculation?<\/strong><\/p>\n I also wonder how the savings are going to be calculated. It\u2019s a bit tricky and prone to generalization. Suppose it\u2019s determined that it would have taken an associate 10 hours to draft a brief, but using Legora, it only took 6 minutes. That, in and of itself, would reflect a tremendous savings. At $400 an hour, that\u2019s almost $4,000. (Although I\u2019m not sure what the associate would be doing for the other 9 hours 54 minutes.)\u00a0<\/p>\n It\u2019s easy to say that the time not spent by the associate times their rate is the savings and the ROI. But what about the time spent revising the brief? Checking the citations? (You damn well better check Legora\u2019s or any other vendor\u2019s AI citations if you want to avoid embarrassment, sanctions, or even worse.)\u00a0<\/p>\n Will that time be netted against the time the AI saved? How will the complexity of the matter factor into the calculation? Should it? It\u2019s a complicated matrix, and it will be interesting to see what Legora and Laurel come up with and how firms treat it.\u00a0<\/p>\n Another Fly in the Ointment<\/strong><\/p>\n Another fly in the ointment. By determining the ROI and the savings from AI, will firms unknowingly encourage additional overreliance on AI? In other words, will a partner tell an associate to simply use Legora to do everything, instead of doing the part of the work a human should do? This could particularly be an issue when the work is billed on a flat fee basis where the firm keeps part or all of the savings.\u00a0<\/p>\n Or perhaps even more problematic. Will clients demand that AI tools be used once they see the savings, to the exclusion or reduction of the needed human work? The reasonable human inquiry that the attorney, by signing a pleading, certifies took place.\u00a0<\/p>\n Here\u2019s a chilling thought for firm management: What if the numbers show that clients should be paying less? What if they expose inefficiencies management would rather not acknowledge? Few places to run. Few places to hide.<\/p>\n So don\u2019t think that this is nirvana.\u00a0<\/p>\n That Does Not Necessarily Make It A Bad Thing<\/strong><\/p>\n That\u2019s not to say calculating the ROI is a bad thing. And it\u2019s not to say Legora and Laurel aren\u2019t providing a helpful tool. (Of course, both have a self-interest in demonstrating the dollar savings.) The questions, though, as with most technologies, primarily fall to the users of these tools.<\/p>\n There are real savings out there from the use of AI. And firm management needs to know what those savings are. They need to know to be transparent with their partners. Particularly in a ponderous consensus-driven decision-making model like most law firms use. They need to know the numbers to be transparent with their clients. And to have any hope of competing on price and quality in the post-AI world.\u00a0<\/p>\n So what Legora and Laurel are doing is a good thing. But law firm management might want to be damn sure it understands what it\u2019s asking for. You never know, it might just get it.\u00a0And then what will it do?<\/p>\n Stephen Embry is a lawyer, speaker, blogger, and writer. He publishes\u00a0TechLaw Crossroads<\/a>, a blog devoted to the examination of the tension between technology, the law, and the practice of law.<\/em><\/strong><\/p>\n \n The post Finally, A Way To Measure AI ROI: Be Careful What You Ask For<\/a> appeared first on Above the Law<\/a>.<\/p>\n In case anyone wasn\u2019t listening, Legora, the legal AI provider, and Laurel, a work intelligence platform provider, recently announced a \u201cpartnership.\u201d A partnership that reportedly has two main parts. It will offer what sounds like a fairly standard timekeeping tool. But it holds out the promise of an intriguing future tool that raises some possibilities.\u00a0<\/p>\n And for users, the latter prompts some that suggest they may need to be careful what they ask for. (As a bit of an aside, I always wonder what these tech vendor partnerships really mean and what obligations come with them. Especially when the key announcement hinges on something the partners plan to do together.)<\/p>\n Automated Time Entry (Yawn)<\/strong><\/p>\n The first part is an automated time entry program that turns every task a lawyer performs in Legora into a time entry. Reportedly, it will provide the client, the matter, and what was done for subsequent review.\u00a0<\/p>\n That part of the partnership isn\u2019t all that remarkable. Other vendors and providers have offered similar time entry programs for some time. Presumably the pitch is that those tools may not work as well with Legora.\u00a0But Legora itself announced<\/a> a similar integration with Intapp Time not long ago.<\/p>\n And I can just hear a Legora\/Laurel representative going, \u201cBut ours is so much better.\u201d Maybe it is. Maybe it\u2019s the greatest thing to happen to timekeeping since the invention of the six-minute increment. I can\u2019t really speak to that but do know that other products are out there.\u00a0<\/p>\n The Bigger Piece<\/strong><\/p>\n The more interesting part of the announcement is something considerably more than an automated time entry program. And it raises some questions that may make firms a little uncomfortable.\u00a0<\/p>\n According to the Legora press release<\/a>, \u201cLaurel and Legora will jointly develop ways to measure how Legora is used, and the value that AI-powered legal work brings to law firms.\u201d\u00a0<\/p>\n The Legora press release goes on to say that the goal is to give law firm leaders \u201ca clearer view of how their lawyers work, how much they rely on Legora, what work is done on Legora, and the value that Legora delivers.\u201d\u00a0<\/p>\n Laurel is even more blunt in its release<\/a>: \u201cEvery firm adopting legal AI eventually asks the same thing. They know what it costs, but what are they getting back?\u2026 Laurel and Legora will keep working together beyond the timesheet, developing ways to measure how AI-powered legal work is used and what it is worth to a firm\u2026\u201d<\/p>\n What Legora and Laurel are promising is to give law firm management the ability to determine the ROI on their purchase of Legora. The ROI for most AI platforms has indeed proven elusive, except for administrative and nonbillable work where AI replaces human work. I can only assume those trying to determine Legora\u2019s ROI have faced the same difficulty. Hence the effort.<\/p>\n I get it. Law firms spend a lot of money on an AI tool. So it might be nice to be able to say, \u201cHere is the value that we got for it\u201d to those partners who may be scratching their heads and saying, \u201cWhat the hell did we spend so much money on?\u201d\u00a0<\/p>\n
\n![\"\"](\"https:\/\/abovethelaw.com\/wp-content\/uploads\/sites\/4\/2018\/10\/GettyImages-851956480-300x200.jpg\" "\\"\\"")