1
00:00:00,000 --> 00:00:10,000
[Music]
2
00:00:10,000 --> 00:00:15,000
Welcome to CharneyChange in Legal!
3
00:00:15,000 --> 00:00:16,000
What up?
4
00:00:16,000 --> 00:00:17,000
I'm Ari Kaplan.
5
00:00:17,000 --> 00:00:22,000
I am an analyst that covers the legal industry and honored to be here with Macohhost.
6
00:00:22,000 --> 00:00:24,000
How do I follow that?
7
00:00:24,000 --> 00:00:28,000
I'm Carolyn Hill, Editor-in-Chief of Legalite Insider.
8
00:00:28,000 --> 00:00:30,000
It's good to be here with you.
9
00:00:30,000 --> 00:00:31,000
Nice to see you.
10
00:00:31,000 --> 00:00:33,000
It's so nice to see you.
11
00:00:33,000 --> 00:00:35,000
It's been 50-something episodes.
12
00:00:35,000 --> 00:00:39,000
I'm definitely, I feel very confident someone is watching this one.
13
00:00:39,000 --> 00:00:40,000
I think you are.
14
00:00:40,000 --> 00:00:43,000
I have a deep, deeply strong feeling about this.
15
00:00:43,000 --> 00:00:47,000
We are going to double, triple our listeners.
16
00:00:47,000 --> 00:00:52,000
Anyway, it's been a very exciting end to the first quarter.
17
00:00:52,000 --> 00:00:56,000
I think it's an interesting start to the second quarter.
18
00:00:56,000 --> 00:01:00,000
I'm looking forward to lots of more events that are coming up.
19
00:01:00,000 --> 00:01:02,000
We should see each other certainly.
20
00:01:02,000 --> 00:01:05,000
It's a Lexpo for sure.
21
00:01:05,000 --> 00:01:06,000
I'll also be in London.
22
00:01:06,000 --> 00:01:09,000
I'm going to be going to relativity fest London.
23
00:01:09,000 --> 00:01:11,000
It's a lot happening.
24
00:01:11,000 --> 00:01:12,000
A lot of excitement.
25
00:01:12,000 --> 00:01:14,000
That is so exciting.
26
00:01:14,000 --> 00:01:16,000
I didn't know you were coming to Ralfa.
27
00:01:16,000 --> 00:01:17,000
That is super cool.
28
00:01:17,000 --> 00:01:19,000
I think it's already heating up, isn't it?
29
00:01:19,000 --> 00:01:23,000
My diary is already jam-packed.
30
00:01:23,000 --> 00:01:26,000
Lexpo is exciting though in Amsterdam.
31
00:01:26,000 --> 00:01:28,000
I haven't done that one before.
32
00:01:28,000 --> 00:01:33,000
It's super, super cool to be supporting Robert Mayer and I think it's the tenth anniversary you said.
33
00:01:33,000 --> 00:01:35,000
Tenth anniversary of Lexpo.
34
00:01:35,000 --> 00:01:36,000
You've been in for over years.
35
00:01:36,000 --> 00:01:40,000
I was a speaker at Lexpo 1 in 2016.
36
00:01:40,000 --> 00:01:45,000
It was great then and I have been lucky to serve as the MC for the past five years.
37
00:01:45,000 --> 00:01:52,000
It honestly is such an exceptional event, not just because I'm associated with it, but because Rob and his team have figured out
38
00:01:52,000 --> 00:02:01,000
a way to draw the most dynamic and high-level decision-makers and give you a forum to get to meet them all.
39
00:02:01,000 --> 00:02:10,000
That's really the special secret sauce there is that all the people you want to meet come and you get many opportunities to interact with them.
40
00:02:10,000 --> 00:02:14,000
I just love that about the event and I try to do everything I can as the MC.
41
00:02:14,000 --> 00:02:19,000
Forget about the content and the venue and everything, but I just think the mix is special.
42
00:02:19,000 --> 00:02:22,000
I think you're going to get a lot of value out of it.
43
00:02:22,000 --> 00:02:24,000
I'm looking forward to seeing you there.
44
00:02:24,000 --> 00:02:25,000
I cannot wait.
45
00:02:25,000 --> 00:02:26,000
You're absolutely right.
46
00:02:26,000 --> 00:02:31,000
I think it's already a year to be selective with your time.
47
00:02:31,000 --> 00:02:38,000
People took that away from last year so the sort of chasing our tails, going to every single thing under the sun.
48
00:02:38,000 --> 00:02:40,000
I think people are a little bit done with that.
49
00:02:40,000 --> 00:02:45,000
I think that this year is going to be a year for being, well, we're already in April.
50
00:02:45,000 --> 00:02:55,000
But anyway, over a year for being a bit more selective with your time and choosing events exactly where you get the right mix of people and are able to have those really great conversations.
51
00:02:55,000 --> 00:02:57,000
Otherwise, why are you there?
52
00:02:57,000 --> 00:03:14,000
It's fun to me to think about this idea of it being the year of something or something else because I feel like in AI years, we're moving at such a rapid pace that I don't actually know what this year is going to be because people ask me.
53
00:03:14,000 --> 00:03:16,000
I'm not really sure.
54
00:03:16,000 --> 00:03:19,000
I mean, ChatGPT came out at the end of 2022.
55
00:03:19,000 --> 00:03:28,000
I think people thought that year was going to go in one direction and then it completely shifted in a pretty extraordinary way.
56
00:03:28,000 --> 00:03:31,000
I will say that I missed out on something in Amsterdam.
57
00:03:31,000 --> 00:03:40,000
I did the Amsterdam triathlon last year and registered early and not realizing that that race closes super fast.
58
00:03:40,000 --> 00:03:44,000
So I will not get to swim in the Amstel this year.
59
00:03:44,000 --> 00:03:46,000
I think Robles will be having a lot of fun.
60
00:03:46,000 --> 00:03:48,000
Yeah.
61
00:03:48,000 --> 00:03:52,000
I can race to the ball already.
62
00:03:52,000 --> 00:03:54,000
It wasn't just a long race.
63
00:03:54,000 --> 00:03:56,000
There's no showing off there.
64
00:03:56,000 --> 00:04:13,000
I will say that I wanted to think I'm very excited about is that I just released a report studying how law firms in 14 countries are thinking about and measuring the ROI of their use of legal AI.
65
00:04:13,000 --> 00:04:14,000
I did that with LaGora.
66
00:04:14,000 --> 00:04:25,000
So specifically LaGora customers, but it was a broader conversation than that and really remarkable to have conversations with people who are thinking very deeply.
67
00:04:25,000 --> 00:04:41,000
Not only about adoption and deployment and building community and work quality and workflows, but just how do we effectively measure performance?
68
00:04:41,000 --> 00:04:45,000
How do we gauge the impact on the overall business of law?
69
00:04:45,000 --> 00:04:50,000
It was a very lucky project and just interesting to see the reaction.
70
00:04:50,000 --> 00:04:56,000
That's so cool. And so you interviewed just slightly north of 13.
71
00:04:56,000 --> 00:04:58,000
Yeah, 31 law firm leaders.
72
00:04:58,000 --> 00:04:59,000
Yeah.
73
00:04:59,000 --> 00:05:08,000
Most of them were partners or well, there was a group of partners and sort of decision makers and innovation and AI.
74
00:05:08,000 --> 00:05:14,000
And just asking a series of questions about how are you reallocating the time that you're saving?
75
00:05:14,000 --> 00:05:20,000
Are you getting value? Are you getting projects that you otherwise wouldn't have taken? How is it affecting business development?
76
00:05:20,000 --> 00:05:28,000
What does revenue look like? How does profitability? How is that affected? And it was just fascinating.
77
00:05:28,000 --> 00:05:39,000
And people are very generous to talk about this, especially in a form where you're holding what they say in confidence, but aggregating it so that it builds something of value for the entire community.
78
00:05:39,000 --> 00:05:56,000
And I kept telling them, you know, my goal is to help LaGoura help you. That was really what the objective was is to try to better understand where they're gaining value, where they're having challenges so that the team there, which is just exceptional.
79
00:05:56,000 --> 00:06:00,000
Honestly, like, I'm a neutral as you know, industry analyst.
80
00:06:00,000 --> 00:06:13,000
I'm Switzerland, but when I ask people, how would you recommend, you know, what would you rate this on a scale of one to 10 and people give it a nine or a 10 and so many people do that?
81
00:06:13,000 --> 00:06:17,000
You know, you recognize that they're trying to do something that's important for the space.
82
00:06:17,000 --> 00:06:21,000
And I know that there's a lot of great vendors out there just saying in this instance, I study them.
83
00:06:21,000 --> 00:06:29,000
And there was a lot of very positive value. And I only hope that this kind of research elevates our entire community.
84
00:06:29,000 --> 00:06:44,000
Because other other teams can learn from this. And I think that was their goal is certainly is it's always my goal is how do we take this research that's focused on a particular area and use it to give an advanced everyone.
85
00:06:44,000 --> 00:06:55,000
You know, when I do, I just also released my general council report. And when I do that, I also hope that law firms gain equal or even more value than just leaders of law departments because there's a collaboration, right?
86
00:06:55,000 --> 00:07:02,000
We all work together. And if one learns something about the other, that just heightens the experience for everyone.
87
00:07:02,000 --> 00:07:07,000
Did you use these firms? Were they US space, were they global, were they mixed?
88
00:07:07,000 --> 00:07:24,000
They were firms in 14 countries. So it was a mix, definitely US firms, but certainly firms throughout Europe and Asia. And it was meant to try to draw a line through what firms are doing, but recognize that different firms are doing.
89
00:07:24,000 --> 00:07:41,000
Different firms have different individuals who are handling this who are responsible for the rollout and just usage of their legal AI platform and it's different in different organizations. Some people have a more significant legal operations component.
90
00:07:41,000 --> 00:07:53,000
And so they look at it through a lens of metrics and other analytics. Some are partners at their firms and they're responsible so they're looking at very much from a use case.
91
00:07:53,000 --> 00:08:09,000
From the juniors to the seniors and which juniors, you know, I asked not only our associates or partners or knowledge management leaders getting most of the most value, but if they are associates who within the associate class is it juniors is it mid levels is it seniors.
92
00:08:09,000 --> 00:08:19,000
And you know, are the people who are performing well getting value and what does that look like are the people who are not performing as well as that helping them is their work being enhanced by this.
93
00:08:19,000 --> 00:08:24,000
And you know, a lot of interesting metrics and takeaways that I hope people will get value from.
94
00:08:24,000 --> 00:08:39,000
Did you, was your overall takeaway? So this is fascinating. My conversations around ROI. I'm sometimes surprised at how I don't know how to express this without sounding negative.
95
00:08:39,000 --> 00:08:50,000
But like you've just thought that ROI would be the first and foremost consideration, but it's not for a lot of law firms. They think and maybe this is the right thing. There's lots of reasons behind this. You know,
96
00:08:50,000 --> 00:09:03,000
AI, Jenny, either different beast people experimenting with how it's used. Sometimes the ROI isn't going to be clear takeaway all of that. But I've always been a bit surprised by how they think, oh, you know, we'll get to we'll get to ROI.
97
00:09:03,000 --> 00:09:13,000
I've spoken to a couple of firms with huge wrong outs, including a flakora where ROI, they've said, oh, yeah, we're getting we're convinced that it was going to provide value, but they're not there.
98
00:09:13,000 --> 00:09:21,000
Putting metrics at the front and center of their decision making, which I thought was kind of interesting. Is that did that come across strongly.
99
00:09:21,000 --> 00:09:38,000
There were definitely conversations about how you define ROI, how you prioritize ROI. And I had a great follow up conversation on my podcast with Nick, what Nick West that Michigan, Durea, who's a leader, obviously in this space.
100
00:09:38,000 --> 00:09:50,000
And Nick and I had a long conversation about what does value look like? What does ROI look like? What are the most important metrics that you should capture? And in this conversation, I was honest about what we were trying to achieve.
101
00:09:50,000 --> 00:10:11,000
And I don't think that there is a mandate to force ROI conversations, nor is there a free free pass on gauging ROI. I mean, every organization is making an investment not only of time, but certainly of of, you know, money and their budgeting for this and they're thinking about it long term.
102
00:10:11,000 --> 00:10:29,000
So this has to be part of the conversation people are in different places in their journey and some have just deployed some have been doing this for years. And as a result, one size doesn't fit all, but I tried in every section of this report to give suggestions.
103
00:10:29,000 --> 00:10:47,000
So for example, if you're trying to measure the performance of your junior and middle-level lawyers, for example, try to connect realization rates year over year or try to find some way to gauge progress, because those are numbers that you have.
104
00:10:47,000 --> 00:11:11,000
And they're excellent at keeping track of how much of that time they've gotten paid for. So those are easy numbers. And the other point that I tried to make was that this cross collaboration between disciplines within a firm is only growing that it can't just be the superstars and innovation and knowledge management and AI.
105
00:11:11,000 --> 00:11:26,000
It has to also be the talented folks in time and billing. It has to be individuals in IT. It really just has to be this cross functional journey. And I think that's really important. I just want to tell people that you can download it.
106
00:11:26,000 --> 00:11:41,000
It's logora.com/ROI-law-firms.
107
00:11:41,000 --> 00:11:56,000
And go download it. It's interesting that you talk about reallocating time as well. I know we must move on briefly, because obviously we have such an agenda always.
108
00:11:56,000 --> 00:12:07,000
And we have a lot of work to do with the process of reallocating time. So by that, presumably, the worst thing that they were seeing, they were gaining time back.
109
00:12:07,000 --> 00:12:18,000
Everyone, 100% are saving time. But time isn't really an ROI component. It's much more about what will you do with that time?
110
00:12:18,000 --> 00:12:30,000
And then the return will be in having more time to take on work, you otherwise would have declined, or the technology allowing you to scale in a way that was otherwise not possible.
111
00:12:30,000 --> 00:12:39,000
Could you now do a project that would have taken a team of lawyers a week to a couple of lawyers in it? And I really talented paralegal just a day.
112
00:12:39,000 --> 00:12:54,000
And are there projects that were too document intensive? And is there a way to view it across the spectrum? I mean, there was a lot of discussion about thinking through projects and being able to serve clients in a way that you otherwise weren't able.
113
00:12:54,000 --> 00:13:01,000
Obviously, law firms are already providing super high quality work. So the question wasn't, you know, what is that?
114
00:13:01,000 --> 00:13:18,000
You know, trust in the work, response time, there were just so many areas where there were improvements in the experience. And law firms will this year, I think, really be able to measure ROI in a way that is meaningful.
115
00:13:18,000 --> 00:13:30,000
And I'm saying, if I'm honored and lucky enough to do it again next year, I think that we will get much richer data. And there will be a way to do a year of your comparison. That's really important for our industry.
116
00:13:30,000 --> 00:13:47,000
It's a, it's a, it's a tangent, but it's so relevant. I'd love to see them really dive into also who is doing what and what impact that has on our, our, our work because I feel like one of the things that's being overlooked is how, how new technology will change who is doing what?
117
00:13:47,000 --> 00:14:12,000
So, for example, I've referred to partners, perhaps doing research that they would have handed off to an associate, you know, and, and they were because it's because it's there within their workflow because they can instantly ask a question and they'll have the citation and they can immediately, you know, I mean, a lot of this is they would know anyway, you know, but, but, you know, the, but the point is that things that they would have naturally just handed off is it because it would take a little bit more time.
118
00:14:12,000 --> 00:14:30,000
It can be done pretty instantly. What impact is that going to have on who is doing what and what impact is that going to then have on on our, what does it all mean? You know, I feel like it's a tangent, but it's equally super relevant and, and, and then in terms of preparing for things to change and training people to do things differently.
119
00:14:30,000 --> 00:14:33,000
You know, I think that that's, it's, it's relevant completely.
120
00:14:33,000 --> 00:14:50,000
You know, I was lucky to help to co facilitate a luncheon this week in Washington, DC with Lucy Allen, who's the chief growth officer at Barbary, who you know, who's now an special congratulations to her, who is now the co CEO of Barbary, which was just announced.
121
00:14:50,000 --> 00:15:06,000
And we were lucky to host an incredible cross section of knowledge management, innovation, professional development, training and development, just all of these really exceptional leaders that aren't often brought together.
122
00:15:06,000 --> 00:15:13,000
There are events for knowledge management. There are events for professional development. There are events for innovation.
123
00:15:13,000 --> 00:15:34,000
We don't typically bring those groups together and yet exactly your point. We are seeing a shift in who's getting the work, where the work is being distributed. This technology is enabling senior professionals to rely less on some of their junior support team because the answer is right there for them.
124
00:15:34,000 --> 00:15:47,000
And they're becoming very adept because it's easy to use. And the answers are increasingly trustworthy. So the vetting isn't, isn't as crucial for a basic question that relies on a proven document set.
125
00:15:47,000 --> 00:15:57,000
And so we had this great conversation and it was just helpful as you know, because we both are lucky to facilitate some of these discussions, to bring people together to try to work out the issues.
126
00:15:57,000 --> 00:16:11,000
And Lucy was great in teasing out some of those really important points. And I think that you're going to see that being a real focus this year, just in terms of how do we rebalance the training and development.
127
00:16:11,000 --> 00:16:40,000
And the thing that came out of this research and that has come out of a lot of my discussions over the course of the past few months, six months because I was just at League of Week is that the exceptional service and technology that company like LaGora is providing, but also let's just be even here, Lexus, protégé, Harvey, there are a lot of teams, Thompson Reuters, there are a lot of teams that are competing in this game.
128
00:16:40,000 --> 00:16:55,000
But the emphasis on exceptional client service and great technology and following a roadmap that's realistic and honest, I think it's really leveling up everyone's game and it's great for the buyer.
129
00:16:55,000 --> 00:17:03,000
That I think is just a general observation and perspective that only helps all of us in legal.
130
00:17:03,000 --> 00:17:21,000
Yeah, no, I agree with you completely. I mean, there's also sort of challenges, speaking to people a lot about strategy and it's interesting because we're doing a lot of inside view. So we're speaking with market leaders on on a podcast with the inside view and I'm preparing for one.
131
00:17:21,000 --> 00:17:31,000
And he wants to talk about some of the funding that's coming into the sector, which obviously LaGora is one and then there's many others.
132
00:17:31,000 --> 00:17:48,000
And it's really interesting to this sort of like the people sort of perception of that and people's, you know, the challenges, if it does present any challenges, I think there's, I think there's so much being driven.
133
00:17:48,000 --> 00:17:59,000
There's a real energy in the sector and I think that's great for everybody. I think that there's also just like a tiny bit of like just nervousness, you know, like is this sustainable? This has to be sustainable.
134
00:17:59,000 --> 00:18:09,000
I think that's something for all vendors to be really focused on with their clients, you know, making sure that they felt they feel everything they're doing right now is sustainable.
135
00:18:09,000 --> 00:18:22,000
Listen, money in the space is great for everyone. I just, I'm positive about the investments. They know certainly the people who are putting their money here know generally more than we do and have done a lot of due diligence on this.
136
00:18:22,000 --> 00:18:32,000
And we saw this. We've seen this in cycles. I've been studying this space for almost 20 years. This is actually my 20th year and of being on my own as R.E. Kaplan advisors.
137
00:18:32,000 --> 00:18:55,000
And we've seen, I know, I know, it'll be awesome, it'll be in June and at Lexpo. So there you go. No, but I just, I just think it's really important for us to not be distracted in some ways by areas we really, we can't control who puts money where I think that the money talks about the importance of the space.
138
00:18:55,000 --> 00:19:16,000
But we saw this. We saw this with CLM. We've seen this with the discovery. We've seen questions about numbers and valuations. I think that that is almost like a side story, at least for what I do, you know, I'm trying to make sure that we focus on our what tools are people using where are they getting value?
139
00:19:16,000 --> 00:19:27,000
Are we training people properly? Are clients being served? Are people avoiding mistakes? And that was, you know, that was one of the things that I asked in my research was like is the level of trust is becoming trust?
140
00:19:27,000 --> 00:19:45,000
Are you, are you, are you built? Is the judgment? You know, all of these, all of these components that we've been talking about. And you know, just to try to start a conversation, the cool thing about releasing the research was there were a lot of comments in the various LinkedIn posts about people digging through and asking questions.
141
00:19:45,000 --> 00:19:57,000
And I was very happy to have a conversation because each conversation kind of leaves us closer to an answer. And that's I think what a lot of people are trying to get to.
142
00:19:57,000 --> 00:20:04,000
Yeah, I was saying that we're in this privilege position as well. Like within this same prep call up with with the inside, the inside view.
143
00:20:04,000 --> 00:20:19,000
I was saying that we're in this privilege position of of reflecting dialogue that helps to advance the conversation, right? I never particularly sometimes I'll post opinion pieces where a lot of the time I'll post reflections on my conversations with people.
144
00:20:19,000 --> 00:20:33,000
I don't really feel like there's a definitive answer to a lot of things right now, but actually what there is is amazing conversations that we're lucky enough to present to to to present to you know to give a public beauty, which I think is a very privileged position to be in.
145
00:20:33,000 --> 00:20:43,000
But yeah, it's kind of fun. Do you know what my biggest takeaway I think from our conversation today is that AI years are like dog years, I think, are that's that so?
146
00:20:43,000 --> 00:20:55,000
Yeah, and I was trying to explain to somebody how I think something's are changing and I was laughing that when I, after I graduated college in 1983, I was lucky to spend a year living in Japan.
147
00:20:55,000 --> 00:21:11,000
So I was an English teacher through something called the jet program and I was in a public high school in in Kobe outside Kobe. And I would always make a mistake about taking the local train versus the express train because you know everything is absolutely certainly 1993 94.
148
00:21:11,000 --> 00:21:24,000
It was everything was absolutely Japanese and I was a little embarrassed and my Japanese wasn't very good and they don't want to keep asking people questions and so I would end up taking the wrong train. And I said we are now in a moment where certainly in legal services.
149
00:21:24,000 --> 00:21:34,000
You know, if you ever saw like a map on the on the New York City subway, for example, there are express lines are local lines and so the express lines just have fewer dots.
150
00:21:34,000 --> 00:21:43,000
There are just fewer stops that you need to make in the in the same way that a partner may not need to make one of those stops with an associate but may need to do that with a senior associate.
151
00:21:43,000 --> 00:21:55,000
And so I just kept thinking like we're getting faster and we're stopping less but we're getting to the destination earlier and by getting there earlier, there are other things that you can do to enhance the experience.
152
00:21:55,000 --> 00:21:59,000
And it just I was trying to, you know, because I'm always trying to think of a visual, I do a lot of infographics.
153
00:21:59,000 --> 00:22:19,000
Yeah, yeah, yeah, yeah, yeah, yeah, yeah, I love it. It's like eight years and not like normal years. So I was in each a item where there is but so I wrote you and I spoke about orchestration though given the speed of things that are happening and I wrote a piece last week actually about the importance of orchestration and that came that that came up again and I thought about actually I wrote it.
154
00:22:19,000 --> 00:22:33,000
Yeah, I wrote it this week and I thought about conversation about how orchestration because of the speed of which things are moving this need and I don't I think that I just I described it as in a we need an innovation spine.
155
00:22:33,000 --> 00:22:39,000
So you need to have something that holds everything together that enables you to maintain it like make sure that you're in charge.
156
00:22:39,000 --> 00:22:53,000
So even if it's even if it's a heavy degree of automation and eventually identity, you need to have the spine through which everything kind of slots into and that's that's orchestration and this is something that's super fascinating.
157
00:22:53,000 --> 00:22:58,000
It's on it's only good technology.com. I call it innovation needs a spine if anyone does want to have a look.
158
00:22:58,000 --> 00:23:04,000
But I really thought about our conversation about how orchestration given the speed of things is coming up more and more.
159
00:23:04,000 --> 00:23:23,000
And I'm actually have to say I'm super excited about this so next month on May 5th I am the MC of the Lexus nexus AI symposium at the Harvard Club in New York City and I am excited to hear Jeff Blight who is the general council event,
160
00:23:23,000 --> 00:23:52,000
and I think it'll be just you know, there are lots of leaders who are going to be there and in the various panel discussions, but that is an element of what's changing our industry that I think will be extra powerful part of the conversation, which is important for us to be having just where where is this, you know, how how much change can we consume.
161
00:23:52,000 --> 00:24:21,000
At once and everyone I talked to is like gosh doesn't it seem faster like it seems faster and I joked that we were talking on our discussion about the general council report that the general council is every year I do this general council report this is year seven and we try to characterize the general council and you know in 2020 they were the chief legal officer and chief medical officer and then they became sort of chief procurement officer and chief transformation and little global.
162
00:24:21,000 --> 00:24:50,000
Global global diplomat et cetera this year was sort of the unfazed general council because you know you imagine someone juggling and then you imagine putting one pin on fire and then all the pins on fire and then adding spikes to all the pins and that's kind of like what's happening and it's just and then bouncing on a ball and you know holding away like the cat and I just think that there's a really interesting element here of just being super versatile and that being the core component so orchestration and versatility let's call those two.
163
00:24:50,000 --> 00:24:53,000
At least two of the words of the year.
164
00:24:53,000 --> 00:25:16,000
I see I speak to less general council I speak to a lot of legal operations and I see them being it's you can't generalize there's so much so many people at different stages so many different size so many you know often it does correlate to the size of the company into the size of the team and the resource and all of that kind of stuff in terms of the level of advancement but
165
00:25:16,000 --> 00:25:34,000
they I hosted a I hosted a webinar with Harvey and and actually it was I have to tell you it was our largest we were we were over subscribed we had well over a thousand people sign up for that one which was kind of funny because we were like what happens now to just fall over but no.
166
00:25:34,000 --> 00:25:51,000
But so and Russell Dentsy is the head of legal operations at Harvey you know we were talking about a genticae I that was one of the purposes of the conversation we had Joe Cohen from Harvey and we had a millie lemon who's one of the engineers and we had
167
00:25:51,000 --> 00:26:18,000
a really practical conversation about a genticae I and actually one of the things the Russell's got a big team I but comparatively big team so he has like seven operations people in his team the legal team is about 300 people 250 lawyers and they are so they're advanced right and they've been using Harvey they want an early adopter but they taking you know they they're taking a cautious approach they very much
168
00:26:18,000 --> 00:26:38,000
wanting to be in control the the the Russell's whole messaging was around you know we need to be in charge of this we're not going to take any risks they're not heavily regulated industry so they they can do things that perhaps banks and you know they they they've got different concerns but
169
00:26:38,000 --> 00:27:02,000
but yeah it was just interesting I just really thought that that was that was his his whole vein was they're doing some exciting stuff they're doing a lot of automation and they're probably further ahead than a lot of people in terms of workflows and automating workflows and I'm not suggesting for a minute that they're not doing some really cool stuff but I was just interested you know that they're still that tone of we need to we need this to be governed we need to be in charge of this.
170
00:27:02,000 --> 00:27:31,000
Well I actually read so Richard Troman shared a piece that gave one of the co-founders of Harvey wrote for X and so I read Richard's analysis and then I read Gabe's piece about agents and the use of agents and it it fascinates me the whole there are two things that I read this week that I found really interesting I found Gabe's piece really interesting and also the two scat and leaders who are now advising one is heart advising Harvey and the others advising
171
00:27:31,000 --> 00:27:58,000
letharra and I forget the other company but it was it was in law.com and it was fascinating actually put that into notebook LM so that I could listen to the analysis of what they were saying and it was just fascinating and I've started doing that a lot more like I'll take you know the annual report for example Larry thinks annual report and put it into
172
00:27:58,000 --> 00:28:09,000
a notebook LM just to listen to how they are talking about it and pulling out key themes and it was fascinating I'll just say that the one the most interesting thing I pulled out of that for example
173
00:28:09,000 --> 00:28:27,000
life thinks of course the famous CEO BlackRock he said nobody's paying attention to this but the most important jobs for the future are essentially jobs of the past that we need expert electricians we need people who can build data centers
174
00:28:27,000 --> 00:28:47,000
and it was so interesting you know I'm a fix a guy and I love that and I'm just always thinking about that and I had it got me thinking because when I was doing my research one of the things that I recommended to people is to think about the data they already have and try to deploy it in a way that will help them measure
175
00:28:47,000 --> 00:29:07,000
and engage ROI and progress and if anybody is like me and has a garage and fix this things and I have sort of redundant tools and I have things my wife so I was like don't you already have that I know I don't know where that is I don't know what bin that tube of whatever is so I just buy it again and my point was that it
176
00:29:07,000 --> 00:29:25,000
has a lot of firms and certainly in corporations and that's why legal operations is such an incredible part of a law department but there's all this data there's all this information there are all these resources and we don't use all of them and I don't know that necessarily you need to rein you need to invest more you just need to sort of you
177
00:29:25,000 --> 00:29:36,000
think where what you have is and what you've done you know has where that's taken you and figure out how you can use that with what you're now investing in to push you forward
178
00:29:36,000 --> 00:29:50,000
I'm doing webinars and in-person sessions on data and data strategy this year and I think it's going to be I can't wait this is there we've had a lot of conversations about data already and it's going to be another year of really starting to learn from learn from people you know
179
00:29:50,000 --> 00:30:06,000
this is what I'm excited about I'm doing a webinar coming up with the leads where we're going to be looking at some success stories maybe get a client on the early stages of just prepping it but you know the more people at the end more end users that we can get on talking about their experiences the better I think you know
180
00:30:06,000 --> 00:30:13,000
like in terms of what can we've done this and this is how and what we've learned and these are the challenges and these are maybe the mistakes wow
181
00:30:13,000 --> 00:30:23,000
Wow Caroline I'm excited for our next time so there's a lot happening here but we'll try to we'll try to chart that change so
182
00:30:23,000 --> 00:30:26,000
boom in change in legal
183
00:30:26,000 --> 00:30:35,000
all right well wonderful to see you wonderful to all of our viewers and our listeners and I'm just overwhelmed with the attention great great
184
00:30:35,000 --> 00:30:47,000
episode thank you I'm sorry bye
185
00:30:47,000 --> 00:30:49,580
(wind blowing)
186
00:30:49,580 --> 00:30:54,580
♪ Yeah ♪
00:00:00,000 --> 00:00:10,000
[Music]
2
00:00:10,000 --> 00:00:15,000
Welcome to CharneyChange in Legal!
3
00:00:15,000 --> 00:00:16,000
What up?
4
00:00:16,000 --> 00:00:17,000
I'm Ari Kaplan.
5
00:00:17,000 --> 00:00:22,000
I am an analyst that covers the legal industry and honored to be here with Macohhost.
6
00:00:22,000 --> 00:00:24,000
How do I follow that?
7
00:00:24,000 --> 00:00:28,000
I'm Carolyn Hill, Editor-in-Chief of Legalite Insider.
8
00:00:28,000 --> 00:00:30,000
It's good to be here with you.
9
00:00:30,000 --> 00:00:31,000
Nice to see you.
10
00:00:31,000 --> 00:00:33,000
It's so nice to see you.
11
00:00:33,000 --> 00:00:35,000
It's been 50-something episodes.
12
00:00:35,000 --> 00:00:39,000
I'm definitely, I feel very confident someone is watching this one.
13
00:00:39,000 --> 00:00:40,000
I think you are.
14
00:00:40,000 --> 00:00:43,000
I have a deep, deeply strong feeling about this.
15
00:00:43,000 --> 00:00:47,000
We are going to double, triple our listeners.
16
00:00:47,000 --> 00:00:52,000
Anyway, it's been a very exciting end to the first quarter.
17
00:00:52,000 --> 00:00:56,000
I think it's an interesting start to the second quarter.
18
00:00:56,000 --> 00:01:00,000
I'm looking forward to lots of more events that are coming up.
19
00:01:00,000 --> 00:01:02,000
We should see each other certainly.
20
00:01:02,000 --> 00:01:05,000
It's a Lexpo for sure.
21
00:01:05,000 --> 00:01:06,000
I'll also be in London.
22
00:01:06,000 --> 00:01:09,000
I'm going to be going to relativity fest London.
23
00:01:09,000 --> 00:01:11,000
It's a lot happening.
24
00:01:11,000 --> 00:01:12,000
A lot of excitement.
25
00:01:12,000 --> 00:01:14,000
That is so exciting.
26
00:01:14,000 --> 00:01:16,000
I didn't know you were coming to Ralfa.
27
00:01:16,000 --> 00:01:17,000
That is super cool.
28
00:01:17,000 --> 00:01:19,000
I think it's already heating up, isn't it?
29
00:01:19,000 --> 00:01:23,000
My diary is already jam-packed.
30
00:01:23,000 --> 00:01:26,000
Lexpo is exciting though in Amsterdam.
31
00:01:26,000 --> 00:01:28,000
I haven't done that one before.
32
00:01:28,000 --> 00:01:33,000
It's super, super cool to be supporting Robert Mayer and I think it's the tenth anniversary you said.
33
00:01:33,000 --> 00:01:35,000
Tenth anniversary of Lexpo.
34
00:01:35,000 --> 00:01:36,000
You've been in for over years.
35
00:01:36,000 --> 00:01:40,000
I was a speaker at Lexpo 1 in 2016.
36
00:01:40,000 --> 00:01:45,000
It was great then and I have been lucky to serve as the MC for the past five years.
37
00:01:45,000 --> 00:01:52,000
It honestly is such an exceptional event, not just because I'm associated with it, but because Rob and his team have figured out
38
00:01:52,000 --> 00:02:01,000
a way to draw the most dynamic and high-level decision-makers and give you a forum to get to meet them all.
39
00:02:01,000 --> 00:02:10,000
That's really the special secret sauce there is that all the people you want to meet come and you get many opportunities to interact with them.
40
00:02:10,000 --> 00:02:14,000
I just love that about the event and I try to do everything I can as the MC.
41
00:02:14,000 --> 00:02:19,000
Forget about the content and the venue and everything, but I just think the mix is special.
42
00:02:19,000 --> 00:02:22,000
I think you're going to get a lot of value out of it.
43
00:02:22,000 --> 00:02:24,000
I'm looking forward to seeing you there.
44
00:02:24,000 --> 00:02:25,000
I cannot wait.
45
00:02:25,000 --> 00:02:26,000
You're absolutely right.
46
00:02:26,000 --> 00:02:31,000
I think it's already a year to be selective with your time.
47
00:02:31,000 --> 00:02:38,000
People took that away from last year so the sort of chasing our tails, going to every single thing under the sun.
48
00:02:38,000 --> 00:02:40,000
I think people are a little bit done with that.
49
00:02:40,000 --> 00:02:45,000
I think that this year is going to be a year for being, well, we're already in April.
50
00:02:45,000 --> 00:02:55,000
But anyway, over a year for being a bit more selective with your time and choosing events exactly where you get the right mix of people and are able to have those really great conversations.
51
00:02:55,000 --> 00:02:57,000
Otherwise, why are you there?
52
00:02:57,000 --> 00:03:14,000
It's fun to me to think about this idea of it being the year of something or something else because I feel like in AI years, we're moving at such a rapid pace that I don't actually know what this year is going to be because people ask me.
53
00:03:14,000 --> 00:03:16,000
I'm not really sure.
54
00:03:16,000 --> 00:03:19,000
I mean, ChatGPT came out at the end of 2022.
55
00:03:19,000 --> 00:03:28,000
I think people thought that year was going to go in one direction and then it completely shifted in a pretty extraordinary way.
56
00:03:28,000 --> 00:03:31,000
I will say that I missed out on something in Amsterdam.
57
00:03:31,000 --> 00:03:40,000
I did the Amsterdam triathlon last year and registered early and not realizing that that race closes super fast.
58
00:03:40,000 --> 00:03:44,000
So I will not get to swim in the Amstel this year.
59
00:03:44,000 --> 00:03:46,000
I think Robles will be having a lot of fun.
60
00:03:46,000 --> 00:03:48,000
Yeah.
61
00:03:48,000 --> 00:03:52,000
I can race to the ball already.
62
00:03:52,000 --> 00:03:54,000
It wasn't just a long race.
63
00:03:54,000 --> 00:03:56,000
There's no showing off there.
64
00:03:56,000 --> 00:04:13,000
I will say that I wanted to think I'm very excited about is that I just released a report studying how law firms in 14 countries are thinking about and measuring the ROI of their use of legal AI.
65
00:04:13,000 --> 00:04:14,000
I did that with LaGora.
66
00:04:14,000 --> 00:04:25,000
So specifically LaGora customers, but it was a broader conversation than that and really remarkable to have conversations with people who are thinking very deeply.
67
00:04:25,000 --> 00:04:41,000
Not only about adoption and deployment and building community and work quality and workflows, but just how do we effectively measure performance?
68
00:04:41,000 --> 00:04:45,000
How do we gauge the impact on the overall business of law?
69
00:04:45,000 --> 00:04:50,000
It was a very lucky project and just interesting to see the reaction.
70
00:04:50,000 --> 00:04:56,000
That's so cool. And so you interviewed just slightly north of 13.
71
00:04:56,000 --> 00:04:58,000
Yeah, 31 law firm leaders.
72
00:04:58,000 --> 00:04:59,000
Yeah.
73
00:04:59,000 --> 00:05:08,000
Most of them were partners or well, there was a group of partners and sort of decision makers and innovation and AI.
74
00:05:08,000 --> 00:05:14,000
And just asking a series of questions about how are you reallocating the time that you're saving?
75
00:05:14,000 --> 00:05:20,000
Are you getting value? Are you getting projects that you otherwise wouldn't have taken? How is it affecting business development?
76
00:05:20,000 --> 00:05:28,000
What does revenue look like? How does profitability? How is that affected? And it was just fascinating.
77
00:05:28,000 --> 00:05:39,000
And people are very generous to talk about this, especially in a form where you're holding what they say in confidence, but aggregating it so that it builds something of value for the entire community.
78
00:05:39,000 --> 00:05:56,000
And I kept telling them, you know, my goal is to help LaGoura help you. That was really what the objective was is to try to better understand where they're gaining value, where they're having challenges so that the team there, which is just exceptional.
79
00:05:56,000 --> 00:06:00,000
Honestly, like, I'm a neutral as you know, industry analyst.
80
00:06:00,000 --> 00:06:13,000
I'm Switzerland, but when I ask people, how would you recommend, you know, what would you rate this on a scale of one to 10 and people give it a nine or a 10 and so many people do that?
81
00:06:13,000 --> 00:06:17,000
You know, you recognize that they're trying to do something that's important for the space.
82
00:06:17,000 --> 00:06:21,000
And I know that there's a lot of great vendors out there just saying in this instance, I study them.
83
00:06:21,000 --> 00:06:29,000
And there was a lot of very positive value. And I only hope that this kind of research elevates our entire community.
84
00:06:29,000 --> 00:06:44,000
Because other other teams can learn from this. And I think that was their goal is certainly is it's always my goal is how do we take this research that's focused on a particular area and use it to give an advanced everyone.
85
00:06:44,000 --> 00:06:55,000
You know, when I do, I just also released my general council report. And when I do that, I also hope that law firms gain equal or even more value than just leaders of law departments because there's a collaboration, right?
86
00:06:55,000 --> 00:07:02,000
We all work together. And if one learns something about the other, that just heightens the experience for everyone.
87
00:07:02,000 --> 00:07:07,000
Did you use these firms? Were they US space, were they global, were they mixed?
88
00:07:07,000 --> 00:07:24,000
They were firms in 14 countries. So it was a mix, definitely US firms, but certainly firms throughout Europe and Asia. And it was meant to try to draw a line through what firms are doing, but recognize that different firms are doing.
89
00:07:24,000 --> 00:07:41,000
Different firms have different individuals who are handling this who are responsible for the rollout and just usage of their legal AI platform and it's different in different organizations. Some people have a more significant legal operations component.
90
00:07:41,000 --> 00:07:53,000
And so they look at it through a lens of metrics and other analytics. Some are partners at their firms and they're responsible so they're looking at very much from a use case.
91
00:07:53,000 --> 00:08:09,000
From the juniors to the seniors and which juniors, you know, I asked not only our associates or partners or knowledge management leaders getting most of the most value, but if they are associates who within the associate class is it juniors is it mid levels is it seniors.
92
00:08:09,000 --> 00:08:19,000
And you know, are the people who are performing well getting value and what does that look like are the people who are not performing as well as that helping them is their work being enhanced by this.
93
00:08:19,000 --> 00:08:24,000
And you know, a lot of interesting metrics and takeaways that I hope people will get value from.
94
00:08:24,000 --> 00:08:39,000
Did you, was your overall takeaway? So this is fascinating. My conversations around ROI. I'm sometimes surprised at how I don't know how to express this without sounding negative.
95
00:08:39,000 --> 00:08:50,000
But like you've just thought that ROI would be the first and foremost consideration, but it's not for a lot of law firms. They think and maybe this is the right thing. There's lots of reasons behind this. You know,
96
00:08:50,000 --> 00:09:03,000
AI, Jenny, either different beast people experimenting with how it's used. Sometimes the ROI isn't going to be clear takeaway all of that. But I've always been a bit surprised by how they think, oh, you know, we'll get to we'll get to ROI.
97
00:09:03,000 --> 00:09:13,000
I've spoken to a couple of firms with huge wrong outs, including a flakora where ROI, they've said, oh, yeah, we're getting we're convinced that it was going to provide value, but they're not there.
98
00:09:13,000 --> 00:09:21,000
Putting metrics at the front and center of their decision making, which I thought was kind of interesting. Is that did that come across strongly.
99
00:09:21,000 --> 00:09:38,000
There were definitely conversations about how you define ROI, how you prioritize ROI. And I had a great follow up conversation on my podcast with Nick, what Nick West that Michigan, Durea, who's a leader, obviously in this space.
100
00:09:38,000 --> 00:09:50,000
And Nick and I had a long conversation about what does value look like? What does ROI look like? What are the most important metrics that you should capture? And in this conversation, I was honest about what we were trying to achieve.
101
00:09:50,000 --> 00:10:11,000
And I don't think that there is a mandate to force ROI conversations, nor is there a free free pass on gauging ROI. I mean, every organization is making an investment not only of time, but certainly of of, you know, money and their budgeting for this and they're thinking about it long term.
102
00:10:11,000 --> 00:10:29,000
So this has to be part of the conversation people are in different places in their journey and some have just deployed some have been doing this for years. And as a result, one size doesn't fit all, but I tried in every section of this report to give suggestions.
103
00:10:29,000 --> 00:10:47,000
So for example, if you're trying to measure the performance of your junior and middle-level lawyers, for example, try to connect realization rates year over year or try to find some way to gauge progress, because those are numbers that you have.
104
00:10:47,000 --> 00:11:11,000
And they're excellent at keeping track of how much of that time they've gotten paid for. So those are easy numbers. And the other point that I tried to make was that this cross collaboration between disciplines within a firm is only growing that it can't just be the superstars and innovation and knowledge management and AI.
105
00:11:11,000 --> 00:11:26,000
It has to also be the talented folks in time and billing. It has to be individuals in IT. It really just has to be this cross functional journey. And I think that's really important. I just want to tell people that you can download it.
106
00:11:26,000 --> 00:11:41,000
It's logora.com/ROI-law-firms.
107
00:11:41,000 --> 00:11:56,000
And go download it. It's interesting that you talk about reallocating time as well. I know we must move on briefly, because obviously we have such an agenda always.
108
00:11:56,000 --> 00:12:07,000
And we have a lot of work to do with the process of reallocating time. So by that, presumably, the worst thing that they were seeing, they were gaining time back.
109
00:12:07,000 --> 00:12:18,000
Everyone, 100% are saving time. But time isn't really an ROI component. It's much more about what will you do with that time?
110
00:12:18,000 --> 00:12:30,000
And then the return will be in having more time to take on work, you otherwise would have declined, or the technology allowing you to scale in a way that was otherwise not possible.
111
00:12:30,000 --> 00:12:39,000
Could you now do a project that would have taken a team of lawyers a week to a couple of lawyers in it? And I really talented paralegal just a day.
112
00:12:39,000 --> 00:12:54,000
And are there projects that were too document intensive? And is there a way to view it across the spectrum? I mean, there was a lot of discussion about thinking through projects and being able to serve clients in a way that you otherwise weren't able.
113
00:12:54,000 --> 00:13:01,000
Obviously, law firms are already providing super high quality work. So the question wasn't, you know, what is that?
114
00:13:01,000 --> 00:13:18,000
You know, trust in the work, response time, there were just so many areas where there were improvements in the experience. And law firms will this year, I think, really be able to measure ROI in a way that is meaningful.
115
00:13:18,000 --> 00:13:30,000
And I'm saying, if I'm honored and lucky enough to do it again next year, I think that we will get much richer data. And there will be a way to do a year of your comparison. That's really important for our industry.
116
00:13:30,000 --> 00:13:47,000
It's a, it's a, it's a tangent, but it's so relevant. I'd love to see them really dive into also who is doing what and what impact that has on our, our, our work because I feel like one of the things that's being overlooked is how, how new technology will change who is doing what?
117
00:13:47,000 --> 00:14:12,000
So, for example, I've referred to partners, perhaps doing research that they would have handed off to an associate, you know, and, and they were because it's because it's there within their workflow because they can instantly ask a question and they'll have the citation and they can immediately, you know, I mean, a lot of this is they would know anyway, you know, but, but, you know, the, but the point is that things that they would have naturally just handed off is it because it would take a little bit more time.
118
00:14:12,000 --> 00:14:30,000
It can be done pretty instantly. What impact is that going to have on who is doing what and what impact is that going to then have on on our, what does it all mean? You know, I feel like it's a tangent, but it's equally super relevant and, and, and then in terms of preparing for things to change and training people to do things differently.
119
00:14:30,000 --> 00:14:33,000
You know, I think that that's, it's, it's relevant completely.
120
00:14:33,000 --> 00:14:50,000
You know, I was lucky to help to co facilitate a luncheon this week in Washington, DC with Lucy Allen, who's the chief growth officer at Barbary, who you know, who's now an special congratulations to her, who is now the co CEO of Barbary, which was just announced.
121
00:14:50,000 --> 00:15:06,000
And we were lucky to host an incredible cross section of knowledge management, innovation, professional development, training and development, just all of these really exceptional leaders that aren't often brought together.
122
00:15:06,000 --> 00:15:13,000
There are events for knowledge management. There are events for professional development. There are events for innovation.
123
00:15:13,000 --> 00:15:34,000
We don't typically bring those groups together and yet exactly your point. We are seeing a shift in who's getting the work, where the work is being distributed. This technology is enabling senior professionals to rely less on some of their junior support team because the answer is right there for them.
124
00:15:34,000 --> 00:15:47,000
And they're becoming very adept because it's easy to use. And the answers are increasingly trustworthy. So the vetting isn't, isn't as crucial for a basic question that relies on a proven document set.
125
00:15:47,000 --> 00:15:57,000
And so we had this great conversation and it was just helpful as you know, because we both are lucky to facilitate some of these discussions, to bring people together to try to work out the issues.
126
00:15:57,000 --> 00:16:11,000
And Lucy was great in teasing out some of those really important points. And I think that you're going to see that being a real focus this year, just in terms of how do we rebalance the training and development.
127
00:16:11,000 --> 00:16:40,000
And the thing that came out of this research and that has come out of a lot of my discussions over the course of the past few months, six months because I was just at League of Week is that the exceptional service and technology that company like LaGora is providing, but also let's just be even here, Lexus, protégé, Harvey, there are a lot of teams, Thompson Reuters, there are a lot of teams that are competing in this game.
128
00:16:40,000 --> 00:16:55,000
But the emphasis on exceptional client service and great technology and following a roadmap that's realistic and honest, I think it's really leveling up everyone's game and it's great for the buyer.
129
00:16:55,000 --> 00:17:03,000
That I think is just a general observation and perspective that only helps all of us in legal.
130
00:17:03,000 --> 00:17:21,000
Yeah, no, I agree with you completely. I mean, there's also sort of challenges, speaking to people a lot about strategy and it's interesting because we're doing a lot of inside view. So we're speaking with market leaders on on a podcast with the inside view and I'm preparing for one.
131
00:17:21,000 --> 00:17:31,000
And he wants to talk about some of the funding that's coming into the sector, which obviously LaGora is one and then there's many others.
132
00:17:31,000 --> 00:17:48,000
And it's really interesting to this sort of like the people sort of perception of that and people's, you know, the challenges, if it does present any challenges, I think there's, I think there's so much being driven.
133
00:17:48,000 --> 00:17:59,000
There's a real energy in the sector and I think that's great for everybody. I think that there's also just like a tiny bit of like just nervousness, you know, like is this sustainable? This has to be sustainable.
134
00:17:59,000 --> 00:18:09,000
I think that's something for all vendors to be really focused on with their clients, you know, making sure that they felt they feel everything they're doing right now is sustainable.
135
00:18:09,000 --> 00:18:22,000
Listen, money in the space is great for everyone. I just, I'm positive about the investments. They know certainly the people who are putting their money here know generally more than we do and have done a lot of due diligence on this.
136
00:18:22,000 --> 00:18:32,000
And we saw this. We've seen this in cycles. I've been studying this space for almost 20 years. This is actually my 20th year and of being on my own as R.E. Kaplan advisors.
137
00:18:32,000 --> 00:18:55,000
And we've seen, I know, I know, it'll be awesome, it'll be in June and at Lexpo. So there you go. No, but I just, I just think it's really important for us to not be distracted in some ways by areas we really, we can't control who puts money where I think that the money talks about the importance of the space.
138
00:18:55,000 --> 00:19:16,000
But we saw this. We saw this with CLM. We've seen this with the discovery. We've seen questions about numbers and valuations. I think that that is almost like a side story, at least for what I do, you know, I'm trying to make sure that we focus on our what tools are people using where are they getting value?
139
00:19:16,000 --> 00:19:27,000
Are we training people properly? Are clients being served? Are people avoiding mistakes? And that was, you know, that was one of the things that I asked in my research was like is the level of trust is becoming trust?
140
00:19:27,000 --> 00:19:45,000
Are you, are you, are you built? Is the judgment? You know, all of these, all of these components that we've been talking about. And you know, just to try to start a conversation, the cool thing about releasing the research was there were a lot of comments in the various LinkedIn posts about people digging through and asking questions.
141
00:19:45,000 --> 00:19:57,000
And I was very happy to have a conversation because each conversation kind of leaves us closer to an answer. And that's I think what a lot of people are trying to get to.
142
00:19:57,000 --> 00:20:04,000
Yeah, I was saying that we're in this privilege position as well. Like within this same prep call up with with the inside, the inside view.
143
00:20:04,000 --> 00:20:19,000
I was saying that we're in this privilege position of of reflecting dialogue that helps to advance the conversation, right? I never particularly sometimes I'll post opinion pieces where a lot of the time I'll post reflections on my conversations with people.
144
00:20:19,000 --> 00:20:33,000
I don't really feel like there's a definitive answer to a lot of things right now, but actually what there is is amazing conversations that we're lucky enough to present to to to present to you know to give a public beauty, which I think is a very privileged position to be in.
145
00:20:33,000 --> 00:20:43,000
But yeah, it's kind of fun. Do you know what my biggest takeaway I think from our conversation today is that AI years are like dog years, I think, are that's that so?
146
00:20:43,000 --> 00:20:55,000
Yeah, and I was trying to explain to somebody how I think something's are changing and I was laughing that when I, after I graduated college in 1983, I was lucky to spend a year living in Japan.
147
00:20:55,000 --> 00:21:11,000
So I was an English teacher through something called the jet program and I was in a public high school in in Kobe outside Kobe. And I would always make a mistake about taking the local train versus the express train because you know everything is absolutely certainly 1993 94.
148
00:21:11,000 --> 00:21:24,000
It was everything was absolutely Japanese and I was a little embarrassed and my Japanese wasn't very good and they don't want to keep asking people questions and so I would end up taking the wrong train. And I said we are now in a moment where certainly in legal services.
149
00:21:24,000 --> 00:21:34,000
You know, if you ever saw like a map on the on the New York City subway, for example, there are express lines are local lines and so the express lines just have fewer dots.
150
00:21:34,000 --> 00:21:43,000
There are just fewer stops that you need to make in the in the same way that a partner may not need to make one of those stops with an associate but may need to do that with a senior associate.
151
00:21:43,000 --> 00:21:55,000
And so I just kept thinking like we're getting faster and we're stopping less but we're getting to the destination earlier and by getting there earlier, there are other things that you can do to enhance the experience.
152
00:21:55,000 --> 00:21:59,000
And it just I was trying to, you know, because I'm always trying to think of a visual, I do a lot of infographics.
153
00:21:59,000 --> 00:22:19,000
Yeah, yeah, yeah, yeah, yeah, yeah, yeah, I love it. It's like eight years and not like normal years. So I was in each a item where there is but so I wrote you and I spoke about orchestration though given the speed of things that are happening and I wrote a piece last week actually about the importance of orchestration and that came that that came up again and I thought about actually I wrote it.
154
00:22:19,000 --> 00:22:33,000
Yeah, I wrote it this week and I thought about conversation about how orchestration because of the speed of which things are moving this need and I don't I think that I just I described it as in a we need an innovation spine.
155
00:22:33,000 --> 00:22:39,000
So you need to have something that holds everything together that enables you to maintain it like make sure that you're in charge.
156
00:22:39,000 --> 00:22:53,000
So even if it's even if it's a heavy degree of automation and eventually identity, you need to have the spine through which everything kind of slots into and that's that's orchestration and this is something that's super fascinating.
157
00:22:53,000 --> 00:22:58,000
It's on it's only good technology.com. I call it innovation needs a spine if anyone does want to have a look.
158
00:22:58,000 --> 00:23:04,000
But I really thought about our conversation about how orchestration given the speed of things is coming up more and more.
159
00:23:04,000 --> 00:23:23,000
And I'm actually have to say I'm super excited about this so next month on May 5th I am the MC of the Lexus nexus AI symposium at the Harvard Club in New York City and I am excited to hear Jeff Blight who is the general council event,
160
00:23:23,000 --> 00:23:52,000
and I think it'll be just you know, there are lots of leaders who are going to be there and in the various panel discussions, but that is an element of what's changing our industry that I think will be extra powerful part of the conversation, which is important for us to be having just where where is this, you know, how how much change can we consume.
161
00:23:52,000 --> 00:24:21,000
At once and everyone I talked to is like gosh doesn't it seem faster like it seems faster and I joked that we were talking on our discussion about the general council report that the general council is every year I do this general council report this is year seven and we try to characterize the general council and you know in 2020 they were the chief legal officer and chief medical officer and then they became sort of chief procurement officer and chief transformation and little global.
162
00:24:21,000 --> 00:24:50,000
Global global diplomat et cetera this year was sort of the unfazed general council because you know you imagine someone juggling and then you imagine putting one pin on fire and then all the pins on fire and then adding spikes to all the pins and that's kind of like what's happening and it's just and then bouncing on a ball and you know holding away like the cat and I just think that there's a really interesting element here of just being super versatile and that being the core component so orchestration and versatility let's call those two.
163
00:24:50,000 --> 00:24:53,000
At least two of the words of the year.
164
00:24:53,000 --> 00:25:16,000
I see I speak to less general council I speak to a lot of legal operations and I see them being it's you can't generalize there's so much so many people at different stages so many different size so many you know often it does correlate to the size of the company into the size of the team and the resource and all of that kind of stuff in terms of the level of advancement but
165
00:25:16,000 --> 00:25:34,000
they I hosted a I hosted a webinar with Harvey and and actually it was I have to tell you it was our largest we were we were over subscribed we had well over a thousand people sign up for that one which was kind of funny because we were like what happens now to just fall over but no.
166
00:25:34,000 --> 00:25:51,000
But so and Russell Dentsy is the head of legal operations at Harvey you know we were talking about a genticae I that was one of the purposes of the conversation we had Joe Cohen from Harvey and we had a millie lemon who's one of the engineers and we had
167
00:25:51,000 --> 00:26:18,000
a really practical conversation about a genticae I and actually one of the things the Russell's got a big team I but comparatively big team so he has like seven operations people in his team the legal team is about 300 people 250 lawyers and they are so they're advanced right and they've been using Harvey they want an early adopter but they taking you know they they're taking a cautious approach they very much
168
00:26:18,000 --> 00:26:38,000
wanting to be in control the the the Russell's whole messaging was around you know we need to be in charge of this we're not going to take any risks they're not heavily regulated industry so they they can do things that perhaps banks and you know they they they've got different concerns but
169
00:26:38,000 --> 00:27:02,000
but yeah it was just interesting I just really thought that that was that was his his whole vein was they're doing some exciting stuff they're doing a lot of automation and they're probably further ahead than a lot of people in terms of workflows and automating workflows and I'm not suggesting for a minute that they're not doing some really cool stuff but I was just interested you know that they're still that tone of we need to we need this to be governed we need to be in charge of this.
170
00:27:02,000 --> 00:27:31,000
Well I actually read so Richard Troman shared a piece that gave one of the co-founders of Harvey wrote for X and so I read Richard's analysis and then I read Gabe's piece about agents and the use of agents and it it fascinates me the whole there are two things that I read this week that I found really interesting I found Gabe's piece really interesting and also the two scat and leaders who are now advising one is heart advising Harvey and the others advising
171
00:27:31,000 --> 00:27:58,000
letharra and I forget the other company but it was it was in law.com and it was fascinating actually put that into notebook LM so that I could listen to the analysis of what they were saying and it was just fascinating and I've started doing that a lot more like I'll take you know the annual report for example Larry thinks annual report and put it into
172
00:27:58,000 --> 00:28:09,000
a notebook LM just to listen to how they are talking about it and pulling out key themes and it was fascinating I'll just say that the one the most interesting thing I pulled out of that for example
173
00:28:09,000 --> 00:28:27,000
life thinks of course the famous CEO BlackRock he said nobody's paying attention to this but the most important jobs for the future are essentially jobs of the past that we need expert electricians we need people who can build data centers
174
00:28:27,000 --> 00:28:47,000
and it was so interesting you know I'm a fix a guy and I love that and I'm just always thinking about that and I had it got me thinking because when I was doing my research one of the things that I recommended to people is to think about the data they already have and try to deploy it in a way that will help them measure
175
00:28:47,000 --> 00:29:07,000
and engage ROI and progress and if anybody is like me and has a garage and fix this things and I have sort of redundant tools and I have things my wife so I was like don't you already have that I know I don't know where that is I don't know what bin that tube of whatever is so I just buy it again and my point was that it
176
00:29:07,000 --> 00:29:25,000
has a lot of firms and certainly in corporations and that's why legal operations is such an incredible part of a law department but there's all this data there's all this information there are all these resources and we don't use all of them and I don't know that necessarily you need to rein you need to invest more you just need to sort of you
177
00:29:25,000 --> 00:29:36,000
think where what you have is and what you've done you know has where that's taken you and figure out how you can use that with what you're now investing in to push you forward
178
00:29:36,000 --> 00:29:50,000
I'm doing webinars and in-person sessions on data and data strategy this year and I think it's going to be I can't wait this is there we've had a lot of conversations about data already and it's going to be another year of really starting to learn from learn from people you know
179
00:29:50,000 --> 00:30:06,000
this is what I'm excited about I'm doing a webinar coming up with the leads where we're going to be looking at some success stories maybe get a client on the early stages of just prepping it but you know the more people at the end more end users that we can get on talking about their experiences the better I think you know
180
00:30:06,000 --> 00:30:13,000
like in terms of what can we've done this and this is how and what we've learned and these are the challenges and these are maybe the mistakes wow
181
00:30:13,000 --> 00:30:23,000
Wow Caroline I'm excited for our next time so there's a lot happening here but we'll try to we'll try to chart that change so
182
00:30:23,000 --> 00:30:26,000
boom in change in legal
183
00:30:26,000 --> 00:30:35,000
all right well wonderful to see you wonderful to all of our viewers and our listeners and I'm just overwhelmed with the attention great great
184
00:30:35,000 --> 00:30:47,000
episode thank you I'm sorry bye
185
00:30:47,000 --> 00:30:49,580
(wind blowing)
186
00:30:49,580 --> 00:30:54,580
♪ Yeah ♪