Deal Velocity, Not Billable Hours: How Crosby Uses AI to Redefine Legal Contracting

[00:00] I think lawyers are quite good at learning. [00:02] But... [00:02] in a law firm structure, as much time goes into apprenticeship. It's a teaching hospital. You don't actually spend that much time getting really good at teaching because you just do it through reps and reps and reps and reps. And so actually explaining things is something that I think [00:14] is going to be a very prized skill for not just lawyers, but for any domain experts, but in particular lawyers. And we're seeing it like when you can make an AI do this thing that you've been doing and not enjoying doing. It is like the most magical experience ever. And we're watching that like on a weekly basis. [00:29] Thank you. [00:46] In this episode, we explore a fascinating approach to building services as software with the founders of Crosby, an AI-first law firm focused on legal contract automation. [00:55] Ryan and John share why they chose to build a law firm rather than legal software. [00:59] and how doing the work themselves creates unique telemetry and feedback loops that traditional evals don't capture. [01:05] Ryan and John also discuss their approach to agent orchestration, from paralegal-level routing to senior associate-level contractor view, and share their vision for a Robinhood-like future where anybody has access to high-quality legal services thanks to AI. [01:20] Enjoy the show. [01:22] John and Ryan, welcome to the show. Thank you so much. Thanks for having us. All right. First question may be, [01:28] Kick us off. What is Crosby? Tell us a little bit about the company you've built.

[01:32] Great. So Crosby is an AI first law firm. [01:35] we focus entirely on contracts. So the theory is that we can automate human negotiations, so getting people to agree on terms. [01:43] And the best way to do that is with a contract. Contracts, turns out, are everywhere. They're your lease, they're your offer letter, and they're under most business transactions. [01:52] And it turns out the best way to do this and to automate it is by building in a house, a law firm, understanding how lawyers work and then trying to replace as much of that agentically. [02:01] to get uh contracts closed faster [02:04] Can you talk about the decision to build a law firm versus to build legal software? Because many entrepreneurs in your path, [02:10] not in the legal space necessarily, but have chosen the path to build software companies. Why build a services company? [02:17] So maybe I'll talk about structurally [02:19] why we sort of chose this. And then, John, you can talk about on a more applied level, how we've built the team and how that works. [02:25] So I think structurally, zooming out a little bit, [02:28] You know, the market for legal services has always put a huge premium on human capital. [02:33] And it's in some ways like a VC firm. I think like you're really investing in the people who work there and getting them better and better and better. [02:39] and trying to keep those experts or your partners around for as long as possible. [02:43] And that made a lot of sense where a lot of that work [02:46] was very specialized and couldn't really be offloaded to technology. And there's a growing sense in the last 30 years, but in particular, the last three that's changed. [02:55] And [02:56] You're looking now for a new model that allows you to actually... [03:00] innovate in the kinds of tasks you can offload from humans to technology. And it just has never happened in a law firm before. But all the raw materials are there. The experts that know how to build things are there. But a law firm partnership, for example, doesn't allow you to invest in speculative things like building technology because you can't sell equity and only law firm partners can take loans that are recourse. So it just doesn't work. But we had this theory from a structural standpoint,

[03:25] that if we get the structure correct, and Atrium proved this five years ago, [03:28] um you would start to see really quick [03:31] iteration cycles and the way that you can actually innovate. So that's the theory at least. [03:35] Yeah, and then putting that into practice, I think... [03:38] Having your domain experts sit side by side with your engineers creates such a unique feedback loop. [03:44] where it's more than just evals. It's actually using the product, experiencing it, doing user research, and understanding what are the critical workflows, what are the biggest gaps, [03:54] and actually being able to [03:55] recognize and say from start to finish, it's more than just a benchmark. It's actually an environment to create that opportunity to, whether it's innovate on the specific, how do you review a contract faster, but also the individual bits and pieces of like, hey, is this red line exactly correct? Or is that the right word choice for what we need here? I think historically, people have attempted this. So they've combined some software as well as the services side together. Tell us a little bit more about why some of these previous attempts might not have worked, but also [04:25] Today, operationally, you have AI engineers sitting next to lawyers. How actually does that work? How do you make that successful? [04:33] So maybe on that first part of the question, why [04:36] hasn't this exactly worked before and what might be different now other than the obvious, which is, you know, the state of the art for for AI. [04:44] Um, [04:45] I think it actually hasn't been tried that much. [04:48] And it's an extremely daring thing to do. [04:51] and [04:53] We've seen great innovation in accounting, actually, and management consulting.

[04:57] And when you even look at the corporate entities, fewer and fewer of those entities are partnership structures and they move to C-Corps. And that's a really good proxy for how much they invest in long-term technology. [05:06] And in technology, we've had two or three companies, Atrium and before that, ClearSpire, actually try this in a meaningful way. [05:13] And a bunch of things didn't quite pan out. One was that tight coordination, which I think, John, you should speak more to between lawyers and engineers. And we literally in our office have desks staggered lawyer, engineer, lawyer, engineer in order to get those feedback cycles and to incent them to really collaborate. [05:28] Um, [05:29] And the other piece, [05:31] I think is [05:32] And this is what is truly unique, is that huge chunks of the qualitative, thoughtful work that lawyers are doing each day can actually now be delegated to machines. And this is like, it's hard to overstate how complex that is and how new it is. [05:47] Yeah, and then putting that into practice, you know, I think that means... [05:50] Two things. It means product velocity and it means [05:54] actually instrumentation. How do you think about metrics? [05:56] What we're doing is an operationally heavy business, right? You can actually instrument and think about we get a contract. It comes in. We send it out really quickly. We need to make sure we're meeting things like our SLA, which is measured by our turnaround time. How many human touch points were involved in actually every contract that. [06:13] from start to finish. And if you can actually understand and say, hey, here are all the individual touch points. Here's how long each touch point took. [06:20] And here are the highest value touchpoints we can automate today. [06:24] and just start [06:25] you know, hammering away at those. I think the other thing when you think about product velocity is

[06:30] It's more than just... [06:31] you know, shipping product for the sake of shipping it. It's do these leading inputs actually lead to customer metrics? Because even though this is an operational heavy business, you need to be thinking about what is the end customer goal that we're trying to solve for here. Ultimately, our customers come to us because they trust us and we do high quality contract reviews for them. And, you know, it's companies like Cursor because they're growing so quickly. Like these companies are growing faster than ever before. And we really need to just like be able to meet their standards and their bar of like what excellence and what speed looks like. [07:02] And [07:03] actually taking all this product velocity, these input metrics, and actually converting those into these lagging indicators of like, are we meeting their SLAs? Are we delivering on time? Are we reducing the number of human touch points? And then [07:14] That's actually how you can drive the impact. [07:16] Maybe I'll just add. [07:18] Something that we've only started to like really get our hands around now. I think a year ago when John and I started working on this idea, we had a strong intuition that [07:27] structuring this like a law firm was just accessible for companies who wanted to [07:31] by some sort of AI-enabled service because there's so much excitement and people want to try it. [07:36] But there's something subtle, which is legal services, I think economists call it a credence good, which means that you only know how good it is after you've experienced it. [07:44] and consumed it. And you need an expert to actually tell you the quality. A layperson, or even not a layperson, a sophisticated CEO often doesn't know [07:53] by definition, how good their legal work is. [07:56] So you want to know that a lawyer is looking at it. And so by structuring it as this law firm, I think we're taking the most promising aspects of what AI can do, but still putting all of the sort of right...

[08:09] safety parameters around it and structures of having an expert tell you this is good quality, or this is safe. [08:16] How do you think about innovating on the pricing and packaging layer? Like I think of law as, you know, one of the most... [08:21] interesting for the AI wave because it's one of the most, you know, technology disruptive, but also in terms of pricing model, if you're billing by the hour, making it more efficient doesn't doesn't really help anything, right? And so say a word on how much pricing innovation you're doing. [08:37] Yeah, so this was an early decision that we almost made [08:41] without thinking too hard about it. And then it's just been a constraint, which is no billable hour. And that's like, for us, very dramatic. But it was so obvious that it would be an interesting wedge to get people's attention. And it would align incentives within the company that we didn't think twice about it. And so that looks like today is billing by the document. [09:02] And... [09:03] I think there's a few things to say about that. The first is the billable hour. People have been predicting the death of the billable hour for like 70 years. It only became popular in the 50s. It's kind of novel, but it's just really durable. And it makes a lot of sense for really sophisticated work where it's hard to ex-ante predict how much work it will be. So actually, I think part of what we're innovating on, which we really could not have guessed a year ago, is being able to predict from time zero how long this piece of work is going to take so that we can price it [09:31] and still make sure that we're doing the work properly, that we align with the value that we're giving the clients. And that's where things get really interesting because you have to predict.

[09:40] you know, how many times will this contract go back and forth? We have to look at it five times, three times, two times. [09:47] in order to price the amount of, you know, in order to price the document properly. [09:51] Yeah. So interesting. Yeah. And you've been a lawyer before. When you say you guys are automating legal contract work, maybe just take us through what a human lawyer does today when negotiating a contract. And what types of contracts are we talking? Are we talking NDAs? Are we talking merger agreements, employment agreements, everything in between? [10:11] so many points i could i could go on so they'll cut me off [10:16] So, [10:17] Right now, we focus on NDAs, MSAs, DPAs. I think every tech person will be very familiar with this because you're selling a B2B product. This is what you're dealing with. [10:27] And I'd say NDAs are sort of, from a complexity standpoint, [10:31] you know, a good deal less complex than MSAs and DPAs. It's actually quite a step to get to the MSA DPAs. You know, NDA is two pages, MSA is 15, but they're probably, what would you say, like maybe 80 times more complex? There's just so many more... [10:46] terms to negotiate. And then you can go all the way up to the merge agreements, which is probably 1,000x more complex. [10:51] Lawyers today... [10:53] really try to predict. [10:55] in looking at all the terms in a contract, the right things you should and shouldn't agree to, based on mental models of what's safe and unsafe and kind of having to calibrate for your business. You know, we want to get you to sign this contract. And so some of the clients we're dealing with are signing dozens of contracts a day, right? These are Cursor and Clay and Unify that are growing so quickly.

[11:14] but you want to insulate the business from too much risk. [11:17] And I think so that's what lawyers do. And there's a lot of guidelines and general benchmarks, consensus on like what is sort of market here. [11:24] But it's really like ethereal. It exists in the minds of lawyers and two reasonable lawyers will disagree on what those things are. And this is a subtle last point that I'll just touch on, which is... [11:33] You know, lawyers... [11:34] are essentially these private actors that are building a public good, which is the legal infrastructure, which is all the contracts that ever get negotiated go into this public domain, sort of, of like, what is a reasonable allocation of risk. And so by automating this, and this is where, you know, I think John gets really interested in the generalizing benchmarks, we can start to actually say... [11:54] quantitatively, here's what that infrastructure should look like. Not like here's my best guess of what's a reasonable contract, but like... [12:01] we can actually give you a metric or a statistical [12:05] guess on like, here's a risky or safe bet to take. Yeah, I think concretely taking the vibes and heuristics inside of a lawyer lawyer's head and converting that into an actual probabilistic quantitative number and saying like, hey, how likely should you be to accept Delaware or California or New York governing law when you're in the specific negotiation? I think there's something innately human about that in terms of that agreement. [12:29] But at the same time, there's a lot of market data and you can actually start dissecting and understanding like, [12:33] What are the levers you have to allocate risk in your business? And, you know, circling back to [12:39] what founders should be thinking about as they're thinking about these businesses. Like, you know, which state you go to court in is like, you know, there's only 50 states, thankfully, for now.

[12:51] Extending that into, you know, the long tail of what work you could do. I think it's really easy to confound like PMF of like your customer is asking you to do this thing and will pay you to do this thing versus like being an actual services business. Like you need to actually understand what is automatable. [13:08] what is repeatable. [13:10] What are the specific signals and levers you have to push that automation forward? Maybe let's dig into that. Actually, what what parts of [13:18] even the product today? What parts of it are the LLM or AI model? What parts of it are the lawyer? What parts of it are more workflow software? And how does that change over time too? [13:28] Yeah, I think... [13:29] It's been so interesting in the past, you know, five, 10 years, the amount of investment. I'm sure you guys have seen this firsthand. So I'd love your take on this, too. Like the amount of investment in NLP research. It's just like, you know, problems that were. [13:43] state-of-the-art five years ago are now like warm-up problems in a Stanford freshman year class. And I think it's just been so... [13:53] interesting to say like okay this is what tools we have available to us now and [13:58] In terms of zooming back out into the specific models and what we can automate today, [14:02] You know, it comes down to context. [14:04] When AlexNet and all the first models were starting to do image classification, you had a [14:10] a picture of something and you try to classify it, all you needed was the picture. [14:14] Now you start thinking about like you're looking at an MRI and you're trying to classify it. Well, you're looking at the MRI, but you also might get some additional context from maybe the patient's history and some other metadata about the patient.

[14:25] I think language models are now taking that to the extreme. [14:28] The language models say basically, give me as much context as is necessary to understand this problem and make some type of decision on it. And to answer your question around the workflows versus the language models today, it starts with how can you context engineer for a human lawyer? Right. How do you give all the right tools and these building blocks? [14:48] to expand what's available to the lawyer and actually automate their manual workflows that they were doing. [14:53] Once you have those building blocks, then it becomes a question, okay, what are the parts that a lawyer is doing that you can now align the language model with and say, hey, how accurately can you replicate that? [15:03] what behavior? [15:04] this human is doing. And I think [15:07] My hot take here is I think everyone focuses on these general, like, you know, reinforcement, like RLHF and all these general purpose, like aligning it to the maximum amount of data available. Yeah. [15:20] Really what you want to do in some of these specific scenarios is align it to a specific person. [15:24] Right. Because like Ryan said, like even getting two lawyers to agree on one specific contract. [15:29] may require a lot of back and forth intention, even if they work for the same firm. And if you can actually align it more accurately with one individual, [15:36] you can start to say, like, this is correct, this is wrong, because that person is internally consistent, even though two people might disagree on that. So you would have almost individualized models for each of the different lawyers? Is that kind of the scenario? So I think the two theses here are, [15:53] I think also fundamentally people are not thinking about per customer evals or per customer fine tuning enough.

[15:58] I think per customer fine tuning and evals are a really high ROI way, especially if you have a large ACV, to make your product reach multiple nines of accuracy. [16:09] One of the dangerous traps of language models today is they get to 90% for basically free. The foundation models have done an incredible job, and we love our partners at OpenAI, Anthropic, and Google for giving us such wonderful tools. [16:22] But one of the dangers is they get to 90% and getting them to 99 or 99.99 is actually extremely difficult. [16:28] And part of all the levers you have are thinking about, like, what are the ways I can adjust these prompts per customer? [16:33] What are the ways I can fine tune this model per customer? [16:36] And then you can actually deliver, you know, not just a four star experience, but a five star product experience, because really that's what you're trying to achieve at the end of the day. [16:43] But I would be curious for your guys' read in terms of like the amount of... [16:47] you know, the investment for the language models and how you've seen it shape in terms of like these per customer, like these more enterprise focused. [16:55] verticals? I think it partly depends on what data is actually in distribution for them, because I think whatever data is in distribution, they will [17:03] I think they are continuing to improve at a rate where they will probably get there very, very far. [17:08] versus [17:09] I think if your point is for a certain enterprise, most of their data, the really interesting data for the contracts. [17:15] you will never have access to as a foundation model company and we could get access to [17:21] individuals specifically, and I can create more [17:25] like RL to fine tune model for you that understands your context. Like, I think that makes sense because it is data that is not in distribution for the large model companies.

[17:34] I agree with that. [17:35] Good take. [17:36] You guys have some very discerning customers. I think I heard Clay and Kursar mentioned. Tell us about what they like most about you. Is it that you're smart AI people? Is it that you can turn around the contract extremely quickly? Is it that you can turn around the contract quickly? [17:52] Cheaper than somebody who's not using AI? Like what is the customer facing value problem? [17:57] Um, [17:59] For these companies, we've really crystallized this over several months. [18:03] It's [18:05] Deal velocity. [18:06] and [18:08] What we think a lot about is [18:11] just the acceleration of startups today and everything is going faster, right? The sales motions are going faster. I mean, you look at Clay, right? Like they're, you know, enabling sales teams to move that much faster. The way that you hire everything and contract negotiations, which is like the sort of critical piece, [18:28] It literally is the sort of way you plug in with your customers. The API for business is what we call it. [18:33] It's kind of unchanged for 40 years, basically since the word processor came out. [18:37] And so this idea that we can unlock speed in two ways, from the time that they send us a contract to the time that they get it back. This is typically the AE or the salesperson. We're just unlocking their speed that they get back to their client. Or also doing reviews in a more thoughtful way so that rather than doing five or six back and forths, we can sort of predict, okay, if we just agree to this term and only push back on these three, we're going to save one turn. So this will be a whole week faster. These are the main things.

[19:07] What's kind of interesting is... [19:09] As John was saying, quality and taste are these somewhat intangible things that are threshold questions for these kinds of agreements. You have to hit some reasonable amount of quality. But I think most great lawyers, the GCs that I really admire and spend a lot of time with, understand their job as business drivers, and they are unlocking the growth of their companies and they position themselves that way. [19:31] And so that's the key. [19:33] And [19:34] Structuring ourselves with lawyers in the loop in a really clever way. [19:39] allows us to have the oversight of lawyers and kind of all the safety and the quality, as I mentioned before, but see how much we can really push the limits on. You know, right now we do a contract review and median times are a little under an hour. [19:51] Can we get that to minutes? Like we're still having making sure the right terms get in front of the right lawyers at the right times. And these are like the fascinating questions. [19:59] And what does it take to get there, you think? Like what needs to happen for it? [20:03] for that to be possible. [20:05] So, [20:06] I think what's really nice, and I think the reason why John and I were so excited about doing this interview together and why we typically are speaking together is we had this really unique marriage of, you know, technical expertise. [20:15] really understanding the cutting edge of AI as much as I love Chachibiti and what lawyers are really good at. And what's interesting is when John and I started working together, I don't know if this is a fair call out, John was constantly asking for evals. And I was like, that's fine, we'll work on this, but I can look at it in 10 seconds to tell you, right? Just put it in my hands. And lawyers have a very visceral sense because it's taste-based based on their training, based on their risk profiles, which is a little unique to each client, just immediately what looks good. And so the more we've been able to get

[20:43] you know, prompting tools and actual sort of input and outputs in the hands of the lawyers that we have at Crosby, it's amazing. Just like it's just it's just velocity. Like we had we actually hired more engineers and lawyers at the beginning and we were sort of. [20:59] I felt like a little bit like we were sort of revving the engine a little bit without clicking to gear. And then lawyers came and it was like we stepped into gear. They just had people to give them like all the inputs of no, no, that's like right. That's sort of we should go that direction. [21:10] So that's like a sort of structural thing in terms of what it takes to get there. I do think... [21:16] that because lawyers provide almost an insurance to make sure that an expert said something looks good, they'll always be in the loop for a lot of types of legal work. There are like, and you know, I can get into hot takes on what kinds of legal work is going to be fully automated. [21:29] But I think the key here is knowing exactly when to escalate something up to a lawyer and to get their thumbs up and to know that that liability is covered. And right now we have malpractice insurance. We take liability for all the work we do. I don't think we exist as a business if we don't do that. That's the key here is we have to be so certain about the quality that we're able to [21:46] to stand behind it. So cool. [21:48] Can you give us a peek at what's happening under the hood on the technology side? You mentioned, you know, you have three beloved foundation model partners. Like, what are you using each of the different models for? And what scaffolding have you built on top? [22:00] Yeah. [22:01] I think. [22:02] What we found is the state of the art is not specifically tuned for contracts because there's not enough data in the corpus out there. Yeah, diversity of data is like bitter lesson. Even if it's just for the legal domain, you want models that are trained generally. And these contracts are so hidden away. The best data set is Edgar. It's when you attach SEC filings and that data has just been transferred.

[22:26] It's so overutilized and doesn't apply to these small. So, yeah, it's been an issue. I think the other part is in terms of infrastructure, really constantly, like Ryan said, benchmarking this with all the environments we set up for these agents to understand what they're good at, what they're bad at. [22:42] And bringing that back to that quality score that I mentioned earlier, this is why I think every team needs someone... [22:47] both the domain expert and... [22:49] the engineer. And I think this is why we'll see more of these vertical AI startups is because having that person in-house gives you such a competitive edge rather than maybe buying a data set from a large company that outsources a lot of like labeled data to contract lawyers or things like that. And then in terms of like, so, you know, [23:09] the way it's set up today. [23:10] We have lawyers. Most of them have big law experience and are pretty proficient in these kinds of agreements. [23:17] who are driving, right? And so they're seeing, and this is what's quite interesting, and to John's point, like the subtleties of the ways you change language within a contract [23:26] or something that AI [23:28] And seems to struggle with a bit more than we'd imagine. So John and I like to joke the difference between the term commercially reasonable and reasonable are actually substantively different things to a lawyer. They look very similar in the betting space. But these are the nuances you really have to pick through. [23:42] But what AI is amazing, so you have lawyers sort of driving there and really measuring, kind of intervening for the quality on actual edits to a contract. But AI is great at summarizing, right? So being able to predict the right comment to make, to explain a change. [23:56] Interesting thing we learned about May.

[23:58] If you can give a really thoughtful explanation as to why we can't accept this language or we really are pushing for that language, the counterparty will sort of understand what you're getting at and accept it. It reduces turns, right? So it's worth investing in AI to explain what you're doing. [24:13] Another thing we realized is this is actually very specific to a company. These aren't legal questions. This is like, you know, some of our clients are not super sophisticated, but you have to understand the fundamentals of the cursor IDE or the fundamentals of how Clay, you know, uses... [24:27] sales data, it's just like to, if you're a procurement person to know what you're buying. So this all and this happens in the contract, right? And so you can unlock a lot of speed for lawyers to feed them all this data in the right place at the right time in the right parts of the contract. [24:40] And these are huge unlocks. [24:43] As the client experienced it, it just feels like we've made it super natural. You just, I mean, by that I mean very natural. You know, it's right in Slack. You just tag Crosby. We've made a big bet on Slack, I think, more and more apps. It's just so easy to use. In Tag Crosby, you set up the document, you get it back, you know, within a couple hours with some thoughts, with some comments, and with an explanation. [25:02] And so we've built quite a bit on top of that. I think email is the other obvious choice. [25:06] But we didn't want any interface. We just wanted to feel like you're talking to somebody who's looking at this for you. And yeah. [25:14] Circling back to the point on infrastructure, [25:17] you know, getting an agent to be really good at NDAs and MSAs and DPAs and all the, like I said, coming back to the point around the long tail, you really want to one, give agents really good tools and then two, give them really good context and make sure they're trained and set for a specific task. And when you're thinking about the specific task, you're going to be able to do that.

[25:37] whether that's an NDA agent, [25:39] for cursor. [25:40] and making sure they're set up for success and actually able to review those contracts really, really quickly. [25:46] Today, [25:46] We've basically built a paralegal agent. [25:49] which is like in charge of routing all the work from like, you know, that comes in from our customers in the same way that a paralegal would at a law firm and then routes it to a human lawyer and make sure the work is assigned effectively. [26:02] The next step is like, how do you think about a junior associate, a senior associate, [26:06] and a junior partner at a law firm and think about like actually replacing these roles in that way and the actual specialty jobs that they're focusing on. [26:14] Makes sense. [26:15] Do you have any favorite workhorse models? [26:18] I really like... [26:20] chat gbt5 [26:22] I don't know. That's a hot take. Me too. My teammates make memes for me about it. Why? Say more. [26:29] I think it's actually been pretty good in terms of the thinking and pro models for some legal tasks. And Gemini 2.5 Pro has been really good at legal tasks as well. [26:40] Super interesting. Do you think that the path to the promised land for you will be kind of RL tuning to each individual law firm and lawyer? Or do you think it's going to be prompting, like, any... [26:51] any religion or any gut instinct on what the kind of, [26:55] what's going to take you to the promised land for automating these contracts fully? [26:59] Well, I think, like Ryan said, [27:01] The thesis is how do you still keep that human touch for like psychological safety? [27:06] I think the promised land comes from really good context engineering and providing it to the

[27:12] Right. Because what great product counsel do and what great commercial counsel do is keep just a ton of information in their working memory about here's how this company works. Here's the background on this specific playbook. Here's how this NDA last time went when we negotiated against this company. [27:28] Loading all that into the working memory is going to be really important. [27:31] I think... [27:32] I'm really optimistic about a lot of these reinforcement learning techniques. So reinforcement fine tuning was something we experimented with early on for comet generation, like Ryan mentioned, and have experimented it with it for a lot of other opportunities as well. And so pretty optimistic there. [27:46] My take is like, let the lawyers cook, you know, get them writing prompts. [27:52] Do your lawyers cook? Say more. [27:54] Yeah. Are they writing prompts? We speak to so many lawyers, you know, who are like... [27:59] all I hear about is AI. I want to learn more. I'm curious. I want to be part of it. Yeah. Yeah. And, you know, you're like... [28:07] Have you used it before? No. And we're like, okay, how's this going to play? [28:10] And they're like, it's like, it's like the look on their face. We have, I'm thinking of one lawyer particular team, the look on her face, the first time she saw some of the tools we were doing, and she's just like, like, the lights turned on, like, it was so it was so neat. And so like, to get them access to like, actually like write prompts, give instructions, teach all these things that are like in your head, but you wouldn't even know how to explain them to someone. [28:33] And it's actually quite complicated to like try to tease these things out and explain them. I think lawyers are quite good at learning. [28:39] But... [28:39] in a law firm structure, as much time goes into apprenticeship. It's a teaching hospital. You don't actually spend that much time getting really good at teaching because you just do it through reps and reps and reps and reps. And so actually explaining things is something that I think

[28:51] is going to be a very prized skill for not just lawyers, but for any domain experts, but in particular lawyers. And we're seeing it like when you can make an AI do this thing that you've been doing and not enjoying doing, it is like the most magical experience ever. And we're watching that like on a weekly basis. What's the coolest thing a lawyer has created? And maybe just like describe how you even create a culture where lawyers... [29:14] are prompting themselves. You know, they're actually playing with this themselves. So we... [29:19] like i'll give a big shout out like i like we have to give kudos to harvey for building a [29:23] building like such a center of gravity to show that like lawyer that you know they invented this job title i think called [29:30] um applied legal research which is brilliant and like that is what lawyers are doing they're right and um [29:37] you create this culture that really praises that. You know, it doesn't just praise... [29:42] You look at lawyers at law firms, they're measured really on one vector, which is hours built each year. [29:47] And so we give a lot of public praise for... [29:50] being [29:52] sort of meta aware of the work you're doing and trying to measure it out. So we have one lawyer who like, you know, kind of mentioned he thought we could be doing things better. And I said, tell me a bit more. And a week later, he built this, like, I taught him Miro, which was like, a huge aha moment for him. And he made this huge process map that like, it was like, we have to get it printed professionally. It's so big. And like, it was one of the best moments for all the engineers. But like, we were so excited about it. And so we created this culture, like we really

[30:22] We're doing a lot of repetitive, the same kinds of work, but there are ways that we can just like step out of that and think bigger. And so we're really, and so you really incentivize lawyers again, because your incentive is to get the TTAT, the total review time lower and lower to be the ones driving that. And so it's been neat. And, you know, there's so many other things that we're just beginning to scratch the surface of like organizational design, structuring your team so that there's both lawyers and engineers all towards the same outcomes. And so they all have to collaborate together. But these are the keys and these are the really hard things. [30:51] Can you talk about New York? You're building an AI company in New York. That is contrarian. Tell us more. [30:57] It's not contrarian to us. [31:00] I think... [31:02] The New York tech scene has gone through a lot of different arcs. [31:07] the first arc of, you know, the early 2000s, a lot of these ad tech companies that were emerging after, you know, the dot com dot com boom, where, you know, [31:17] these like AppNexus and all these other companies that have just exploded. [31:21] And then there was a second wave of all these deeply technical engineers that came out of these ad tech companies spinning off and creating these more dev tool, like MongoDBs of the world. In parallel, there were a lot of also training firms in New York. So you can think of the Jane Streets, the HRTs, the Citadels. [31:39] So the New York tech team had this as like its base framework. [31:43] What happened in the last five to 10 years is a lot of, you know, more and more senior engineers were coming out of those places to the point where a lot of what building a startup is about is actually knowing what a great growth trajectory looks like and understanding how do you not just go from like one to 10, but zero to one. And so these were great breeding grounds.

[32:02] We've seen a ton of companies start spawning out of like these, whether it's in DevTools and DevX or thinking more, you know, I think a really great example is Ramp where, you know, [32:12] I remember... [32:14] one of the first Kareem told me the story about how they had a YC company was called Paribus. [32:18] And it was based in New York. They said that I think they might have been the only YC company in New York. And... [32:24] 2013 or something like that. [32:26] The reason it's so interesting is because they had a candidate who applied, extremely talented developer, incredible resume. They asked him, why did you apply to work here? And he said one simple reason. I filtered by New York City on YC and you were the only company there. And so we've come a long way since then. I think, you know, Ramp has been just an incredible place. And there's many other companies in New York now coming out of that as well. I think where you can take a lot of great young talent. [32:56] teach them right from these people who worked at these places like AppNexus and all these other places of like other startups that have scaled. [33:04] apply those learnings and create a truly generational company like ramp is. [33:08] There was an interesting survey. I think Pat talked about this as well, or you might have mentioned it, where there was a survey from NIO or someone else where. [33:15] Most new grads wanted to be in New York in 2021, 2022. [33:20] And it's so interesting where if you just follow that as a leading indicator of like, where do all the really smart, hungry, high slope, [33:29] you know, young engineers want to be. [33:31] And I think that was New York. Yeah.

[33:33] It also allows you to break out of the AI echo chamber a little bit and do things a little bit differently. And just hearing how you guys speak, it is, you know, it's refreshingly first principles. I do think like we, you know, we're probably here every few months for various reasons. And I feel like we come here to dream. [33:51] And then we go back to New York to build. [33:54] And [33:55] And like in the subject matter expertise there is so dense in finance. [33:59] in the creative fields, healthcare, healthcare and law, obviously in law. [34:04] Um, [34:05] And you sort of distill like all the really crazy ideas. Like you come here and you're like, it's not AGI, it's ASI. Like you learn all this, right? And then you go back and then you really apply it. [34:15] And you sort of like, you know, like the water goes through the sand and it comes out with something that kind of just works. And that's been really special to be part of. Yeah. And I think for us, really, you know, taking these domain experts with really, you know, [34:27] deep expertise and combining them with these like high slope new grads, as well as these people who are like either experienced founders or want to be founders again. Our entire founding engineering team like is all either previous founders or wants to be founders. I think that mentality is really what it takes because in some ways, like Ryan said, you're like building these pods and like these, you're working with one or two lawyers and your customer is sitting right next to you. It's like such a unique opportunity in terms of like the amount of dev cycles and like product loops you get. [34:57] I mean, I think your name itself kind of... [35:00] echoes your your like tie to New York. Maybe tell us a little bit about the story of the name.

[35:05] Well, [35:06] There's a lot of myth and a lot of lore over the name of Crosby. [35:10] One of the myths. [35:12] is that John and I were going these long searching [35:16] existential walks back last summer through Soho. And we kept finding ourselves on Crosby. And it's a beautiful old street in a very modern neighborhood. And it kind of to us spoke about being an essentially New York company that has all the best artisanship of the old and all the modern steel glass of the new and it combines it nicely. But that's just one it could be after the hockey player. [35:36] Also. Could be after the hotel. Could be anything. Our office manager's dog was named Crosby. Really? Yeah. Her dog. Maybe tell us a little bit more also in terms of [35:46] just having built in New York, like, [35:48] What? [35:49] What is different about the company culture, actually? Like, how do you think it is distinct from a typical AI company, maybe here in SF? [35:56] I do think I I don't know why this would be a New York thing, but I'm seeing it more and more in some of our friends, companies, other Sequoia companies in New York. [36:04] there's a huge bias to starting things. [36:07] to being founders. [36:08] And the way that we've been able to convince people to join us is by saying this will be your stepping stone for four or five years. [36:14] And we have to live up to that, by the way. Like, it's actually not it's like it's not trivial. We have to make sure that like when we get invited to a founder dinner, we send someone else in our stead, which I think annoys people, but it's pretty awesome for them. And but but what's interesting is in this type of company, which is a lot of these on the application layer. [36:30] As John mentioned, you need that level of autonomy. [36:33] and agency and creativity of that mentality of like, this is my thing and I'm going to figure out how to build it with my pot of lawyers and I'm going to solve this and then I'm going to come back.

[36:43] I don't know why, but we keep seeing more of this. I do think Ramp's a big part of the story. I think Ramp has become a founder factory and... [36:47] sort of culturally that permeates all throughout New York and we feel it. [36:52] So I'm actually like really excited and I'm curious to watch the next four or five years of like all of these kind of like the next the next wave of folks coming out and starting things. Yeah, I think one other uniquely New York thing is just the emphasis it feels like on design. You know, Ramp is a product that's really prided for its like great design and product taste. I think a lot of that can be traced to just the depth and creativity levels that these design agencies and other great firms do. [37:17] One last thing. [37:18] People in New York like pizza. I feel like it's really hard to get a proper New York slice for any slice in San Francisco. That's how we celebrate it. That's how we celebrate it. Pizza. So we have real two pizza teams in New York. Not like Domino's teams. Yeah, yeah, yeah. No, very real. Okay, we need the hot takes. What type of legal work is going to be completely automated? [37:38] So legal work. [37:40] Thank you. [37:41] There's about 11,000 law firms, which account for 8% of all law firms in the US that account for about 75% of revenue. [37:48] Still a lot of law firms. [37:49] But there's this huge tale of these other 92% that make up the rest. And those 92% focus on individuals. [37:57] helping you with child support payments and leases and like all the sort of human things. And they're like horribly underserved by lawyers. It's almost... [38:09] immoral. And we talk about all the time in law school. [38:12] And everybody has really lofty dreams to kind of do something about this. And it's not really being touched. And

[38:18] Um, [38:20] I think this work will be automated [38:23] entirely because the alternative is nothing and i think and i just and like we'll have and like in like i suspect that [38:31] Anybody right now can negotiate a landlord kind of lease with ChatGPT today. And I think a lot of people do. [38:38] I think that the corporate law firms, [38:41] are here to stay for quite a while. [38:43] And [38:44] those jobs are quite safe. So it's like sort of a net new type of legal skew that's going to be totally automated. [38:50] But it's not that we're taking a lawyer's job and automating. It's just nobody's doing it today. It's net new market creation. Totally. Why isn't it just ChatGPT that does it, though? I already kind of turned into it for legal advice. Maybe a bad strategy. I think for a lot of this work it is. I think, again, the alternative is nothing. The alternative is having nobody look at it. [39:08] and [39:09] My hope is that if you can add so much leverage to lawyers, [39:12] that like you know rather than looking at two contracts an hour they can look at 500 [39:17] Like, shouldn't we be able to have more and more people getting serviced like that? I think when we talk about the our mission of Crosby is very lofty, it's building a better legal infrastructure with technology. This is what we're talking about. This is like just so leveraging the lawyers that we have. [39:31] Um, [39:32] It's an optimistic hot take. I think it's the golden age for what lawyers are going to be able to do in the next 5-10 years being unlocked by this. [39:38] Love that. [39:39] Do you have any Northstar metrics that you run the company on? [39:41] Yeah. [39:43] We run on total turnaround time, which means... [39:47] Time in the time out.

[39:49] How long does the contract take across all of the back and forths? So like Ryan said, you know, a contract negotiation might have... [39:57] five back and forths or two back and forths. [39:59] If you add up all the time that Crosby has spent looking at a contract, that's our North Star metric. [40:06] And that's very counterintuitive. [40:08] Most law firms are [40:09] not trying to maximize that number, but like that's how they earn their billable hour. [40:14] For us, it's about aligning incentives. We want to not only do a faster job on each individual turn, [40:21] It's also about [40:23] How do we do a better job? How do we understand the right negotiation levers for the business? I'm sure you all have negotiated your fair share of term sheets that are really high velocity coming back and forth. [40:34] So for us, it's really thinking about like, how do we minimize those back and forths and also get faster every time? How do you make that incentive align for your customer? Like if you go back to the term sheet example, the fastest way I have of getting a term sheet signed is to increase the post-money valuation. So like, how do you make sure that, you know, you're not giving on your customers negotiating leverage in order to kind of maximize that North Star? Exactly. It comes back to guardrail metrics as well. And so we really pride ourselves. We have, I think... [41:03] One thing that most startups that think about these vertical AI opportunities is they should have some type of team focused on either environments for their AI agents or quality metrics for their agents. [41:15] And the reason that matters so much is because it's very easy to get misaligned incentives of like taking shortcuts or doing work that's like halfway there.

[41:23] We have people on the team, both lawyers and engineers, only focused on how do we make sure quality is consistently meeting our customers' needs. [41:32] And that means [41:33] not just doing good legal work in an objective sense, but also, hey, [41:37] Is this aligned with our customer's risk profile? Is this... [41:41] in the best interest of the customer's negotiation and distilling all that down into a guardrail metric. [41:47] Combining that with the total turnaround time we call it T-Tat. And then I've learned that also from Ramp, you know, if you have pithymetrics that you can really like rally behind that are fun to say, it actually does help. Just because people start. Yeah, we just came up with it, you know. [42:04] at one meeting and now the entire office, we just go around saying TTAT. We also called this other metric, it's called HURT. [42:11] which stands for human, H-U, review time, R-T. And so we're also trying to reduce the amount of hurt. I like the punniness of this. And I think... [42:22] It's funny because I think metrics, you know, you can talk about them from a product perspective, but there's something very innately human and you want it to feel empathetic, right? Like reducing hurt feels more value aligned with... [42:33] how our lawyers should feel and also the same way like quality is so aligned with what our customers are expecting from us. [42:39] I think one thing maybe I'll add... [42:42] The other ways that you have to increase leverage in a negotiation, in a fundraise is... [42:49] like set deadlines, like increase the pressure. Like there's a lot of ways.

[42:53] And. [42:55] I think contracts are so interesting because they're so human. Fundamentally, it's just like [42:59] an abstraction of a human to human conversation about like, what can we agree on? [43:04] And so last summer when we were kind of researching the idea, I'd actually spent time in India. John shared the story countless times. And there's a lot of offshore legal services that do sort of back office, very routine contract negotiations for Fortune 500 global companies. [43:20] And they just take five rules and apply those to a contract and just kind of go back and forth and like negotiate against them. It's like negotiating against the wall. They just, you know, they kind of don't get creative. But this one guy and I said, so like, what do you do if you get stuck? [43:31] He's like, I have this really creative thing I do. I just call them and tell them that they're not going to want to say no to this company. And we have a really long life and we're going to want to interface. And I was like, are you allowed to do that? He said, I don't know. I just started doing it at works. Like, it was so human. And it made me so... [43:45] appreciative of the human element of these back and forth. And so I do think like, [43:50] We're unbelievably optimistic about how much time we can reduce and how much more efficient we can make the transactions between customers. [43:58] entities. [43:59] But also there's an essential role for those counterparties to have in interfacing with each other to meet, to have what we call meeting of the minds, right, to really get to agreement. Totally. And at the same time, I also wonder if we had an AI agent with some type of reinforcement learning, if it just would reward Hack and realize that picking up the phone would 100% convert if I give it a tool call for phone calls. But... [44:21] Who knows? Well, how do you think this plays out, though? Let's say-- I imagine your agent has never negotiated against another one of your agents before in the field.

[44:29] Eventually, I'm guessing people will have their agents negotiating and DAs on both sides, right? I think this is the most beautiful essence of what we hope we can achieve here is being able to [44:40] capture each party's preferences with their own sets of agents and have them simulate the negotiation. Yeah. And be able to show an auditable record of here was the first back and forth and then the fifth and the seventh. And here's where we netted. [44:52] And what do you think? Is that reasonable? And that's your starting point. And these are fundamentally collaborative negotiations. These are not adversarial negotiations. [44:59] And so the goal here is actually to be the collaboration platform to get people to agreement faster. [45:05] So interesting. [45:07] So each agent will kind of have a sense of everyone's risk preference, their bottom line, their tolerance for waiting out the negotiations. And I want the agent that's going to like bang its hand on the table. Yeah. And like that's the one that you're only going to spend more compute on. The high inference agent. Yeah. And yeah, I think fundamentally, you know, partitioning the data, making sure like this agent doesn't have access to the other agent's data and making sure like. [45:31] It's just really taking what law firms have already figured out of like you. [45:35] you know, set up a wall between different teams and say negotiate against each other, you can apply that. [45:40] even in an easier way in a system setting because you just don't need the agents to talk to each other unless [45:45] through their specific guardrails. [45:47] Great. I'd love to bring it home by asking a bit about the future of how you guys see Crosby and how you see the legal industry playing out. What do you think the legal industry looks like in 10 years? [45:55] You know, I think... [45:57] Coming back to the point on taste...

[46:00] increasing the leverage of these senior partners at law firms, I get a little worried about the junior associates and the paralegals and the opportunity for them. I can imagine it just looks like a senior associate managing an army of agents who can increase their leverage. Maybe for a personal injury firm, it's managing intake and someone managing actually drafting the demand letters and then actually reviewing them. [46:26] the main job of the person is to show up in court and everything else is handled by an agentic system. [46:31] but I'm curious for your take. [46:33] Alright, I'm gonna try to do this quickly. [46:34] In the 10 year period from 2007 to 2017, [46:37] In-house legal teams grew 200% and law firms grew 30%. [46:41] And then again, from 2014 till 2024, they went from about 320,000 to 440,000. In-house teams are really, really expanding. [46:48] And the narrative seems to be [46:50] that legal work is getting more complex. [46:52] and companies need much bigger in-house teams. [46:54] And in-house teams have a lot fewer constraints than law firms. They can have not just lawyers. They can have paralegals. They can have legal operations. They can have... [47:02] different types of work specializing [47:04] And they've become really creative. And it's this kind of huge change that's been going on quite quietly. [47:09] My hope is that... [47:11] you know because these are not companies that specialize in legal services these are just you know this is the legal function [47:16] You'll see more and more specialized companies that are AI first because it's just so obvious. [47:21] that are truly changing the way [47:24] legal services get delivered [47:27] We are like a small part in this. And I'll go back to what I said. This is the golden age. I think like this is like we've never seen true innovation in the legal market.

[47:35] And we're just at the beginning. I think things are going to look very different. [47:38] And maybe given that future, what should somebody in law school today do? Should they drop out? What should they be doing? I think – [47:46] This will go back to the fabric of our company. [47:48] I think you want to question absolutely everything. I mean, like question the way your professors tell you to write footnotes. Like, is that really necessary? Question all. There's so much dogma. [47:57] And then balance that [47:59] Like, it's so fragile. [48:02] with understanding the brilliance of legal academia. This is what makes society run, [48:07] professors, my professors at Stanford truly are some of the best mentors I've ever found and some of the smartest people. [48:13] And so don't be arrogant, but question everything. [48:17] and come [48:18] Take time and do an apprenticeship with Crosby. We'll teach you how to prompt. But like it's important. Like these are the skills that I think are really going to matter is how to [48:26] harness all the power of AI. And there's so much room to change things and there's so many [48:32] Things are accepted as just facts that can all be permeable, and it's hard to see when you're in it. [48:37] Yeah, I think. [48:39] I won't say which company, but... [48:41] I went to a conference. It was all general counsels. Imagine Fortune 500. [48:46] I won't name the conference because I would like to go back. But I sat next to this gentleman. He was the general counsel of a very large telecoms company. [48:55] Maybe one of our phones runs on this telecoms company. [48:59] And I said, hey, have you like ever tried any of this chat GPT or AI stuff? And he said, no, of course not. My CEO keeps telling me to. I refuse to.

[49:07] I do not want to try it. And he's just, you know, [49:11] I think to Ryan's point, like... [49:12] There's arrogance on both sides of like, you know, questioning everything, but also like, you know, being stuck in the old ways as well is dangerous. [49:19] Makes sense. Well, I think question everything and try everything seems to be a good thing for all of us. [49:24] Thank you guys again for coming on. Appreciate it. Thanks for having us. It was really fun. [49:28] Thank you. [49:52] Bye. [49:53] Thank you.