Building Legal AI Agents Without Seeing Client Data: Legora's Jacob Lauritzen

Legora's CTO explains how its team evaluates legal agents, designs review workflows and builds around the confidentiality of client matters.

JLJacob Lauritzen게스트 · Legora
채널
Latent Space
게시일
2026년 11월 2일
영상
1:07:22
읽기
12분
원문
영어
YouTube에서 열기
스크롤하면 영상이 오른쪽 아래로 작아져 계속 재생됩니다. 자막은 읽기 언어를 따릅니다.
읽기 언어2개 언어로 읽을 수 있음
이 글은 아직 한국어 번역이 없어 영어 원문으로 표시합니다.
요약

30초 요약

Legora CTO Jacob Lauritzen joins swyx and Basil Chatha to discuss how legal agents have evolved from research assistants into systems that help coordinate work. He explains model routing, evaluations built around simulated legal projects and the difficulty of improving a product when customer traces are confidential. The conversation examines tabular review, forward-deployed teams, citations and long-document reasoning, as well as Lauritzen's tentative predictions for legal work and business models.

  1. 1Evaluate a complete legal projectLegora builds simulated data-room scenarios and evaluates both the identification of red flags and the quality of the resulting report.
  2. 2Improve a product without seeing tracesLauritzen says client confidentiality generally prevents the team from inspecting actual matter data, so it relies on constrained signals and representative evaluations.
  3. 3Review documents in a tableRows represent documents and columns represent questions. Users can inspect a small sample first and trace results back to their sources.
  4. 4Two kinds of customer-facing expertsLegal engineers configure and teach workflows, while forward-deployed engineers build integrations and production capabilities when needed.
  5. 5Make claims traceableCitations can point from a generated claim through a table cell to the underlying source, supporting human verification.

핵심 정리

  1. Use realistic legal scenarios and expert review to evaluate separate stages of analysis and drafting.
  2. Protecting confidential client matters constrains observability, so teams need safe signals and customer-approved examples.
  3. Test bulk extraction on a small sample and provide citations that let lawyers trace results to source documents.
  4. Choose models by task, balancing quality with cost, latency, governance and regional availability.
  5. Reusable lists, agents and document workflows can support many customized legal applications.
  6. The future of legal roles and firm economics remains uncertain even as individual tasks become easier to automate.
전문

챕터별로 다듬은 전문 읽기

원본 자막만 보기
01

From legal research to agents

Lauritzen traces Legora's origins and its expansion from finding legal precedent into drafting and coordinating work.

Legora CTO Jacob Lauritzen joins swyx and Basil Chatha to discuss building AI tools for lawyers. He describes the company's Stockholm origins as a persistent underdog story: entering the US required its team to become more comfortable telling customers what it had built.

Legora began as a ChatGPT-style interface with a Swedish law search tool. Legal research meant finding relevant earlier cases and precedent; the product has since expanded into drafting, editing Word documents, organizing files and conducting more complex analysis.

One expansion is tabular review, which extracts information across large collections of agreements. Another is orchestration: lists organize work, while intake and portals help lawyers, clients and agents collaborate. Lauritzen sees the opportunity as both doing legal work and improving how that work moves between people.

The team describes its transition from an assistant to a more capable agent. Lauritzen places that change roughly a year before the interview; the hosts note how quickly the field has moved. Legora was in Y Combinator's 2024 batch, while Lauritzen had participated in 2023 separately.

02

Model selection and evaluation

The team routes tasks across models and evaluates realistic legal projects with engineers and lawyers.

Legora uses different models for different tasks. Users can choose the agent's primary model, while individual tools may route subtasks elsewhere. Lauritzen says the team resisted adding a selector, but some customers wanted the control and access to new models even when the additional capability might not be necessary for a given task.

The hosts frame a domain-specific agent provider as an intermediary that follows the model landscape for its users. A lawyer should not have to decide which model tier is right for every contract. Lauritzen wants to balance quality, cost and speed, although he acknowledges that some users still want to experiment themselves.

Lauritzen estimates that current systems can handle roughly 60% of legal work well, leaving cost and latency as important constraints on that portion. More complex analysis still needs greater capability, in his view, and better systems may also expand the work lawyers choose to undertake. He offers the figure as an estimate, not a measured industry benchmark.

Delegating retrieval to subagents is one area he says has improved. Legora tracks model performance across legal practice areas and tasks in a heat map. New releases often improve overall, he says, but can also regress on particular tasks, making it useful to test them rather than assume every change is an improvement.

For evaluation, the team constructs scenarios that resemble legal projects. A simulated due-diligence data room might contain 10,000 files and require a report identifying particular red flags without introducing irrelevant claims. The team can evaluate the quality of the analysis separately from the clarity and completeness of the drafted report.

The dedicated evaluation team combines engineers and lawyers; Lauritzen says it then had about three of each. It can also draw on a larger pool of legal engineers, typically lawyers with large-firm experience and an interest in technology, who use the product and talk to customers. They help shape both product development and evaluation.

Earlier, the team often benefited simply from exposing steadily improving models through a better product and harness. Lauritzen recalls one citation problem where a subsequent model release raised performance on that particular problem from about 70% to 99% without a change by his team. He does not present that as a general citation accuracy rate.

03

What changes for legal work

Lauritzen discusses possible changes to firm incentives, junior roles, pricing and client relationships, while acknowledging uncertainty.

Product design also requires a view of how legal work might be organized in five or ten years. Lauritzen imagines reducing long email chains and document-version exchanges while retaining audit logs, retention controls and other requirements of regulated work. Proactive agents might eventually surface tasks for lawyers to review rather than wait for every instruction.

Lauritzen explicitly qualifies his forecast: no one knows exactly what the profession will become. He expects lawyers to spend more time on strategic judgment, risk and client relationships, and less on tedious document searches. The outcome depends on both technical progress and how firms redesign their work.

Asked about partnerships, Lauritzen observes that professional-services firms historically depend on human expertise, making ownership structures a way to retain valuable people. He wonders whether firms could build more durable assets by codifying their methods, precedent and judgment in systems that others at the firm can use.

That idea raises an incentive problem. Partners who are rewarded for bringing in clients may have little reason to spend time building an asset that benefits the firm after they leave. Lauritzen does not claim to have solved the business model; he sees the incentives around durable institutional knowledge as an open question.

The hosts press him on whether junior lawyers and paralegals disappear. Lauritzen says that is not what he is seeing: firms still need a next generation, and capable junior staff may become more productive and valuable with better tools. The conversation distinguishes individual tasks that can be automated from a settled prediction about whole occupations.

Hourly billing creates another tension. Lauritzen recalls initially questioning why law firms would adopt technology that makes billable work faster. He now sees competitive pressure pushing firms to change, and says some lower-complexity work is already priced as a project or flat fee rather than strictly by the hour, particularly in the United States.

Strategic work, major transactions, litigation and client relationships remain valuable in Lauritzen's account. Some firms have historically done limited work without charge to maintain relationships; reducing routine effort can change the economics of that service. He does not claim that every legal fee will fall.

The group discusses the skills needed when people supervise agents. Knowing a legal workflow, the tools and how to refine an output can be meaningful work in its own right. Lauritzen says routine bulk review may require less overnight manual extraction, leaving staff time for other responsibilities.

04

Due diligence and private data

Legora uses its tools internally, while confidentiality limits what it can observe in customer matters.

Legora has used its own tools in acquisition due diligence. Lauritzen says tabular review helps its team find issues early, while outside counsel still advises on strategic risks and local questions such as payroll in another jurisdiction. He says the team has found red flags that caused it to pause, but declines to disclose deal details.

In Lauritzen's experience, US customers have generally moved faster and shown more appetite for custom systems and integrations, while European customers more often start with an off-the-shelf product and provide feedback. He cautions against reading this as evidence that one group cares less about AI: he sees different routes toward a shared strategic priority.

The company tracks familiar product signals such as return usage, time in the product and renewals. It also uses online evaluations and compares feature rollouts to look for improvements or serious regressions. The unusual constraint is that it generally cannot inspect the underlying customer traces: the confidential material often belongs to a law firm's clients.

The hosts ask whether a model could paraphrase real interactions to make safe examples. Lauritzen says merely removing names may not be sufficient, so the company generally chooses a more restrictive approach. Classifying a failure into a small set of categories, task types or practice areas can yield some signal without exposing the underlying matter.

05

Infrastructure and model tradeoffs

Customer governance affects hosting and vendor choices, and model selection varies by task.

Customer data requirements also shape infrastructure. Lauritzen says Legora initially hosted on Azure in part because firms were already familiar with Microsoft as a vendor. He describes customers' attitudes to cloud infrastructure as having changed over the preceding years; his account is about those customer choices, not a guarantee that any particular deployment is secure.

For each task, the company weighs model quality against latency, price, governance and regional availability. Lauritzen says some open-weight models are useful for specific jobs, while frontier models remain appropriate for others. He is interested in post-training for narrowly defined tasks rather than assuming one model is best everywhere.

As an example of specialization, he cites an early Gemini model that worked well for certain transcription and speaker-attribution tasks. Vendor selection also depends on data-processing agreements: keeping the list of providers short can make governance simpler, even when another specialist model might be attractive.

The group cautions that speech recognition still makes consequential errors with domain-specific vocabulary. One workflow discussed is to extract likely keywords with a language model and run transcription again with that guidance. Lauritzen says errors become especially visible at scale or outside ordinary conversation.

06

Tabular review and intake

Spreadsheet-style review, sampling and intake lists connect agent work with lawyer review and collaboration.

The conversation returns to product design: the agent, tabular review, and Word and Outlook integrations are major components. In a due-diligence table, each row can represent an employment contract and each column a question, such as the notice period, an intellectual-property assignment or compensation.

An agent can start a bulk review, wait for it to finish, analyze the results and flag unusual items for a lawyer, or help draft a memo. The spreadsheet makes it easier to scan results, collaborate, mark items reviewed and follow citations to source documents. Lauritzen says the team has handled tables with up to a million cells.

Before running a question across a very large set, the product runs the first ten rows so a user can inspect and refine the query. The hosts compare this with testing a small sample before a large fan-out: quick feedback can reveal that the question is not extracting what the lawyer intended.

Intake is more than a generic Slack bot. A request can become an item on a legal team's list, where lawyers and agents work on it and mark it complete; the result can then return through Slack. The requesting employee need not change interfaces, while the legal team has a shared place to manage the work.

Lauritzen calls lists a flexible primitive, comparable to a configurable database. Triggers and automations can start agent runs; agents can read or update list fields and add documents. The same building blocks let legal engineers configure specialized workflows and dashboards without the company building every experience from scratch.

07

Reusable primitives and deployed teams

Lists and agents support specialized workflows, while legal engineers and forward-deployed engineers serve distinct roles.

He points to the acquisition of Wexler and its litigation-focused fact intelligence as another use case. The idea is to extract dated facts and named entities from documents, then compare evidence that supports or conflicts with a claim. He presents this as an application of the platform's primitives, rather than a substitute for a lawyer's assessment.

Legora's legal engineers and forward-deployed engineers have different roles. Legal engineers configure workflows as expert product users and help customers adopt them; forward-deployed engineers write production code, build integrations and feed needs back into the core product. Which people join a customer project depends on its scope.

A common workflow might be configured within the product, while a complex integration or a missing primitive can require engineering work. Lauritzen says forward-deployed engineers still do not need to see confidential matter data when building a system, though customers may sometimes onboard them like employees when necessary.

08

APIs, product bets and team scale

Lauritzen weighs API maintenance, the idea of an agent interface and the need for reusable product primitives.

The company has APIs but does not promise that every product feature is exposed through them. Lauritzen says the team delayed opening APIs because it was changing quickly and did not want to maintain old versions of a changing data model. As the company grew, it became more able to bear that maintenance cost.

He is also considering whether triggering an agent could serve some integration needs that would otherwise require a conventional API. This is an idea under exploration, not an announced product commitment. The participants note the tradeoffs: agent execution can be slower, more expensive and less deterministic than a fixed endpoint.

Lauritzen once imagined keeping the engineering team to 20 people, like a small force competing against larger rivals. He says the team had reached around 100 engineers and still felt small relative to demand. His aim is to create a few reusable primitives that support a much broader range of customer-facing capabilities.

Customer demand determines much of the roadmap, but the team sometimes makes a strategic bet ahead of an explicit request. Lauritzen cites the move toward a more autonomous agent and collaboration inside the product. Legal engineers then help firms adapt workflows to capabilities they may not have known to ask for.

09

Training, retrieval and citations

Selective post-training is one option, but better retrieval, harnesses and source links can improve legal outputs too.

At the time of the interview, Legora had not yet fine-tuned its own models, Lauritzen says. He expects selective post-training of open-weight models for bounded tasks such as parts of legal research, where a specialized model could improve the cost and latency of high-volume retrieval. He does not propose training a general frontier model to replace the main agent.

There is still substantial work to do in retrieval pipelines and agent harnesses without training a model. Lauritzen mentions possibilities such as improved embeddings and late interaction, while clarifying that the latter is not something the team currently uses. Better search, analysis, file editing and governance can all improve the final result.

Drafting a complex contract is also partly a search problem. A lawyer looks for clauses and precedent from comparable transactions, where similarity might mean industry, counterparty or deal type, then decides which parts of multiple documents belong in the new agreement. Finding the right material is not a trivial prelude to writing.

To make generated claims inspectable, Lauritzen describes citations that link to highlighted locations in source documents. A claim based on a tabular review can link to a cell and then further down to the document. Such links support verification; they do not remove the need for people to decide which claims and sources to check.

10

Long documents and future interfaces

The speakers discuss long-context tradeoffs, anonymized feedback, embeddings and how lawyers may access specialist tools.

He compares review practices to code review: people differ in how closely they inspect outputs, and experienced reviewers may focus on high-risk points. Long-document reasoning remains difficult, especially when edits to definitions or ordering must stay consistent throughout a contract.

Breaking a long document into pieces can help orchestrate edits, but summarizing chunks independently can lose a point that only becomes clear across their boundary. The team changes its scaffolding as models improve and considers different search approaches depending on the material and question.

Customer feedback can sometimes provide an anonymized document and prompt that reproduce a failure, if the customer is willing to engage. The speakers also discuss acquiring legal data, but Lauritzen notes uncertainty over whether a firm's records belong to the firm or its clients. An output alone may not reveal the reasoning or quality of the process that produced it.

The hosts recommend testing embeddings against the actual retrieval workload rather than selecting a default solely from a benchmark. Lauritzen agrees and adds that multilingual performance matters for Legora's users, especially across European languages.

Looking ahead, Lauritzen expects some enterprises to access specialist legal capabilities through broader tools and APIs, while firms may use Legora directly. He sees model providers building general legal features but expects a specialist product to go deeper on demanding workflows. These are his competitive predictions, not guarantees about future products.

Asked about law schools, Lauritzen says the company wants students to learn its tools but does not claim knowledge of how curricula are changing. The conversation closes on hiring and the broader importance of legal work to organizations: finance, employment and other business decisions regularly depend on legal judgment.

Lauritzen says Legora is hiring engineers in New York, Stockholm and London, with other roles in additional locations. The hosts close by returning to the breadth of the field: legal expertise touches hiring, finance and much of organizational life, which is why Lauritzen finds the work compelling.

같은 채널의 다른 글

27:34EN
Latent Space· 2026년 10월 31일팟캐스트 · 3명Joseph Kim on Building AI Tools for Financial Work게스트 Joseph Kim · 진행자 swyx, RichardOpenAI’s Joseph Kim discusses data, human review, taste and evaluations in building a financial-services product.금융 AI엔터프라이즈 AI사람 참여 검증(HITL)+2
26:05EN
Latent Space· 2026년 10월 31일팟캐스트 · 2명Aman Singh on AI Agents for Long-Running Financial Work at Arca게스트 Aman Singh · 진행자 Richard MacManusArca’s AI platform lead explains its agent harness, persistent memory, human approvals and verification layers.에이전트 엔지니어링금융 AI안전과 거버넌스+2
1:16:38EN
Latent Space· 2026년 10월 28일팟캐스트 · 3명Supabase for Agents: Compute, Postgres and Developer Workflows게스트 Paul Copplestone, Ant Wilson · 진행자 swyxPaul Copplestone and Ant Wilson discuss infrastructure and the company’s growth.인프라와 배포AI agentsOpen Source
1:46:40EN
Latent Space· 2026년 10월 27일팟캐스트 · 3명Inside Anthropic’s Agent Infrastructure and Product Engineering게스트 Katelyn Lesse, Angela Jiang · 진행자 swyxKatelyn Lesse and Angela Jiang discuss managed agents, evaluations and sandbox design.Anthropic에이전트 엔지니어링평가(Evals)
16:34EN
Latent Space· 2026년 10월 26일팟캐스트 · 3명Ian Quigley on Testing Scientific Agents in Premeasured Worlds게스트 Ian QuigleyLeash Bio’s Minos environments replay physical measurements so agents can explore medicinal chemistry decisions at scale.AI for scienceComputational Biology평가(Evals)+2
1:25:33EN
Latent Space· 2026년 10월 22일팟캐스트 · 2명Why GPU Capacity Comes in Three-Year Rectangles — Erik Bernhardsson, Modal게스트 Erik Bernhardsson · 진행자 Vibhu SapraModal’s CEO tells Latent Space why AI demand almost never looks like a three-year GPU contract, how the company pools compute across thousands of customers, and why sandboxes grew from a product they almost killed into a third of revenue.인프라와 배포Sandboxes & isolationAI cost & performance+2