Ford Prior: An AI War Room for Modernizing GEICO’s Legacy Code

How an insurer combined human decisions, enterprise context and agent fleets to modernize claims technology.

FPFord Prior연사 · GEICO
채널
AI Engineer
게시일
2026년 10월 21일
영상
18:42
읽기
5분
슬라이드
6
원문
영어
YouTube에서 열기
스크롤하면 영상이 오른쪽 아래로 작아져 계속 재생됩니다. 자막은 읽기 언어를 따릅니다.
읽기 언어2개 언어로 읽을 수 있음
이 글은 아직 한국어 번역이 없어 영어 원문으로 표시합니다.
요약

30초 요약

GEICO engineer Ford Prior describes three experiments in which a shared AI-native war room brought decision makers and agents together to modernize legacy claims systems. He explains the FleetKit workflow, human approvals, artifacts, model tests and cost lessons.

  1. 1The 25% constraintPatches and minor upgrades left limited time for major changes.
  2. 2One day, $1,000The experiment sought to map a legacy domain and produce a meaningful change.
  3. 3Three distinct resultsThe missions yielded API work and an approved migration plan.
  4. 4Humans at the gatesFleetKit routes research to an approval queue before builders act.
  5. 5Measure model fitThe team compared model outputs on its own legacy-code task.

핵심 정리

  1. Faster coding can expose coordination and decision-making as the next constraint.
  2. Enterprise context and human decision rights are essential inputs to agent workflows.
  3. Three modernization missions produced distinct results, from APIs to an approved migration plan.
  4. Approval gates and concrete artifacts help coordinate agents and people.
  5. Measure model performance and token costs on the actual task.
전문

챕터별로 다듬은 전문 읽기

원본 자막만 보기
01

The outer loop

Coding is faster, but decisions and coordination constrain delivery.

For years we have tried to speed up the software development lifecycle, particularly the build phase. Coding has accelerated dramatically, but at GEICO, a risk management company, the work around it still sets the pace. The inner loop is faster; the outer loop of decisions and delivery has not kept up.

We wanted to imagine what software delivery would look like if the outer loop moved at the same speed. My team works in claims technology: after an accident, a claim is where the insurance policy comes to life and the customer is helped back on the road.

I am Ford Prior, a senior staff engineer and technology evangelist in GEICO's claims group. Our roughly 300 engineers work in about 32 teams. My role is to introduce better development practices, run a claims innovation lab and share what we learn.

Six months ago we found that, after patches and minor upgrades, engineers had at best 25% of their time for the major changes that keep us competitive. We began using GEICO-managed agents, with different harnesses and models, to handle smaller changes from specification through deployment.

Major changes still depend on assembling the right people at the right moment. They also require facts, code analysis and a growing understanding of the domain to be available as decisions arise. We needed both faster collaboration and intelligence to support it.

02

An AI-native war room

People, tools and agents coordinate around a shared mission.

AI-native war room
슬라이드 1 / 6AI-native war roomDecision makers, a driver and experts work over workflows, skills, MCPs and agents.

Our answer was a multiplayer, AI-native war room: decision makers and domain experts, a driver operating the AI tools, and shared communications, design and code repositories. Workflows, skills, MCP connections and fleets of agents carry out analysis, synthesis and checking.

The challenge was to make legacy claims capabilities callable by agents. The legacy systems contain millions of lines of code, so the context is expensive to build but can be reused. My bet was that one day and $1,000 of AI tokens could map a domain end to end and produce one serious change.

The proposed output was an agent-callable API for a legacy system, deployed to our agent platform for a 4 p.m. demonstration. We ran three experiments, using the uplift, transform and reimagine categories from Anthropic's code modernization plugin.

Three modernization missions
슬라이드 2 / 6Three modernization missionsThe slide compares the projects, costs and outcomes for rentals, damages and salvage.
03

Three modernization missions

Rentals, damages and salvage each produced a different outcome.

First, in rentals, we extended an existing API using a newer version of the same technology. The agent connected pieces of information and identified a way to give customers current rental information; Prior says this could save about 8,500 calls a month.

Second, we added agent-callable APIs to the damages domain, which assigns a dollar value to a reported loss. Third, in the complex salvage domain—the work after a vehicle is totaled—we produced a migration plan with specifications and mockups, approved by product and technology leaders. The work also surfaced a production bug.

04

FleetKit and enterprise context

The fleet combines replaceable tools with organization-specific judgment and knowledge.

Tools and organizational knowledge
슬라이드 3 / 6Tools and organizational knowledgeThe vendor stack is combined with GEICO context, judgment, methods and tools.

The vendor supplied a model, a harness, FleetKit and a code modernization plugin. Those components can be replaced. What GEICO must supply itself is context: the knowledge base, standards, past decisions, available tools, working methods and the people authorized to exercise judgment at each gate.

FleetKit, developed with Anthropic and not yet open source at the time of the talk, is a structured set of Markdown rules and instructions for managing the fleet. It decomposes a goal, dispatches research leaders and places their proposals in a human-in-the-loop queue; after approval, builder agents make the change.

FleetKit approval flow
슬라이드 4 / 6FleetKit approval flowResearch leaders feed a human-in-the-loop queue before builder agents make changes.

The queue can be implemented with something like GitHub issues, where people can comment or approve and other agents can add context. The desired result is a material change: a change request or code change in the organization's systems.

05

Inside the workflow

Agents, worksheets and diagrams bring people into decisions.

A mission starts by loading the repositories and creating a shared communications channel. Relevant decision makers and subject experts join. When the agent needs product information, it can identify and mention the person responsible rather than waiting for the driver to find them.

The agent also creates interactive worksheets to fill information gaps and editable design documents, including architecture diagrams. People can edit the artifacts and feed them back into the session. Teams kept some diagrams afterwards because they documented systems nobody had mapped in this way before.

Two kinds of agents supported the work: cloud agents performed deep code analysis and graphing over legacy languages, while local agents used enterprise-specific tools and MCPs available on my laptop. A bindings file told the agent what was available locally and how it connected to FleetKit.

Nine-stage process
슬라이드 5 / 6Nine-stage processThe driver moves through the stages, with artifacts and gates.

The driver's laptop was the runtime. The process had nine steps including boot, scope, research, target, plan, build, test, deploy and maintain. Worksheets acted as approval gates, and scripts checked deterministically whether a previous stage produced the required artifacts.

06

Cost, models and next steps

Prior shares lessons from cost and model selection and outlines improvements.

Model comparison
슬라이드 6 / 6Model comparisonGEICO compared models on five legacy API tasks, measuring response-field recall and cost.

Cost was a lesson. Prior warns against letting an agent schedule repeated AI sessions merely to check on work, because the budget can disappear quickly. He also saw more prompt caching than expected and some unusual subagent behavior.

After building the context, the team compared models on recently written legacy code used as reference data. In this particular test, Sonnet 5.5 performed as well as or better than Fable, Prior says. The result is an argument for measuring model choice against the actual task rather than assuming the most expensive option is necessary.

Next, Prior wants stronger enforcement of approval gates, better decision and model-selection methods, and improved ways to search and organize context that currently lives in Markdown. He also wants to capture conversations as audio so that the driver does not have to take every note manually.

The broader question is how to spread this approach across an organization while controlling cost and keeping people at the right decision points. As agents make progress up one hill, Prior wants engineers to choose the next hill worth climbing.

같은 채널의 다른 글

슬라이드 4장21:47EN
AI Engineer· 2026년 10월 28일Patrick Smyth on Open-Source Supply Chain Security in the AI EraPatrick Smyth · ChainguardChainguard’s Patrick Smyth discusses faster exploitation, malware in dependencies, zero-days and the expanding attack surface around developer workflows.CybersecurityOpen-source ecosystemsAI security+2
슬라이드 5장14:09EN
AI Engineer· 2026년 10월 28일Taylor Luttrell-Williams on Finding Logic Vulnerabilities with SonarQube Hunter AgentTaylor Luttrell-Williams · SonarSonar’s Taylor Luttrell-Williams explains how a security agent maps a codebase, investigates logic flaws and presents validated findings alongside conventional scans.CybersecurityAI securityCode review & verification+2
슬라이드 5장16:29EN
AI Engineer· 2026년 10월 28일Chris Vela on Benchmarking vLLM Configurations with Runpod BenchPodChris Vela · RunpodRunpod’s Chris Vela demonstrates a dashboard for comparing LLM serving configurations and choosing performance settings with workload-specific data.InferenceBenchmarksAI cost & performance+2
슬라이드 6장18:52EN
AI Engineer· 2026년 10월 28일Manish Kapur and Addy Osmani on Verifying AI Software FactoriesManish Kapur, Addy Osmani · SonarSonar’s Manish Kapur and Anthropic’s Addy Osmani discuss code review, evidence and layered checks as coding agents increase the pace of software changes.소프트웨어 팩토리Code review & verification코딩 에이전트+2
슬라이드 5장18:35EN
AI Engineer· 2026년 10월 28일Kamil Potrec on Agent Authentication, Delegation and Gateway ControlsKamil Potrec · KeycardKeycard’s Kamil Potrec explains why agents need distinct identities, scoped credentials and auditable authorization, and where gateways can help.에이전트 인증AI securityCybersecurity+2
슬라이드 7장18:56EN
AI Engineer· 2026년 10월 27일John Feminella: Five Controls for AI Agents, and the $900 Million Bank ErrorJohn Feminella · Two SigmaA payment mistake shows why good intentions and approval prompts are not enough. Feminella describes practical controls for giving agents useful autonomy.안전과 거버넌스에이전트 엔지니어링금융 AI+2