Theo on Using an AI Agent to Test Debugging Hypotheses

When a model could not find a problem on its own, Theo asked it to build a tool for testing his theories.

TBTheo Browne연사 · Ping Labs
채널
Theo - t3․gg
게시일
2026년 8월 5일
영상
0:42
읽기
1분
슬라이드
1
원문
영어
YouTube에서 열기
스크롤하면 영상이 오른쪽 아래로 작아져 계속 재생됩니다. 자막은 읽기 언어를 따릅니다.
읽기 언어2개 언어로 읽을 수 있음
이 글은 아직 한국어 번역이 없어 영어 원문으로 표시합니다.
요약

30초 요약

Theo Browne describes changing his approach after an AI model failed to identify or fix a problem. He used the agent to locate relevant code and build a browser-console tool, while bringing his own observations and hypotheses to the investigation.

  1. 1Change the questionWhen the model could not find or fix the problem, Theo shifted to testing multiple hypotheses.
  2. 2Build a testing toolHe asked for changes that could be tried in production through console commands and observed immediately.
  3. 3Divide the workThe agent found code and built tools quickly; Theo contributed the information and theories that guided the work.

핵심 정리

  1. An AI model may help investigate a problem even when it cannot identify the cause itself.
  2. Theo asked the agent to build a console-accessible tool for testing changes quickly.
  3. The agent accelerated code discovery and experimentation while Theo supplied the observations and theories.
전문

챕터별로 다듬은 전문 읽기

원본 자막만 보기
01

Using the model to investigate

Theo describes moving from asking a model to solve a problem to using it to test theories. A custom browser tool lets him change options and observe the effects.

At this point I realized the model was not going to solve the problem for me, or even find it. So I changed my mindset: instead of waiting for an answer, I thought about how to use the model to test as many different debugging theories as efficiently as possible.

Request for a production debugging helper
슬라이드 1 / 1Request for a production debugging helperThe screen shows Theo asking for changes he can test through console commands, followed by an agent-generated helper.

I asked it to make changes easy to experiment with in production, ideally through console commands so I could see an immediate difference. It wrote a window binding that created __T3GPU, giving us a custom tool for switching options back and forth while investigating.

The agent could find things in the codebase faster than I could and build custom tools to test my theories better than I could. But I was still the one bringing the actual information to the investigation.

같은 채널의 다른 글

슬라이드 5장38:47EN
Theo - t3․gg· 2026년 10월 28일Theo’s Long-Running Agent Experiments: Verification, Compute and CostTheo Browne · Ping LabsA skateboard game and two compiler projects show how repeated checks and flexible compute can sustain agent work—and how expensive those loops can become.코딩 에이전트에이전트 엔지니어링AI cost & performance+2
슬라이드 5장36:07EN
Theo - t3․gg· 2026년 10월 27일Theo on Token Costs, Coding Agents, and the Price of AI CapabilityTheo Browne · Ping LabsA viral estimate of Lauren's AI spending prompts a closer look at cache pricing, benchmarks, and the changing work of coding agents.AI cost & performance코딩 에이전트Inference+1
슬라이드 5장30:37EN
Theo - t3․gg· 2026년 10월 26일Theo’s Three Skills for Reviewing and Shipping with Coding AgentsTheo Browne · Ping LabsHow sol-loop, full-send and full-stop encode review, verification and different levels of merge authority.Agent skills코딩 에이전트Code review & verification+2
슬라이드 2장0:43EN
Theo - t3․gg· 2026년 10월 23일Theo Distinguishes Security Vulnerabilities from Active AttacksTheo Browne · Ping LabsA short explanation of why disclosed software flaws and reported attacks are different kinds of security news.CybersecuritySoftware engineering
슬라이드 6장29:22EN
Theo - t3․gg· 2026년 10월 22일Theo on Security Vulnerabilities, Stolen API Keys and AITheo Browne · Ping LabsA look at the gap between vulnerability disclosure and patching, and a speculative account of why stolen inference keys may be valuable.CybersecurityAI securitySoftware engineering+1
슬라이드 4장31:13EN
Theo - t3․gg· 2026년 10월 20일Theo on Why Smarter Models Help More Than DevelopersTheo Browne · Ping LabsFrom game modifications to compiler experiments, Theo revisits his assumptions about who benefits from more capable AI.코딩 에이전트Developer productivityHuman-AI Collaboration+1