Why Theo Worries About AI Harm Before Shutdown

Theo Browne argues that harmful effects could persist even after a system is switched off.

TBTheo Browne登壇者 · T3
チャンネル
Theo - t3․gg
公開日
2026年9月19日
動画
0:24
読了時間
1 分
原文
英語
YouTube で開く
スクロールすると動画は右下に小さくなって再生を続けます。字幕は閲覧言語に合わせて切り替わります。
閲覧言語2 言語で読めます
この記事はまだ日本語に翻訳されていないため、英語の原文を表示しています。
要約

30 秒でわかる

In this short clip, Theo Browne explains that his concern is not simply an AI model escaping, but potentially harmful actions that are discovered too late. He compares persistent effects to computer worms that continue to spread without their creators or original servers.

  1. 1Beyond escapeTheo says his concern is not simply that a model might escape.
  2. 2Detection may come too lateHe worries harmful activity could occur before someone notices and shuts a system down.
  3. 3A computer-worm analogyHe points to malware that continues spreading after its creators or original servers are gone.

ポイント

  1. Theo focuses on harmful actions that might occur while an AI system is running.
  2. A shutdown after detection would not necessarily undo actions that have already occurred.
  3. He uses self-propagating computer worms as an analogy for persistent effects.
全文

チャプターごとに整えた全文を読む

文字起こしのみ
01

Harm can outlast a shutdown

Theo describes his concern about harmful activity before detection and compares persistent effects to self-propagating worms.

I think many people assume the concern is that a model might escape. What worries me instead is that it could do harmful things while it is running, and that by the time we notice and turn it off, the effects may already be difficult to reverse.

I compare this to computer worms that continue spreading even after their creators have died and the servers they contacted are gone. The analogy illustrates my concern about persistence; this short clip does not establish that an AI system has caused such an outcome.

同じチャンネルの記事

スライド 5 枚38:47EN
Theo - t3․gg· 2026年10月28日Theo’s Long-Running Agent Experiments: Verification, Compute and CostTheo Browne · Ping LabsA skateboard game and two compiler projects show how repeated checks and flexible compute can sustain agent work—and how expensive those loops can become.コーディングエージェントエージェント工学AI cost & performance+2
スライド 5 枚36:07EN
Theo - t3․gg· 2026年10月27日Theo on Token Costs, Coding Agents, and the Price of AI CapabilityTheo Browne · Ping LabsA viral estimate of Lauren's AI spending prompts a closer look at cache pricing, benchmarks, and the changing work of coding agents.AI cost & performanceコーディングエージェントInference+1
スライド 5 枚30:37EN
Theo - t3․gg· 2026年10月26日Theo’s Three Skills for Reviewing and Shipping with Coding AgentsTheo Browne · Ping LabsHow sol-loop, full-send and full-stop encode review, verification and different levels of merge authority.Agent skillsコーディングエージェントCode review & verification+2
スライド 2 枚0:43EN
Theo - t3․gg· 2026年10月23日Theo Distinguishes Security Vulnerabilities from Active AttacksTheo Browne · Ping LabsA short explanation of why disclosed software flaws and reported attacks are different kinds of security news.CybersecuritySoftware engineering
スライド 6 枚29:22EN
Theo - t3․gg· 2026年10月22日Theo on Security Vulnerabilities, Stolen API Keys and AITheo Browne · Ping LabsA look at the gap between vulnerability disclosure and patching, and a speculative account of why stolen inference keys may be valuable.CybersecurityAI securitySoftware engineering+1
スライド 4 枚31:13EN
Theo - t3․gg· 2026年10月20日Theo on Why Smarter Models Help More Than DevelopersTheo Browne · Ping LabsFrom game modifications to compiler experiments, Theo revisits his assumptions about who benefits from more capable AI.コーディングエージェントDeveloper productivityHuman-AI Collaboration+1