In 30 seconds
In this short clip, Theo Browne explains that his concern is not simply an AI model escaping, but potentially harmful actions that are discovered too late. He compares persistent effects to computer worms that continue to spread without their creators or original servers.
- 1Beyond escapeTheo says his concern is not simply that a model might escape.
- 2Detection may come too lateHe worries harmful activity could occur before someone notices and shuts a system down.
- 3A computer-worm analogyHe points to malware that continues spreading after its creators or original servers are gone.
Takeaways
- Theo focuses on harmful actions that might occur while an AI system is running.
- A shutdown after detection would not necessarily undo actions that have already occurred.
- He uses self-propagating computer worms as an analogy for persistent effects.
Read the edited text by chapter
Harm can outlast a shutdown
Theo describes his concern about harmful activity before detection and compares persistent effects to self-propagating worms.
I think many people assume the concern is that a model might escape. What worries me instead is that it could do harmful things while it is running, and that by the time we notice and turn it off, the effects may already be difficult to reverse.
I compare this to computer worms that continue spreading even after their creators have died and the servers they contacted are gone. The analogy illustrates my concern about persistence; this short clip does not establish that an AI system has caused such an outcome.
More from this channel
36:07EN
30:37EN
0:43EN
29:22EN
31:13EN
31:47EN