When AI Agents Delegate: Security and a Possible Agent Economy

Nenad Tomašev discusses specialists, oversight and correlated failures with Hannah Fry.

NTNenad Tomaševゲスト
チャンネル
Google DeepMind
公開日
2026年6月23日
動画
42:38
読了時間
3 分
原文
英語
YouTube で開く
スクロールすると動画は右下に小さくなって再生を続けます。字幕は閲覧言語に合わせて切り替わります。
閲覧言語2 言語で読めます
この記事はまだ日本語に翻訳されていないため、英語の原文を表示しています。
要約

30 秒でわかる

Nenad Tomašev explains how agents might delegate to specialists, why human attention and security matter, and how many similar agents could create correlated failures. The proposed agent economy is a research scenario rather than an established system.

  1. 1What is an agent?Agents can use tools and take multiple steps toward a task.
  2. 2Automation biasHuman oversight requires active attention.
  3. 3DelegationDelegation involves choosing and monitoring specialized work.
  4. 4ConsequencesIrreversible actions require more careful authorization.
  5. 5Agentic trapsMalicious content can try to redirect agents.
  6. 6Correlated failuresSimilar decisions can cause failures to be correlated.
  7. 7SpecialistsComplementary specialists may improve collective capability.

ポイント

  1. Agents can use tools and take multiple steps toward a task.
  2. Human oversight requires active attention.
  3. Delegation involves choosing and monitoring specialized work.
  4. Irreversible actions require more careful authorization.
  5. Malicious content can try to redirect agents.
  6. Similar decisions can cause failures to be correlated.
  7. Complementary specialists may improve collective capability.
全文

チャプターごとに整えた全文を読む

文字起こしのみ
01

Agents and people

Tools, oversight and automation bias.

Hannah Fry interviews Google DeepMind researcher Nenad Tomašev about AI agents, delegation and a possible future agent economy. The conversation mixes present-day observations with research proposals and hypothetical scenarios.

Tomašev defines agents in terms of systems that can pursue tasks through actions and tools. He notes that the concept predates today’s large language models, including earlier agents in simulated environments.

The user may still communicate in natural language, but the system can take multiple steps. Tomašev expects the person’s role to include decisions, review and approval rather than simply waiting for an answer.

They discuss coding agents as a current application. Tomašev says they can reduce repetitive implementation work, while the actual effect on productivity depends on task, review and organizational context.

Fry raises automation bias: a person may become less attentive when a system usually appears to perform well. Tomašev says being nominally in the loop is insufficient if a reviewer is not engaged.

The speakers consider how better tools and safeguards might allow agents to carry out more complex work. They treat reliable long-running autonomy as a goal with unresolved technical and social challenges.

02

Science and delegation

Exploration, specialization and task risk.

Fry asks how agentic exploration could help science. Tomašev imagines systems proposing and testing many alternatives while researchers define questions, evaluate evidence and decide what matters.

He says current systems still have major limits and often recombine known methods more readily than they produce reliable new scientific understanding. The discussion distinguishes present capabilities from longer-term hopes.

Asked why a fully capable personal assistant is not broadly deployed, he points beyond the underlying model to tools, infrastructure, reliability and safeguards. A capable model alone does not guarantee a dependable service.

Delegation is introduced as a possible response to complex tasks: an agent could divide work, choose specialists and combine their results. Tomašev contrasts this with simply running many similar tasks in parallel.

He says effective delegation requires selecting subtasks, supplying context and monitoring whether work is completed. Coordination itself creates cost and failure modes; more agents do not automatically produce a better answer.

The speakers distinguish reversible tasks from actions with real-world consequences, such as spending money. Higher-consequence actions warrant more careful authorization, checks and opportunities for human review.

03

Security

Agentic traps and dynamic cloaking.

The conversation turns to agentic traps: malicious content can attempt to redirect a system that is performing a user’s task. Tomašev identifies this as a security challenge for large-scale deployment.

He describes dynamic cloaking, where a site may show different content to a human and an agent. The risk is that a trusted-looking workflow can encounter instructions or misleading content crafted for the agent.

The speakers compare the problem with earlier web security and adversarial examples. Verification, isolation and other defenses can reduce exposure, but no single measure is presented as a complete guarantee.

04

An agent economy

Negotiation, correlated failure and distributed intelligence.

Tomašev sketches an agent economy in which assistants negotiate or delegate within budgets and preferences set by people. It is a theoretical framework, not a description of an already mature universal market.

An example involves allocating a limited budget for tickets while accounting for preferences and schedules. The assistant’s choices would still need appropriate user control and a way to handle mistakes.

They discuss cognitive monoculture: if many agents use similar models and make correlated decisions, failures can occur together. Diversity in models and oversight may help, but its effectiveness must be evaluated.

The potential benefit of distributed intelligence is combining specialists with different abilities. Tomašev suggests coordination and complementary expertise can do more than simply make identical work run faster.

They consider a general coordinating layer calling specialized systems for particular tasks. Fry compares this with distributed intelligence; the architecture and its safety remain research questions.

Fry closes by emphasizing that the important system may be a network of generalists and specialists rather than a single assistant. The interview leaves open how such systems should be governed and evaluated.

同じチャンネルの記事

スライド 5 枚38:10EN
Google DeepMind· 2026年10月1日From deepfakes to DNA: how SynthID watermarks AIHannah Fry, Pushmeet Kohli, Jeremy Ratcliffe · Google DeepMindHannah Fry sits down with Pushmeet Kohli and Jeremy Ratcliffe to explain SynthID: a mathematical watermark now used on text, images and video, and being extended to protein sequences so DNA synthesis companies can tell AI-designed molecules from nature.BiosecurityComputational BiologyGenerative media+2
44:25EN
Google DeepMind· 2026年9月9日How AI Is Changing Weather ForecastingHannah Fry, Peter Battaglia · Google DeepMindHannah Fry and Peter Battaglia discuss hurricane forecasts, uncertainty and WeatherNext 3.AI researchモデルと学習
44:41EN
Google DeepMind· 2026年8月26日The Mathematics of AI UncertaintyZoubin GhahramaniZoubin Ghahramani explains Bayesian updating, calibration and their computational challenges.AI researchMachine Learning
10:52PT
Google DeepMind· 2026年7月14日Reconstruindo o gol perdido de PeléPesquisa histórica, atores e IA recriam um lance de 1959 sem filmagem original.HistoryGenerative media
53:05EN
Google DeepMind· 2026年7月10日Inside AI Models: Neel Nanda on Interpretability and SafetyHannah Fry, Neel Nanda · Google DeepMindHannah Fry explores reasoning traces, probes and sparse autoencoders.Model InterpretabilityAI SafetyAI research
53:48EN
Google DeepMind· 2026年3月10日Ten Years after AlphaGo: From Go to Scientific DiscoveryHannah Fry, Thore Graepel, Pushmeet Kohli · Google DeepMindHannah Fry and DeepMind researchers revisit the match and its technical legacy.AI researchAI for scienceモデルと学習