When AI Agents Delegate: Security and a Possible Agent Economy

Nenad Tomašev discusses specialists, oversight and correlated failures with Hannah Fry.

NTNenad Tomašev게스트
채널
Google DeepMind
게시일
2026년 6월 23일
영상
42:38
읽기
3분
원문
영어
YouTube에서 열기
스크롤하면 영상이 오른쪽 아래로 작아져 계속 재생됩니다. 자막은 읽기 언어를 따릅니다.
읽기 언어2개 언어로 읽을 수 있음
이 글은 아직 한국어 번역이 없어 영어 원문으로 표시합니다.
요약

30초 요약

Nenad Tomašev explains how agents might delegate to specialists, why human attention and security matter, and how many similar agents could create correlated failures. The proposed agent economy is a research scenario rather than an established system.

  1. 1What is an agent?Agents can use tools and take multiple steps toward a task.
  2. 2Automation biasHuman oversight requires active attention.
  3. 3DelegationDelegation involves choosing and monitoring specialized work.
  4. 4ConsequencesIrreversible actions require more careful authorization.
  5. 5Agentic trapsMalicious content can try to redirect agents.
  6. 6Correlated failuresSimilar decisions can cause failures to be correlated.
  7. 7SpecialistsComplementary specialists may improve collective capability.

핵심 정리

  1. Agents can use tools and take multiple steps toward a task.
  2. Human oversight requires active attention.
  3. Delegation involves choosing and monitoring specialized work.
  4. Irreversible actions require more careful authorization.
  5. Malicious content can try to redirect agents.
  6. Similar decisions can cause failures to be correlated.
  7. Complementary specialists may improve collective capability.
전문

챕터별로 다듬은 전문 읽기

원본 자막만 보기
01

Agents and people

Tools, oversight and automation bias.

Hannah Fry interviews Google DeepMind researcher Nenad Tomašev about AI agents, delegation and a possible future agent economy. The conversation mixes present-day observations with research proposals and hypothetical scenarios.

Tomašev defines agents in terms of systems that can pursue tasks through actions and tools. He notes that the concept predates today’s large language models, including earlier agents in simulated environments.

The user may still communicate in natural language, but the system can take multiple steps. Tomašev expects the person’s role to include decisions, review and approval rather than simply waiting for an answer.

They discuss coding agents as a current application. Tomašev says they can reduce repetitive implementation work, while the actual effect on productivity depends on task, review and organizational context.

Fry raises automation bias: a person may become less attentive when a system usually appears to perform well. Tomašev says being nominally in the loop is insufficient if a reviewer is not engaged.

The speakers consider how better tools and safeguards might allow agents to carry out more complex work. They treat reliable long-running autonomy as a goal with unresolved technical and social challenges.

02

Science and delegation

Exploration, specialization and task risk.

Fry asks how agentic exploration could help science. Tomašev imagines systems proposing and testing many alternatives while researchers define questions, evaluate evidence and decide what matters.

He says current systems still have major limits and often recombine known methods more readily than they produce reliable new scientific understanding. The discussion distinguishes present capabilities from longer-term hopes.

Asked why a fully capable personal assistant is not broadly deployed, he points beyond the underlying model to tools, infrastructure, reliability and safeguards. A capable model alone does not guarantee a dependable service.

Delegation is introduced as a possible response to complex tasks: an agent could divide work, choose specialists and combine their results. Tomašev contrasts this with simply running many similar tasks in parallel.

He says effective delegation requires selecting subtasks, supplying context and monitoring whether work is completed. Coordination itself creates cost and failure modes; more agents do not automatically produce a better answer.

The speakers distinguish reversible tasks from actions with real-world consequences, such as spending money. Higher-consequence actions warrant more careful authorization, checks and opportunities for human review.

03

Security

Agentic traps and dynamic cloaking.

The conversation turns to agentic traps: malicious content can attempt to redirect a system that is performing a user’s task. Tomašev identifies this as a security challenge for large-scale deployment.

He describes dynamic cloaking, where a site may show different content to a human and an agent. The risk is that a trusted-looking workflow can encounter instructions or misleading content crafted for the agent.

The speakers compare the problem with earlier web security and adversarial examples. Verification, isolation and other defenses can reduce exposure, but no single measure is presented as a complete guarantee.

04

An agent economy

Negotiation, correlated failure and distributed intelligence.

Tomašev sketches an agent economy in which assistants negotiate or delegate within budgets and preferences set by people. It is a theoretical framework, not a description of an already mature universal market.

An example involves allocating a limited budget for tickets while accounting for preferences and schedules. The assistant’s choices would still need appropriate user control and a way to handle mistakes.

They discuss cognitive monoculture: if many agents use similar models and make correlated decisions, failures can occur together. Diversity in models and oversight may help, but its effectiveness must be evaluated.

The potential benefit of distributed intelligence is combining specialists with different abilities. Tomašev suggests coordination and complementary expertise can do more than simply make identical work run faster.

They consider a general coordinating layer calling specialized systems for particular tasks. Fry compares this with distributed intelligence; the architecture and its safety remain research questions.

Fry closes by emphasizing that the important system may be a network of generalists and specialists rather than a single assistant. The interview leaves open how such systems should be governed and evaluated.

같은 채널의 다른 글

슬라이드 5장38:10EN
Google DeepMind· 2026년 10월 1일From deepfakes to DNA: how SynthID watermarks AIHannah Fry, Pushmeet Kohli, Jeremy Ratcliffe · Google DeepMindHannah Fry sits down with Pushmeet Kohli and Jeremy Ratcliffe to explain SynthID: a mathematical watermark now used on text, images and video, and being extended to protein sequences so DNA synthesis companies can tell AI-designed molecules from nature.BiosecurityComputational BiologyGenerative media+2
44:25EN
Google DeepMind· 2026년 9월 9일How AI Is Changing Weather ForecastingHannah Fry, Peter Battaglia · Google DeepMindHannah Fry and Peter Battaglia discuss hurricane forecasts, uncertainty and WeatherNext 3.AI research모델과 학습
44:41EN
Google DeepMind· 2026년 8월 26일The Mathematics of AI UncertaintyZoubin GhahramaniZoubin Ghahramani explains Bayesian updating, calibration and their computational challenges.AI researchMachine Learning
10:52PT
Google DeepMind· 2026년 7월 14일Reconstruindo o gol perdido de PeléPesquisa histórica, atores e IA recriam um lance de 1959 sem filmagem original.HistoryGenerative media
53:05EN
Google DeepMind· 2026년 7월 10일Inside AI Models: Neel Nanda on Interpretability and SafetyHannah Fry, Neel Nanda · Google DeepMindHannah Fry explores reasoning traces, probes and sparse autoencoders.Model InterpretabilityAI SafetyAI research
53:48EN
Google DeepMind· 2026년 3월 10일Ten Years after AlphaGo: From Go to Scientific DiscoveryHannah Fry, Thore Graepel, Pushmeet Kohli · Google DeepMindHannah Fry and DeepMind researchers revisit the match and its technical legacy.AI researchAI for science모델과 학습