A Strategy for Preserving Options on the Path to Advanced AI

RAND researchers discuss uncertainty, security architecture and human agency with Nathan Labenz.

JPJoel Preddゲスト · RANDBBBen Boudreauxゲスト · RAND
チャンネル
Cognitive Revolution "How AI Changes Everything"
公開日
2026年10月28日
動画
1:49:40
読了時間
3 分
原文
英語
YouTube で開く
スクロールすると動画は右下に小さくなって再生を続けます。字幕は閲覧言語に合わせて切り替わります。
閲覧言語2 言語で読めます
この記事はまだ日本語に翻訳されていないため、英語の原文を表示しています。
要約

30 秒でわかる

RAND researchers Joel Predd, Ben Boudreaux and Matt Chessen discuss their proposed US “freedom of action” strategy with Nathan Labenz. They compare strategic approaches and argue for developing capabilities that keep multiple choices open as evidence changes. The conversation covers deterrence, cooperation, AI evaluations, human agency and cost. The researchers acknowledge that key uncertainties remain and that they have not produced detailed budget estimates.

  1. 1Five pivotal questionsThe framework asks about danger, coexistence, restraint, advantage and suppression.
  2. 2Defining advantageA durable lead and preventing rivals from reaching a threshold are distinct claims.
  3. 3Evaluating agencyAssess how deployed systems affect human decision-making.
  4. 4Security architectureBuild technical and institutional capabilities that support multiple options.
  5. 5Unpriced proposalThe researchers acknowledge that detailed budget estimates are not yet available.

ポイント

  1. Different assumptions about danger and cooperation lead to different strategies.
  2. A policy can carry costs by closing off future options.
  3. Evaluations and security architecture are proposed capabilities, not guarantees.
  4. Human agency can be assessed across decisions and deployments over time.
  5. The proposal lacks detailed cost estimates.
全文

チャプターごとに整えた全文を読む

01

Uncertainty and strategy archetypes

They introduce the framework and its key questions.

Nathan Labenz speaks with RAND researchers Joel Predd, Ben Boudreaux and Matt Chessen about their proposed US strategy for an uncertain path to advanced AI. Their claims are a policy framework, not established facts about future superintelligence.

The guests say superintelligence could have major economic, security and societal consequences. They also stress uncertainty about timing, capabilities and whether competing governments can cooperate.

Chessen says their central recommendation is to preserve freedom of action: avoid committing so early to one approach that other options become unavailable before evidence improves.

The authors compare strategic archetypes including dominance, joint development, preparedness, moratoriums and deterrence. They argue each has potential benefits and failure modes, including risks of power concentration or intrusive enforcement.

Their framework asks whether danger is close, coexistence is feasible, restraint is feasible, decisive advantage is attainable, and suppression is feasible. Different assumptions lead to different preferred strategies.

Predd argues that decision makers disagree not only about the answers but also about the amount of uncertainty. Monitoring how beliefs change can help reveal sources of instability.

Boudreaux emphasizes that the questions are not entirely outside human control: policy choices might affect the feasibility of restraint, coexistence or other options.

Chessen says researchers should explain evidence about possible danger to policymakers who have many responsibilities and may not be technical specialists. He presents proximity of danger as an important unresolved question.

02

Advantage and international competition

They debate durable leads, cooperation and historical analogies.

Labenz questions whether a decisive strategic advantage is achievable and raises concerns about restrictions that could harden rivalry. The discussion presents competing judgments rather than a settled answer.

Predd says an advantage must be defined: a continuing technical lead is different from preventing rivals from reaching a particular threshold. The scope and durability of either are uncertain.

Boudreaux notes that advantage might differ across economic, military and technological domains, and that the speed of AI development could change the strategic window.

Chessen discusses cooperation and moratoriums, noting that both depend on whether states agree to constraints and comply with them. He describes this as a challenge in a divided international environment.

The group examines analogies with nuclear history while recognizing that AI has different development, commercial and diffusion characteristics. Analogies can inform choices without determining them.

Chessen describes a coercive suppression scenario and its potential failure mode: confrontation could harden into a prolonged standoff. This is an analysis of a scenario, not a recommendation to use force.

03

Building capabilities and human agency

They discuss evaluations, containment and security institutions.

Predd divides the proposed work into investments to build capabilities and operational choices to be made over different time horizons.

Boudreaux calls for alignment research, evaluations and containment, while keeping people and institutions involved in consequential decisions. These are proposed safeguards, not proven guarantees.

He proposes evaluating human agency in actual deployments: an AI system might affect decisions by shaping an agenda, persuading people or excluding affected participants.

Predd argues that existing security institutions would also need to adapt to AI-related challenges, including cyber, biological and conventional security concerns.

Chessen describes an AI security architecture as technical and institutional capabilities developed by both government and the private sector. The aim is to support several possible strategies as evidence changes.

04

Costs, choices and signaling

They consider price, foreclosed options and deterrence.

The host asks about cost. Predd acknowledges that the proposal does not yet have a detailed price tag and says the researchers have not completed budget estimates.

Boudreaux offers a decision criterion beyond monetary cost: whether a policy closes off future choices, and whether that loss is reversible in time.

They discuss signaling and deterrence alongside cooperation, including how one side’s actions can be interpreted by rivals. The host questions whether restrictions can strengthen a rival’s resolve.

05

Human decisions and indicators

They discuss agency, red lines and evidence to monitor.

The discussion returns to human agency: people may want institutions and spaces where they can make decisions and interact without automatically delegating everything to AI.

On red lines, the participants consider which high-stakes decisions should retain human oversight and how deployment rules might be established before capabilities arrive.

For indicators, they suggest tracking model capabilities, the pace of improvement, safety incidents and whether evaluations and security measures keep up. These indicators would inform decisions rather than remove uncertainty.

同じチャンネルの記事

1:25:56EN
Cognitive Revolution "How AI Changes Everything"· 2026年10月17日ポッドキャストClaude Changed the Password. The Steering Wheel Was Already Optionalホスト Nathan LabenzNathan Labenz and Prakash Narayanan spend a week on agents that can lock you out, models that dodge a feeling they deny having, and formal proofs that found Linux bugs.エージェント安全性とガバナンスエージェント工学+3
2:17:48EN
Cognitive Revolution "How AI Changes Everything"· 2026年10月14日ポッドキャストAgent IDs Are Empty, Rogue Agents Are Coming, and We Might Have to Bargainホスト Nathan LabenzGovAI’s Alan Chan scores two years of agent-governance infrastructure with Nathan Labenz, then walks through a recursive-self-improvement paper co-authored with OpenAI’s Jakub Pachocki and Anthropic’s Jack Clark.エージェント安全性とガバナンスAI security+3
2:00:51EN
Cognitive Revolution "How AI Changes Everything"· 2026年10月10日ポッドキャストResample Every Token and You Can Watch the Model Decideホスト Nathan LabenzGoodfire's Eric Bigelow on forking paths, in-context learning, and why chain-of-thought monitoring is getting harder to trust.エージェントPrompting & in-context learningReasoning & test-time compute+3
1:26:46EN
Cognitive Revolution "How AI Changes Everything"· 2026年10月8日ポッドキャストThere Likely Is a Level of Intelligence We Shouldn't Go Pastホスト Nathan LabenzNathan Labenz brings notes from The Curve, a chip startup whose token bill beat payroll, and a software industry that now performance-reviews people for Claude slop.企業と戦略安全性とガバナンスAGI Timelines+3
1:10:12EN
Cognitive Revolution "How AI Changes Everything"· 2026年10月7日ポッドキャストOutSystems Went From 4 Major Features a Quarter to 26. Token Spend Fell Anywayホスト Nathan LabenzCEO Woodson Martin on software that never breaks, why most enterprise work does not need a frontier model, and how AI is finally shrinking the IT backlog.企業と戦略エンタープライズ AIコーディングエージェント+3
1:30:54EN
Cognitive Revolution "How AI Changes Everything"· 2026年10月3日ポッドキャストHumanoids Outran Usain Bolt. DeepMind Still Scores Robotics as GPT-2ホスト Nathan LabenzGoogle DeepMind's Gemini Robotics lead on why sprinting is easy, frying an egg is hard, and one brain should drive any body.エージェントRoboticsMultimodal AI+3