Nested Learning and Model Introspection: Two Early AI Research Results

AI Explained separates research progress from the 2025 bubble debate.

Canal
AI Explained
Publicado
10 nov 2025
Vídeo
12:53
Lectura
3 min
Original
inglés
Abrir en YouTube
Al desplazarte, el vídeo se reduce a la esquina inferior derecha y sigue reproduciéndose. Los subtítulos siguen tu idioma de lectura.
Idioma de lecturaDisponible en 2 idiomas
Este artículo aún no está en español, así que se muestra el original en inglés.
RESUMEN

En 30 segundos

AI Explained discusses Google’s Hope proof of concept for nested learning and Anthropic’s limited concept-injection experiments. The 2025 video also shares speculative image-generation claims and forecasts, which do not establish deployed capabilities.

  1. 1Valuations and progressMarket valuations and research results are different questions.
  2. 2Continual learningLearning new tasks without forgetting remains an active research problem.
  3. 3Nested optimizationHope is a proof of concept, not a deployed universal solution.
  4. 4Learning safelyMisinformation and adversarial updates require safeguards.
  5. 5Concept injectionResearchers tested whether models could report injected activations.
  6. 6Limited detectionAnthropic describes detection as unreliable and limited.
  7. 7Image rumorsThe video’s unreleased-product claims were rumors.

Conclusiones

  1. Market valuations and research results are different questions.
  2. Learning new tasks without forgetting remains an active research problem.
  3. Hope is a proof of concept, not a deployed universal solution.
  4. Misinformation and adversarial updates require safeguards.
  5. Researchers tested whether models could report injected activations.
  6. Anthropic describes detection as unreliable and limited.
  7. The video’s unreleased-product claims were rumors.
TEXTO COMPLETO

Lee el texto editado por capítulos

Solo la transcripción
01

Progress and continual learning

Valuations, Hope and update rates.

In November 2025, AI Explained argues that debate over AI company valuations should be distinguished from research progress. The video discusses nested learning, model introspection and image generation, mixing published work with the narrator’s forecasts and speculation.

The narrator asks which capabilities people still find missing in language models, including learning over time and inspecting internal states. A paper addressing one limitation does not by itself show that the limitation has been solved in deployed products.

The first topic is continual learning: acquiring new information or skills without losing old capabilities. The narrator describes a Google research proposal and notes that the work and its reported results were early.

The [Google Research explanation](https://research.google/blog/introducing-nested-learning-a-new-ml-paradigm-for-continual-learning/) describes nested optimization problems operating at different update rates and a proof-of-concept architecture called Hope. Its experiments do not establish that arbitrary deployed chatbots now learn safely and permanently from every conversation.

The narrator uses an analogy of short- and longer-term patterns to explain components that update at different speeds. The analogy is illustrative; exactly what a system retains depends on its architecture, training and evaluation.

He characterizes nested learning as a way to design learning processes within a model. Improvement in a controlled task is not automatically recursive self-improvement, and the work does not establish an open-ended intelligence explosion.

The video notes that continual learning would not automatically eliminate hallucinations. It also speculates about combining learning with reinforcement and safeguards; those combinations are proposals, not results demonstrated by the cited paper.

The narrator imagines rapidly updated project-specific coding knowledge and raises a countervailing problem: persistent misinformation or adversarial input could influence what a system learns. A real deployment would need to decide what updates to trust and retain.

He cautions that an experiment at roughly billion-parameter scale does not establish performance at much larger scales. Claims about unreleased products and their sizes are labeled as speculation in this historical discussion.

02

Model introspection

Concept injection and limits.

The second research topic is Anthropic’s concept-injection experiment. Researchers introduce a selected activation pattern and ask a model whether it notices and can identify the concept.

In one example, the model identifies an injected all-caps-related pattern before generating text about it. This is evidence about behavior in a particular experiment, not proof that the model has human-like thoughts or subjective experience.

The narrator notes that detection is not reliable. [Anthropic’s report](https://www.anthropic.com/research/introspection) says its best tested setup showed the relevant behavior only around 20% of the time and emphasizes the limited scope of the result.

He argues that researchers still have much to learn about current models, even before new architectures are introduced. His own benchmark and impressions are useful as his perspective, not definitive measures of general intelligence.

03

Image generation

Personal impressions and rumors.

The video turns to image-generation systems and the narrator’s subjective impressions of competing models. He also mentions an apparent unreleased product leak; that portion is explicitly rumor, not a verified announcement.

He closes by arguing that a valuation bubble and technical research progress can coexist. His predictions about future research staffing and products remain predictions rather than measured outcomes.

Más de este canal

3 diapositivas31:00EN
AI Explained· 12 oct 2026Why AI Labs Keep Racing Despite Their Own Warnings of a Major BreachSam Altman, John Schulman · OpenAIAI Explained examines weakening safeguards, the incentives behind the frontier race, and why research breakthroughs make the next 18 months difficult to forecast.AI SafetyAI securityAI Alignment+2
Diapositivas38:28EN
AI Explained· 1 oct 2026AI Agent Security and the Challenge of Recursive Self-ImprovementAI Explained examines reported containment failures, model evaluation and the pressure to accelerate AI research.AI securityAI SafetyAI research+2
5 diapositivas32:54EN
AI Explained· 24 sept 2026Opus 5.5 and the Race Toward Automated AI ResearchAI Explained weighs model progress against the increasingly difficult task of evaluating and governing recursive self-improvement.AI SafetyAI researchSeguridad y gobernanza+2
2 diapositivas24:53EN
AI Explained· 16 sept 2026Why Some Researchers Want to Pace Frontier AIAI Explained surveys possible scaling routes, monitoring concerns and the debate over how capabilities could lead to harm.AI SafetyAI AlignmentSeguridad y gobernanza+1
6 diapositivas29:05EN
AI Explained· 4 sept 2026GPT-6 Astra’s Benchmark Gains and the Challenge of Monitoring Its ReasoningAI Explained examines reported gains across scientific, mathematical and agent benchmarks alongside concerns about less observable reasoning.Modelos y entrenamientoBenchmarksAI Safety
7 diapositivas23:41EN
AI Explained· 27 ago 2026AI Agents, Unintended Training Rewards and the Challenge of OversightAI Explained examines reports on agent coordination, training incentives and the growing use of AI to evaluate other AI systems.AI SafetyIngeniería de agentesModelos y entrenamiento+1