AGI Beyond Chatbots: A 2023 Debate on Autonomy and Safety

In September 2023, the presenter reviews interviews and articles about artificial general intelligence. His central argument is that the systems companies envision could act with tools and pursue goals, rather than only answer questions in a chat window. The timelines discussed are historical forecasts, not established outcomes.

A Wired report says OpenAI’s board would determine whether AGI had been achieved, while the criteria were not publicly clear. The presenter compares two broad descriptions used by OpenAI: systems generally smarter than people and highly autonomous systems outperforming humans at most economically valuable work.

The report discusses how an AGI determination could affect OpenAI’s financial arrangements and its relationship with Microsoft. The presenter speculates that vague definitions might create incentives for disagreement; that is his interpretation, not a finding about either company’s intentions.

He cites reporting that Sam Altman viewed AGI as a major historical event and had previously predicted extensive automation and job displacement. Mustafa Suleyman similarly argues that AI tools could eventually replace labor, not merely augment it. These are forecasts about economic effects.

The presenter contrasts an earlier vision of many smaller AI systems with Altman’s later discussions of superintelligence. He describes the possibility of systems as productive as a large corporation, but those descriptions are ambitions and predictions rather than a demonstrated capability.

He quotes then OpenAI chief scientist Ilya Sutskever on the possibility of systems becoming highly capable and difficult for humans to understand. The parent-child analogy he discusses is a speculative proposal about alignment, not evidence that models have parental feelings or intentions.

Autonomy could change the picture beyond conversation. The presenter describes a proposed test in which a system designs a product, arranges manufacturing, negotiates details and sells it using digital tools. This is an example of a proposed capability test, not a demonstration that a particular model completed it.

He notes an apparent tension in Suleyman’s views: the Inflection AI co-founder imagined a personal digital chief of staff, while saying the company was not pursuing recursive self-improvement or autonomous capabilities in the way discussed. The interview reflects his position at that time.

A 2023 article shown in the video attributes a forecast of matching top human mathematicians by 2026 to Christian Szegedy. Separately, mathematician Terence Tao expressed hope that a suitably used AI system could become a trustworthy research co-author around that time. Neither statement establishes that either forecast was realized.

The presenter brings in discussion of AI systems that could help improve future systems, citing OpenAI and Suleyman. He stresses that unexpected capabilities and accelerated development are possibilities raised by the sources, not guaranteed consequences of scaling.

Suleyman predicted models might become dramatically larger over a few years and described possible concentration of power. The presenter treats these as striking 2023 predictions; their outcome depends on what “larger” means and on later developments.

Suleyman uses the WannaCry ransomware attack as a starting point for a hypothetical self-improving attack that could resist shutdown. It is presented as a risk scenario, not evidence that the described weapon existed or was deployed.

The presenter turns to Demis Hassabis and a Time profile recounting early concerns about powerful AI and Elon Musk’s reported attempt to prevent DeepMind’s sale to Google. He also notes Hassabis’s early optimism about Gemini, which had not yet been released when this video was made.

The video discusses Neuralink and a proposed human settlement on Mars as ideas associated with Musk’s response to AI risk. These are reported visions, not demonstrated solutions to the safety issues under discussion.

Asked about capabilities that might stop a model’s release, Hassabis says better practical evaluations are needed. He gives deception and replication across data centers as examples of capabilities researchers might want to test, while emphasizing that rigorous definitions are needed.

The presenter contrasts that approach with Suleyman’s 2023 view that powerful models were already being developed in public and that a fully contained oracle was an unrealistic metaphor. Suleyman argued that openness allows scrutiny and that there was still time to address risks.

Hassabis instead describes the possibility of holding back a system that failed future evaluations and investigating it in a hardened sandbox. He suggests that even a few years could be a short period for the necessary research. These are proposed approaches and time estimates, not guarantees of containment.

The presenter says his own view is closer to Hassabis’s and hopes society can gain benefits such as medical advances while avoiding dangerous uses. He points to the forthcoming 2023 UK AI summit and closes by reiterating that the debate concerns capabilities beyond chatbots.