En 30 secondes
François Chollet argues that science is a recursively self-improving problem-solving system whose resource consumption grows exponentially while its output of significant discoveries stays roughly linear. He takes this as evidence that a superhuman AI would also run into mounting bottlenecks rather than an intelligence explosion, and suggests the singularity narrative works more like a belief system than a scientific argument.
- 1Recursive self-improvement is real, but it rarely produces an explosion,because no system exists in isolation and fixing one part makes another part the bottleneck.
- 2Science consumes exponentially more resources for roughly linear outputCounts of papers and patents mostly track how many people work in science, not how much knowledge it creates.
- 3Michael Nielsen's analysis found a flat "temporal density of significance"across physics, biology, and medicine, when experts rated historic discoveries over the past 100 to 150 years.
- 4As a field matures, each next discovery needs far more effortEarly researchers pick low-hanging fruit, while later ones need larger teams to achieve the same impact.
- 5Exponential progress triggers exponential friction:communication overhead, the knowledge needed to contribute in fields like quantum mechanics, and ever more expensive experiments.
- 6For many people AI is more a belief system than a subfield,and questioning the singularity can feel like attacking their identity.
Lire la transcription complète par chapitre
Science improves itself recursively, yet its output stays linear while resource use explodes
Asked why an intelligence explosion would not be possible, Chollet starts by granting the premise: any problem-solving process can be accelerated, and recursive self-improvement is a real thing. What typically happens is not an explosion, though. No system exists in isolation, so tweaking one part makes another part the bottleneck.
Science is his main example, since it is clearly a recursively self-improving problem-solving system. Scientific progress is not exploding, he says. What you see instead is a system consuming an exponentially increasing amount of resources while producing linear output in terms of progress.
He says that claims of exponential scientific progress usually look at indicators such as the number of papers published or patents filed. Those are just correlated with how many people are working on science today, so they measure resource consumption. What matters is the output: the scope and significance of the problems solved.
Measuring the significance of discoveries gives a flat curve, which fits diminishing returns
Chollet points to a paper by Michael Nielsen that tried to measure scientific output. Nielsen took the timeline of discoveries over the past 100 to 150 years and had panels of experts rate each discovery's significance. If output were exponential, the temporal density of significance should rise exponentially.
What the plot shows, Chollet says, is very much a flat graph, across physics, biology, medicine, and other disciplines. He finds that plausible: a century ago physics was in a period of crazy change, and 130 years ago technology was replacing horses with cars and spreading electricity. Today is also a time of fast change, but it would be unfair to say technology now moves much faster than it did 50 or 100 years ago.
His interpretation is that as you progress in a field, further progress gets exponentially harder. The first people in a new field like information theory find low-hanging fruit, while the next generation must dig harder for smaller discoveries and needs a much larger headcount to match the impact. The number of scientists and the computing resources available to science are growing exponentially, yet the output of significance is linear.
This holds even though science feeds back on itself, Chollet notes. Computers and the internet are products of science that speed up science, since the internet lets researchers exchange papers and ideas much faster. Even so, the system consumes ever more resources to produce the same amount of problem-solving.
Deep learning probably follows the same pattern, and friction would limit any AI explosion
Host Lex Fridman asks whether this holds for the deep learning community. Chollet says it would need more thought, but suggests the significance per paper may even be decreasing while the number of papers grows exponentially. In aggregate he guesses you would still see roughly linear progress.
He doesn't think it is a coincidence that progress is linear despite exponential resource consumption. His idea is that resource consumption adjusts dynamically to maintain linear progress, as a community expects it. If investment drops, lower-hanging fruit becomes available and someone steps up to pick it, much like a market for discoveries and ideas.
The general principle, in his words, is that exponential progress triggers exponential friction. He gives the analogy of a device that measures its own acceleration and adds more in proportion: it will not reach infinite speed, because air friction caps it, and if that is removed some other limit steps in, maybe even the speed of light.
Science as an institution shows the same thing. More researchers means more communication overhead, and in a field like quantum mechanics there is a huge body of knowledge to absorb before you can contribute. Significant experiments also need exponentially more expensive equipment, because the easier ones have already been run. Chollet thinks this is a good model for what would happen with superhuman AI.
The intelligence explosion works like a belief system, which explains the pushback
Chollet is careful to say that this is an intuition and an argument, not a mathematical proof. He is not trying to prove anything, only to question the intelligence explosion narrative, which he calls quite dominant.
He says people push back hard on it because for many of them AI is not just a subfield of computer science but more of a belief system. It includes the belief that the world is heading toward a singularity after which things go exponential, the world is transformed, and humans become obsolete. Since it is not really a scientific argument, but part of many people's identity, questioning it feels like an attack, which he compares to saying that God does not exist.
Sur la même chaîne
3:36:56EN
Lex Fridman· 16 sept. 2026PodcastPsychiatry Has Never Found Its PenicillinAnime : Lex FridmanHistorian Andrew Scull tells Lex Fridman why the field can ease symptoms, has never cured a major mental illness, and keeps paying for overconfidence with patients' lives.
5:15:51ENLex Fridman· 26 août 2026Podcast · 2 voixDHH Did Not Write a Line of Omarchy QuattroInvité : DHH · Anime : Lex FridmanThirteen months after a skeptical conversation with Lex Fridman, the Rails creator describes how Opus 4.5, a swarm of coding agents, and a one-minute Linux installer ended his era of hand-chiseled Ruby.
3:12:58ENLex Fridman· 12 août 2026Podcast · 2 voixOne Cold Shower, Twenty Champions: How Khabib Nurmagomedov Was ForgedInvité : Khabib Nurmagomedov · Anime : Lex FridmanIn a Makhachkala school gym, seventy men shared one shower, and the water was only cold.
3:46:18ENLex Fridman· 28 juil. 2026Podcast · 2 voixIf You Take Slavery Out of the Picture, There Is No Civil WarInvité : Gary Gallagher · Anime : Lex FridmanIn 1860, enslaved people were worth more than every railroad and factory in the United States combined.
3:51:47ENLex Fridman· 30 juin 2026Podcast · 2 voixForty-Six Percent of Emperors Were Overthrown. The Empire Lasted AnywayInvité : Anthony Kaldellis · Anime : Lex FridmanHistorian Anthony Kaldellis walks Lex Fridman through 2,200 years of Roman history and argues that what we call Byzantium was Rome itself.
2:53:42ENLex Fridman· 29 mai 2026Podcast · 2 voixThe Moon Is Falling. It Just Keeps Missing.Invité : Biggest Mysteries in Physics · Anime : Lex FridmanFermilab physicist Don Lincoln tells Lex Fridman that the history of physics is a history of unification, and that antimatter, dark energy, and a theory of everything still sit far beyond the experiments we can run.