Résultats
11 articlesTrier
18:31ENJanie Gu and Suyeol Yun: Why Frontier Models Fail as Buy-Side AnalystsJanie Gu, Suyeol Yun · Google DeepMindJanie Gu explains why benchmark scores can mislead, while Suyeol Yun presents MandateBench, which tests whether a model can turn a fund mandate into a defensible investment memo. The two talks show why real workflows, reproducible grading, and evidence-backed reasoning matter.
36:19ENThe Benchmark Grid Is Broken: Why Test-Time Compute Has Outrun How We Score ModelsAnime : Sarah Guo, Elad GilOpenAI researcher Noam Brown argues that static leaderboards hide how long a model is allowed to think — and that safety evals, research taste, and the release cycle have not caught up.
32:59ENA Hundred People, a Billion in Revenue, and Zero Venture MoneyAnime : Sarah Guo, Elad GilSurge AI founder Edwin Chen on why quality human data is a poetry problem, not a bounding-box problem, and why leaderboards keep training models to write clickbait.
26:00ENWhy a Zapier founder thinks AGI research has been stalled for four yearsAnime : Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
53:37EN30 models, 42 scenarios, 7 metrics: Percy Liang's public checkup for language modelsAnime : Sarah Guo, Elad GilA PubMed-only model once led the U.S. medical licensing exam — until a system roughly 200 times larger overtook it.
2:34:20ENIntelligence Is How Efficiently You Acquire Skills You Were Not Prepared ForInvité : François Chollet · Anime : Lex FridmanFrançois Chollet tells Lex Fridman why skill is not intelligence, why GPT-3 is still pattern matching, and why a grid puzzle called ARC still separates children from machines.
1:49:51ENThe Idea Once Called a Devolution Now Powers Almost Every New ChipInvité : David Patterson · Anime : Lex FridmanTuring Award winner David Patterson talks with Lex Fridman about RISC, RAID, Moore's Law, open hardware, and why chips without a software stack die.
16:03ENQuantum Supremacy Is a Well-Defined Speedup, Not a Useful TaskInvité : Scott Aaronson · Anime : Lex FridmanScott Aaronson explains what Google's 53-qubit experiment actually demonstrated, how it was verified, and why complexity theory can offer evidence but not proof against classical spoofing.
11:11ENYann LeCun on Benchmarks, Interactive Environments, and Why Human Intelligence Is Not GeneralInvité : Yann Lecun · Anime : Lex FridmanIn a 2019 clip, LeCun defends benchmarks as a test of AI claims, explains why interactive environments break the usual train-test protocol, and argues that "general intelligence" is a misnomer.
14:41ENTalking for 20 Minutes: How the Alexa Prize Turns Real Customers into a Testbed for Conversational AIInvité : Rohit Prasad · Anime : Lex FridmanRohit Prasad, head scientist of Amazon Alexa, explains the Alexa Prize grand challenge, how it is judged and why true conversation still needs reasoning.
1:00:25ENCan Machines Think? A Guided Tour of Turing's Test, Its Critics and Its SuccessorsInvité : Turing Test · Anime : Lex FridmanLex Fridman walks through Alan Turing's 1950 paper, the objections to it, and the benchmarks that have tried to replace or extend the imitation game.









