필터 결과
10개정렬
36:19ENThe Benchmark Grid Is Broken: Why Test-Time Compute Has Outrun How We Score Models진행자 Sarah Guo, Elad GilOpenAI researcher Noam Brown argues that static leaderboards hide how long a model is allowed to think — and that safety evals, research taste, and the release cycle have not caught up.
32:59ENA Hundred People, a Billion in Revenue, and Zero Venture Money진행자 Sarah Guo, Elad GilSurge AI founder Edwin Chen on why quality human data is a poetry problem, not a bounding-box problem, and why leaderboards keep training models to write clickbait.
26:00ENWhy a Zapier founder thinks AGI research has been stalled for four years진행자 Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
53:37EN30 models, 42 scenarios, 7 metrics: Percy Liang's public checkup for language models진행자 Sarah Guo, Elad GilA PubMed-only model once led the U.S. medical licensing exam — until a system roughly 200 times larger overtook it.
2:34:20ENIntelligence Is How Efficiently You Acquire Skills You Were Not Prepared For게스트 François Chollet · 진행자 Lex FridmanFrançois Chollet tells Lex Fridman why skill is not intelligence, why GPT-3 is still pattern matching, and why a grid puzzle called ARC still separates children from machines.
1:49:51ENThe Idea Once Called a Devolution Now Powers Almost Every New Chip게스트 David Patterson · 진행자 Lex FridmanTuring Award winner David Patterson talks with Lex Fridman about RISC, RAID, Moore's Law, open hardware, and why chips without a software stack die.
16:03ENQuantum Supremacy Is a Well-Defined Speedup, Not a Useful Task게스트 Scott Aaronson · 진행자 Lex FridmanScott Aaronson explains what Google's 53-qubit experiment actually demonstrated, how it was verified, and why complexity theory can offer evidence but not proof against classical spoofing.
11:11ENYann LeCun on Benchmarks, Interactive Environments, and Why Human Intelligence Is Not General게스트 Yann Lecun · 진행자 Lex FridmanIn a 2019 clip, LeCun defends benchmarks as a test of AI claims, explains why interactive environments break the usual train-test protocol, and argues that "general intelligence" is a misnomer.
14:41ENTalking for 20 Minutes: How the Alexa Prize Turns Real Customers into a Testbed for Conversational AI게스트 Rohit Prasad · 진행자 Lex FridmanRohit Prasad, head scientist of Amazon Alexa, explains the Alexa Prize grand challenge, how it is judged and why true conversation still needs reasoning.
1:00:25ENCan Machines Think? A Guided Tour of Turing's Test, Its Critics and Its Successors게스트 Turing Test · 진행자 Lex FridmanLex Fridman walks through Alan Turing's 1950 paper, the objections to it, and the benchmarks that have tried to replace or extend the imitation game.









