筛选结果
11 篇排序
18:31EN → 简体中文Janie Gu 与 Suyeol Yun:为什么前沿模型做不好买方分析师Janie Gu, Suyeol Yun · Google DeepMindJanie Gu 解释了基准分数为何可能误导人;Suyeol Yun 则介绍 MandateBench,它测试模型能否把基金投资授权转化为有理有据的投资备忘录。两场分享说明,真实工作流程、可复现的评分和有证据支撑的推理为何至关重要。
36:19ENThe Benchmark Grid Is Broken: Why Test-Time Compute Has Outrun How We Score Models主持 Sarah Guo, Elad GilOpenAI researcher Noam Brown argues that static leaderboards hide how long a model is allowed to think — and that safety evals, research taste, and the release cycle have not caught up.
32:59ENA Hundred People, a Billion in Revenue, and Zero Venture Money主持 Sarah Guo, Elad GilSurge AI founder Edwin Chen on why quality human data is a poetry problem, not a bounding-box problem, and why leaderboards keep training models to write clickbait.
26:00ENWhy a Zapier founder thinks AGI research has been stalled for four years主持 Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
53:37EN → 简体中文30 个模型、42 个场景、7 项指标:Percy Liang 为语言模型做的公开体检主持 Sarah Guo, Elad Gil一个只用 PubMed 论文训练的模型,曾在美国医师执照考试中名列前茅,直到一个规模约大 200 倍的系统超过了它。
2:34:20EN → 简体中文智能,是你习得未曾准备过的技能的效率嘉宾 François Chollet · 主持 Lex FridmanFrançois Chollet 对 Lex Fridman 说,技能不等于智能,GPT-3 仍然只是在做模式匹配,而一种名为 ARC 的网格谜题,至今仍能把孩子和机器区分开。
1:49:51EN → 简体中文曾被斥为倒退的设计思路,如今几乎驱动着每一款新芯片嘉宾 David Patterson · 主持 Lex Fridman图灵奖得主 David Patterson 与 Lex Fridman 谈精简指令集(RISC)、RAID、摩尔定律(Moore's Law)、开放硬件,以及没有软件栈的芯片为何难以存活。
16:03ENQuantum Supremacy Is a Well-Defined Speedup, Not a Useful Task嘉宾 Scott Aaronson · 主持 Lex FridmanScott Aaronson explains what Google's 53-qubit experiment actually demonstrated, how it was verified, and why complexity theory can offer evidence but not proof against classical spoofing.
11:11ENYann LeCun on Benchmarks, Interactive Environments, and Why Human Intelligence Is Not General嘉宾 Yann Lecun · 主持 Lex FridmanIn a 2019 clip, LeCun defends benchmarks as a test of AI claims, explains why interactive environments break the usual train-test protocol, and argues that "general intelligence" is a misnomer.
14:41ENTalking for 20 Minutes: How the Alexa Prize Turns Real Customers into a Testbed for Conversational AI嘉宾 Rohit Prasad · 主持 Lex FridmanRohit Prasad, head scientist of Amazon Alexa, explains the Alexa Prize grand challenge, how it is judged and why true conversation still needs reasoning.
1:00:25ENCan Machines Think? A Guided Tour of Turing's Test, Its Critics and Its Successors嘉宾 Turing Test · 主持 Lex FridmanLex Fridman walks through Alan Turing's 1950 paper, the objections to it, and the benchmarks that have tried to replace or extend the imitation game.









