筛选结果
11 篇排序
18:31EN → 简体中文
AI Engineer· 2026年10月25日Janie Gu 与 Suyeol Yun：为什么前沿模型做不好买方分析师Janie Gu, Suyeol Yun · Google DeepMindJanie Gu 解释了基准分数为何可能误导人；Suyeol Yun 则介绍 MandateBench，它测试模型能否把基金投资授权转化为有理有据的投资备忘录。两场分享说明，真实工作流程、可复现的评分和有证据支撑的推理为何至关重要。
36:19EN
No Priors: AI, Machine Learning, Tech, & Startups· 2026年6月26日播客 · 2 人对谈The Benchmark Grid Is Broken: Why Test-Time Compute Has Outrun How We Score Models主持 Sarah Guo, Elad GilOpenAI researcher Noam Brown argues that static leaderboards hide how long a model is allowed to think — and that safety evals, research taste, and the release cycle have not caught up.
32:59ENNo Priors: AI, Machine Learning, Tech, & Startups· 2025年7月24日播客 · 2 人对谈A Hundred People, a Billion in Revenue, and Zero Venture Money主持 Sarah Guo, Elad GilSurge AI founder Edwin Chen on why quality human data is a poetry problem, not a bounding-box problem, and why leaderboards keep training models to write clickbait.
26:00ENNo Priors: AI, Machine Learning, Tech, & Startups· 2024年6月11日播客 · 2 人对谈Why a Zapier founder thinks AGI research has been stalled for four years主持 Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
53:37ENNo Priors: AI, Machine Learning, Tech, & Startups· 2023年3月9日播客 · 2 人对谈30 models, 42 scenarios, 7 metrics: Percy Liang's public checkup for language models主持 Sarah Guo, Elad GilA PubMed-only model once led the U.S. medical licensing exam — until a system roughly 200 times larger overtook it.
2:34:20EN → 简体中文
Lex Fridman· 2020年8月30日播客 · 2 人对谈智能，是你习得未曾准备过的技能的效率嘉宾 François Chollet · 主持 Lex FridmanFrançois Chollet 对 Lex Fridman 说，技能不等于智能，GPT-3 仍然只是在做模式匹配，而一种名为 ARC 的网格谜题，至今仍能把孩子和机器区分开。
1:49:51EN → 简体中文Lex Fridman· 2020年6月27日播客 · 2 人对谈曾被斥为倒退的设计思路，如今几乎驱动着每一款新芯片嘉宾 David Patterson · 主持 Lex Fridman图灵奖得主 David Patterson 与 Lex Fridman 谈精简指令集（RISC）、RAID、摩尔定律（Moore's Law）、开放硬件，以及没有软件栈的芯片为何难以存活。
16:03ENLex Fridman· 2020年2月22日播客 · 2 人对谈Quantum Supremacy Is a Well-Defined Speedup, Not a Useful Task嘉宾 Scott Aaronson · 主持 Lex FridmanScott Aaronson explains what Google's 53-qubit experiment actually demonstrated, how it was verified, and why complexity theory can offer evidence but not proof against classical spoofing.
11:11ENLex Fridman播客 · 2 人对谈Yann LeCun on Benchmarks, Interactive Environments, and Why Human Intelligence Is Not General嘉宾 Yann Lecun · 主持 Lex FridmanIn a 2019 clip, LeCun defends benchmarks as a test of AI claims, explains why interactive environments break the usual train-test protocol, and argues that "general intelligence" is a misnomer.
14:41ENLex Fridman播客 · 2 人对谈Talking for 20 Minutes: How the Alexa Prize Turns Real Customers into a Testbed for Conversational AI嘉宾 Rohit Prasad · 主持 Lex FridmanRohit Prasad, head scientist of Amazon Alexa, explains the Alexa Prize grand challenge, how it is judged and why true conversation still needs reasoning.
1:00:25ENLex Fridman播客 · 2 人对谈Can Machines Think? A Guided Tour of Turing's Test, Its Critics and Its Successors嘉宾 Turing Test · 主持 Lex FridmanLex Fridman walks through Alan Turing's 1950 paper, the objections to it, and the benchmarks that have tried to replace or extend the imitation game.