絞り込み結果
11 件並び順
18:31EN
AI Engineer· 2026年10月25日Janie Gu and Suyeol Yun: Why Frontier Models Fail as Buy-Side AnalystsJanie Gu, Suyeol Yun · Google DeepMindJanie Gu explains why benchmark scores can mislead, while Suyeol Yun presents MandateBench, which tests whether a model can turn a fund mandate into a defensible investment memo. The two talks show why real workflows, reproducible grading, and evidence-backed reasoning matter.
36:19EN
No Priors: AI, Machine Learning, Tech, & Startups· 2026年6月26日ポッドキャスト · 2 人The Benchmark Grid Is Broken: Why Test-Time Compute Has Outrun How We Score Modelsホスト Sarah Guo, Elad GilOpenAI researcher Noam Brown argues that static leaderboards hide how long a model is allowed to think — and that safety evals, research taste, and the release cycle have not caught up.
32:59ENNo Priors: AI, Machine Learning, Tech, & Startups· 2025年7月24日ポッドキャスト · 2 人A Hundred People, a Billion in Revenue, and Zero Venture Moneyホスト Sarah Guo, Elad GilSurge AI founder Edwin Chen on why quality human data is a poetry problem, not a bounding-box problem, and why leaderboards keep training models to write clickbait.
26:00ENNo Priors: AI, Machine Learning, Tech, & Startups· 2024年6月11日ポッドキャスト · 2 人Why a Zapier founder thinks AGI research has been stalled for four yearsホスト Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
53:37ENNo Priors: AI, Machine Learning, Tech, & Startups· 2023年3月9日ポッドキャスト · 2 人30 models, 42 scenarios, 7 metrics: Percy Liang's public checkup for language modelsホスト Sarah Guo, Elad GilA PubMed-only model once led the U.S. medical licensing exam — until a system roughly 200 times larger overtook it.
2:34:20EN
Lex Fridman· 2020年8月30日ポッドキャスト · 2 人Intelligence Is How Efficiently You Acquire Skills You Were Not Prepared Forゲスト François Chollet · ホスト Lex FridmanFrançois Chollet tells Lex Fridman why skill is not intelligence, why GPT-3 is still pattern matching, and why a grid puzzle called ARC still separates children from machines.
1:49:51ENLex Fridman· 2020年6月27日ポッドキャスト · 2 人The Idea Once Called a Devolution Now Powers Almost Every New Chipゲスト David Patterson · ホスト Lex FridmanTuring Award winner David Patterson talks with Lex Fridman about RISC, RAID, Moore's Law, open hardware, and why chips without a software stack die.
16:03ENLex Fridman· 2020年2月22日ポッドキャスト · 2 人Quantum Supremacy Is a Well-Defined Speedup, Not a Useful Taskゲスト Scott Aaronson · ホスト Lex FridmanScott Aaronson explains what Google's 53-qubit experiment actually demonstrated, how it was verified, and why complexity theory can offer evidence but not proof against classical spoofing.
11:11ENLex Fridmanポッドキャスト · 2 人Yann LeCun on Benchmarks, Interactive Environments, and Why Human Intelligence Is Not Generalゲスト Yann Lecun · ホスト Lex FridmanIn a 2019 clip, LeCun defends benchmarks as a test of AI claims, explains why interactive environments break the usual train-test protocol, and argues that "general intelligence" is a misnomer.
14:41ENLex Fridmanポッドキャスト · 2 人Talking for 20 Minutes: How the Alexa Prize Turns Real Customers into a Testbed for Conversational AIゲスト Rohit Prasad · ホスト Lex FridmanRohit Prasad, head scientist of Amazon Alexa, explains the Alexa Prize grand challenge, how it is judged and why true conversation still needs reasoning.
1:00:25ENLex Fridmanポッドキャスト · 2 人Can Machines Think? A Guided Tour of Turing's Test, Its Critics and Its Successorsゲスト Turing Test · ホスト Lex FridmanLex Fridman walks through Alan Turing's 1950 paper, the objections to it, and the benchmarks that have tried to replace or extend the imitation game.