絞り込み結果
5 件並び順
2:10:42EN
Cognitive Revolution "How AI Changes Everything"· 2026年8月28日ポッドキャストThe Exam Papers Nobody Auditsホスト Nathan LabenzFrontier labs buy reinforcement-learning environments from a cottage industry of small vendors, and almost nobody checks whether those tests match the real work.
1:46:41ENCognitive Revolution "How AI Changes Everything"· 2024年12月21日ポッドキャストFrontier Models Hit the 10th–40th Percentile on Real AI R&Dホスト Nathan LabenzNeev Parikh of METR walks Nathan Labenz through REBench, a seven-task test of whether agents can do machine learning research—and what happened when one of them decided not to train.
1:23:37ENCognitive Revolution "How AI Changes Everything"· 2024年10月23日ポッドキャストNine of the top ten research ideas were Claude'sホスト Nathan LabenzStanford PhD student Chenglei Si ran a blind study pitting Claude 3.5 Sonnet against more than a hundred NLP researchers on novel research ideas.
1:54:17ENCognitive Revolution "How AI Changes Everything"· 2024年8月28日ポッドキャストMetaculus Flagged Covid in January 2020. Now It Is Putting AI on the Forecasting Deskホスト Nathan LabenzNathan Labenz talks with Metaculus CEO Deger Turan about epistemic security, a year-long bot tournament, and why a useful forecast is harder than an accurate one.
1:56:03ENCognitive Revolution "How AI Changes Everything"· 2024年7月13日ポッドキャストHumans Near a Perfect Score. The Best AI Still Gets 39%ホスト Nathan LabenzZapier co-founder Mike Knoop and François Chollet put $1 million on ARC-AGI, a 2019 test of sample-efficient intelligence that language models still cannot crack under a one-cent-per-puzzle budget.