Kürzlich aktualisierte Kanäle

Wählen, um nur diesen Kanal zu sehenAlle Kanäle →

Ergebnisse

5 Artikel
Sortieren
2:10:42EN
Cognitive Revolution "How AI Changes Everything"· 28. Aug. 2026PodcastThe Exam Papers Nobody AuditsModeration: Nathan LabenzFrontier labs buy reinforcement-learning environments from a cottage industry of small vendors, and almost nobody checks whether those tests match the real work.Evals & ObservabilityEvalsReward hacking+3
1:46:41EN
Cognitive Revolution "How AI Changes Everything"· 21. Dez. 2024PodcastFrontier Models Hit the 10th–40th Percentile on Real AI R&DModeration: Nathan LabenzNeev Parikh of METR walks Nathan Labenz through REBench, a seven-task test of whether agents can do machine learning research—and what happened when one of them decided not to train.Evals & ObservabilityEvalsBenchmarks+3
1:23:37EN
Cognitive Revolution "How AI Changes Everything"· 23. Okt. 2024PodcastNine of the top ten research ideas were Claude'sModeration: Nathan LabenzStanford PhD student Chenglei Si ran a blind study pitting Claude 3.5 Sonnet against more than a hundred NLP researchers on novel research ideas.Evals & ObservabilityEvalsBenchmarks+3
1:54:17EN
Cognitive Revolution "How AI Changes Everything"· 28. Aug. 2024PodcastMetaculus Flagged Covid in January 2020. Now It Is Putting AI on the Forecasting DeskModeration: Nathan LabenzNathan Labenz talks with Metaculus CEO Deger Turan about epistemic security, a year-long bot tournament, and why a useful forecast is harder than an accurate one.Evals & ObservabilityEvalsBenchmarks+3
1:56:03EN
Cognitive Revolution "How AI Changes Everything"· 13. Juli 2024PodcastHumans Near a Perfect Score. The Best AI Still Gets 39%Moderation: Nathan LabenzZapier co-founder Mike Knoop and François Chollet put $1 million on ARC-AGI, a 2019 test of sample-efficient intelligence that language models still cannot crack under a one-cent-per-puzzle budget.Evals & ObservabilityAGIBenchmarks+3