Ergebnisse
11 ArtikelSortieren
35:19EN
AI Engineer· 25. Okt. 2026SallyAnn DeLucia: How to Write Your First AI EvalSallyAnn DeLucia · Arize AITurn an agent’s real traces into concrete pass/fail criteria, then build an LLM judge you can test, align with people, and run in production.
2:10:42EN
Cognitive Revolution "How AI Changes Everything"· 28. Aug. 2026PodcastThe Exam Papers Nobody AuditsModeration: Nathan LabenzFrontier labs buy reinforcement-learning environments from a cottage industry of small vendors, and almost nobody checks whether those tests match the real work.
48:00EN
Unsupervised Learning: With Jacob Effron· 15. Dez. 2025PodcastA Two-Second Vote Is Training Models to Be ClickbaitModeration: Jacob EffronSurge AI CEO Edwin Chen tells Redpoint why LMArena rewards length and emojis, how one lab's models got worse for a year, and why frontier labs are no longer on the same path.
54:53ENUnsupervised Learning: With Jacob Effron· 17. Juni 2025PodcastA Free Voting Board Burned $2 Million. Then It Raised $100 Million.Moderation: Jacob EffronDatabricks co-founder Ion Stoica explains why LMArena exists, why China is winning open-source models, and why reliability—not another scaling law—is still the thing holding AI back.
44:21ENUnsupervised Learning: With Jacob Effron· 4. Juni 2025PodcastMercor's CEO: Knowledge Work's Next Job Is Writing EvalsModeration: Jacob EffronBrendan Foody tells Redpoint how Mercor turned AI hiring and expert data into a $100 million round — and why he thinks a huge slice of white-collar work will become creating tests for models.
57:11ENUnsupervised Learning: With Jacob Effron· 30. Jan. 2025PodcastA Million Tokens Cannot Write a Good JokeModeration: Jacob EffronPrinceton's Arvind Narayanan on why agent evals mislead, inference scaling hits a wall, and AI looks more like the internet than an overnight revolution.
1:46:41ENCognitive Revolution "How AI Changes Everything"· 21. Dez. 2024PodcastFrontier Models Hit the 10th–40th Percentile on Real AI R&DModeration: Nathan LabenzNeev Parikh of METR walks Nathan Labenz through REBench, a seven-task test of whether agents can do machine learning research—and what happened when one of them decided not to train.
1:23:37ENCognitive Revolution "How AI Changes Everything"· 23. Okt. 2024PodcastNine of the top ten research ideas were Claude'sModeration: Nathan LabenzStanford PhD student Chenglei Si ran a blind study pitting Claude 3.5 Sonnet against more than a hundred NLP researchers on novel research ideas.
1:54:17ENCognitive Revolution "How AI Changes Everything"· 28. Aug. 2024PodcastMetaculus Flagged Covid in January 2020. Now It Is Putting AI on the Forecasting DeskModeration: Nathan LabenzNathan Labenz talks with Metaculus CEO Deger Turan about epistemic security, a year-long bot tournament, and why a useful forecast is harder than an accurate one.
1:56:03ENCognitive Revolution "How AI Changes Everything"· 13. Juli 2024PodcastHumans Near a Perfect Score. The Best AI Still Gets 39%Moderation: Nathan LabenzZapier co-founder Mike Knoop and François Chollet put $1 million on ARC-AGI, a 2019 test of sample-efficient intelligence that language models still cannot crack under a one-cent-per-puzzle budget.
1:07:48EN
Lenny's PodcastPodcastMost Productivity Metrics Are a Lie: Nicole Forsgren on Measuring Developer Experience in the AI EraModeration: Lenny RachitskyThe creator of DORA and SPACE explains why lines of code and old pipeline metrics fall short with AI, and how to start improving developer experience by listening, surveying and tying results to what leaders care about.