Results
33 articlesSort
1:19:24EN
Cognitive Revolution "How AI Changes Everything"· Apr 5, 2024PodcastA Gibberish Prompt Unlocks What GPT-J Plans Three Tokens AheadHost Nathan LabenzNortheastern’s Bau Lab shows that a 40,000-parameter soft prompt can read a model’s future words, and that about ten attention heads carry the task itself.
1:57:04ENCognitive Revolution "How AI Changes Everything"· Dec 15, 2023PodcastGPT-4 Took the Insider Trade, Then Lied About ItHost Nathan LabenzApollo Research CEO Marius Hobbhahn walks Nathan Labenz through a one-afternoon red-team setup that got GPT-4 to break the law, invent a cover story, and deny the tip it had just used.
1:19:52ENCognitive Revolution "How AI Changes Everything"· Oct 18, 2023Podcast1,000 H100s Take 115 Days; 22,000 Take FiveHost Nathan LabenzNathan Labenz and Trey Kollmer walk through cluster math that turns GPT-4-scale training into a weekly experiment, then four papers on search-augmented models, recursive code improvers, spatial maps inside Llama 2, and what networks do when they have no idea.
1:14:36ENCognitive Revolution "How AI Changes Everything"· Oct 13, 2023PodcastZulu Bypasses GPT-4, and a Hundred Examples Undo the GuardrailsHost Nathan LabenzNathan Labenz reads seven papers — four hopeful, three not — on whether anyone can actually keep a language model under control.
2:13:07ENCognitive Revolution "How AI Changes Everything"· Jul 27, 2023PodcastHalf an Hour to a Circuit in GPT-2 Small — and a Quadratic Wall Before GPT-3Host Nathan LabenzArthur Conmy walks Nathan Labenz through ACDC, the algorithm that automates the most tedious step of mechanistic interpretability: finding which transformer components actually do a task.
1:33:56ENCognitive Revolution "How AI Changes Everything"· Jul 6, 2023PodcastThe AI Scouting Report: 90 Minutes From GPT-4's Exam Scores to Whether Models UnderstandHost Nathan LabenzNathan Labenz spends a solo episode walking through what general-purpose models can do, how they are trained, how capabilities unlock, and whether they understand anything at all.
1:52:46ENCognitive Revolution "How AI Changes Everything"· Jun 27, 2023PodcastCharge Neural Nets by Connection Length, and the Black Box Splits Into Modules You Can SeeHost Nathan LabenzMIT physicist Ziming Liu walks Nathan Labenz through BIMT, a brain-inspired training trick that sparsifies networks until you can read them by looking.
2:00:19ENCognitive Revolution "How AI Changes Everything"· Jun 6, 2023Podcast1.5 Million GPT-4 Fairy Tales Let a 33-Million-Parameter Model Out-Reason GPT-2Host Nathan LabenzTry this fill-in: Lily likes cats and dogs. She asked her mom for a dog. Mom said no, so she asked for a…
1:38:22ENCognitive Revolution "How AI Changes Everything"· May 19, 2023PodcastSix days after “slow down,” the plugins went liveHost Nathan LabenzConjecture CEO Connor Leahy talks GPT-4, the magic of black-box models, and cognitive emulation as a bounded alternative to god-like AGI.