Results
59 articlesSort
2:04:45EN
Cognitive Revolution "How AI Changes Everything"· Jan 7, 2025Podcasto3 Hit Superhuman on ARC-AGI. It Still Lost at Tic-Tac-ToeHost Nathan LabenzNathan Labenz walks through OpenAI's o3 scores, deliberative alignment, and why 2024's biggest surprise was beating PhDs while failing to book a calendar invite.
1:49:41ENCognitive Revolution "How AI Changes Everything"· Nov 21, 2024PodcastA Team of Fifteen Matched Meta’s Post-Training on Meta’s Own BaseHost Nathan LabenzNathan Lambert walks through Tulu 3: the three-stage recipe, the 1 percent versus 14 percent lesson, and why open post-training now lives or dies on data and evals.
2:24:18ENCognitive Revolution "How AI Changes Everything"· Oct 30, 2024PodcastMMLU Stays at Chance Until Late Training. Loss Is Only an Alarm.Host Nathan LabenzZyphra’s training lead walks through Zamba 2’s hybrid architecture, the evals that actually matter, and the trade secrets small labs still have to rediscover.
1:18:32ENCognitive Revolution "How AI Changes Everything"· Sep 20, 2024PodcastA DNA Model That Can Tell Which Genes You Cannot TouchHost Nathan LabenzStanford's Brian Hie walks through hybrid architectures, a genome-scale language model trained only on DNA, and an antibody that binds 25 times tighter than nature.
2:04:15ENCognitive Revolution "How AI Changes Everything"· Aug 14, 2024PodcastA parrot cannot paraphrase — and Claude cannot be talked into harmHost Nathan LabenzRobert Wright of the Nonzero podcast interviews Nathan Labenz on whether large language models understand anything, what Anthropic’s 10 million features actually show, and why open weights collide with U.S.–China policy.
1:42:16ENCognitive Revolution "How AI Changes Everything"· Jul 4, 2024Podcast267 Papers in Seven Months: Albert Gu Explains the State Space Model RevolutionHost Nathan LabenzThe Mamba co-author walks through five years of recurrent-model work, why selective compression beats a growing KV cache, and what Mamba 2 trades away to train faster.
1:54:01ENCognitive Revolution "How AI Changes Everything"· Jun 26, 2024PodcastA Tiny Network Grew a Salt Crystal the Training Data Never ShowedHost Nathan LabenzTim Duignan trained tens of thousands of parameters on salt water. The model invented a crystal — and a continuum solvent theory he had spent a PhD failing to write by hand.
1:37:07ENCognitive Revolution "How AI Changes Everything"· Jun 22, 2024PodcastA Text-Only AI Outdiagnosed GPs. Google Still Won't Ship It.Host Nathan LabenzGoogle researchers Vivek Natarajan and Khaled Saab walk Nathan Labenz through five medical-AI papers, from radiology reports to an AI doctor that still has to earn trust.
1:59:15ENCognitive Revolution "How AI Changes Everything"· May 25, 2024PodcastA Protein Backbone in a Minute: The Real Progress, Bottlenecks, and Risks of AI BiologyHost Nathan LabenzThe White House set a thousand-fold lower reporting bar for biological models than for language models—and this conversation shows why that gap already looks prescient.
58:28ENCognitive Revolution "How AI Changes Everything"· May 22, 2024PodcastFrom Jailbreaking ChatGPT to Anthropic’s First Prompt Engineer: How Alex Albert Ships Claude 3Host Nathan LabenzA year after building jailbreakchat.com, Alex Albert walks Nathan Labenz through Claude 3’s writing, orchestration, character work, and the guardrails app developers still skip.
1:01:39ENCognitive Revolution "How AI Changes Everything"· Apr 13, 2024PodcastGPT-5 Wants 100 Trillion Tokens. Does Earth Have Enough?Host Nathan LabenzTraining GPT-3 took about a trillion tokens; GPT-4 took about ten trillion. The next jump is a data question as much as a compute one.
1:19:24ENCognitive Revolution "How AI Changes Everything"· Apr 5, 2024PodcastA Gibberish Prompt Unlocks What GPT-J Plans Three Tokens AheadHost Nathan LabenzNortheastern’s Bau Lab shows that a 40,000-parameter soft prompt can read a model’s future words, and that about ten attention heads carry the task itself.
1:20:44ENCognitive Revolution "How AI Changes Everything"· Mar 30, 2024PodcastSeeing Like a Mamba: Vision, Rotting States, and a Cell Model in 90 DaysHost Nathan LabenzNathan Labenz and Jason Meaux survey the vision papers, long-context experiments, and biology work that followed the original Mamba release.
1:58:43ENCognitive Revolution "How AI Changes Everything"· Feb 7, 2024PodcastA Worm With 302 Neurons Already Makes Trade-offs. AI Is Still on the Same Ladder.Host Nathan LabenzMax Bennett maps 600 million years of brain evolution onto five breakthroughs — and asks which rungs today's models have actually reached.
2:30:06ENCognitive Revolution "How AI Changes Everything"· Dec 22, 2023PodcastTrained on a Thirtieth of GPT-4's Tokens, Mamba Beat Transformers on Home TurfHost Nathan LabenzIn a solo emergency episode, Nathan Labenz argues that Albert Gu and Tri Dao's selective state space model is the first architecture since 2017 that deserves to share the Transformer’s throne.
1:19:24ENCognitive Revolution "How AI Changes Everything"· Nov 17, 2023PodcastA Toy Paper Did Not Prove LLMs Cannot Generalize. The Discourse Still Ran With It.Host Nathan LabenzNathan Labenz and Erik Torenberg unpack a viral DeepMind result, a weekend reproduction, and a premature war over voluntary AI commitments.
1:21:50ENCognitive Revolution "How AI Changes Everything"· Nov 14, 2023PodcastA 16K Context Window Holds About 350 Rows. That's Why Tables Need an Agent.Host Nathan LabenzGretel AI founder Alex Watson tells Nathan Labenz why most company data is still a spreadsheet, why GPT-4 is the wrong tool for generating it, and how differential privacy lets a model learn a disease without learning a patient.
1:19:52ENCognitive Revolution "How AI Changes Everything"· Oct 18, 2023Podcast1,000 H100s Take 115 Days; 22,000 Take FiveHost Nathan LabenzNathan Labenz and Trey Kollmer walk through cluster math that turns GPT-4-scale training into a weekly experiment, then four papers on search-augmented models, recursive code improvers, spatial maps inside Llama 2, and what networks do when they have no idea.
55:08ENCognitive Revolution "How AI Changes Everything"· Aug 29, 2023PodcastOne Model Inside 38 Products: Paige Bailey on How Google Trains and Ships PaLM 2Host Nathan LabenzAt Google I/O in May 2023, PaLM 2 arrived already running in more than two dozen products — and its lead product manager walks through what that actually took.
52:48ENCognitive Revolution "How AI Changes Everything"· Aug 25, 2023PodcastOpenAI Cut Fine-Tuning 90 Percent, and Founders Crossed Llama 2 Off the ListHost Nathan LabenzNathan Labenz and Erik Torenberg walk through GPT-3.5 Turbo fine-tuning, why self-hosting still loses on total cost, and what is actually working in code, school, and medicine.
2:13:07ENCognitive Revolution "How AI Changes Everything"· Jul 27, 2023PodcastHalf an Hour to a Circuit in GPT-2 Small — and a Quadratic Wall Before GPT-3Host Nathan LabenzArthur Conmy walks Nathan Labenz through ACDC, the algorithm that automates the most tedious step of mechanistic interpretability: finding which transformer components actually do a task.
1:33:56ENCognitive Revolution "How AI Changes Everything"· Jul 6, 2023PodcastThe AI Scouting Report: 90 Minutes From GPT-4's Exam Scores to Whether Models UnderstandHost Nathan LabenzNathan Labenz spends a solo episode walking through what general-purpose models can do, how they are trained, how capabilities unlock, and whether they understand anything at all.
1:32:22ENCognitive Revolution "How AI Changes Everything"· Jun 29, 2023PodcastA Million Bytes and 256 Symbols: Meta's MEGABYTE Wants to Throw the Tokenizer AwayHost Nathan LabenzLili Yu of Meta AI explains a multiscale transformer that predicts million-byte sequences, skips tokenization, and aims to model any file as raw bytes.
1:52:46ENCognitive Revolution "How AI Changes Everything"· Jun 27, 2023PodcastCharge Neural Nets by Connection Length, and the Black Box Splits Into Modules You Can SeeHost Nathan LabenzMIT physicist Ziming Liu walks Nathan Labenz through BIMT, a brain-inspired training trick that sparsifies networks until you can read them by looking.Load moreShowing 24 of 59