Results
198 articlesSort
1:40:22EN
Cognitive Revolution "How AI Changes Everything"· Jan 22, 2025PodcastTwenty-atom crystals taught an AI the physics of a heartbeatHost Nathan LabenzOrbital Materials' Jonathan Godwin and Tim Duignan tell Nathan Labenz how a neural network trained on tiny crystals simulated a potassium ion channel on a single 2017 GPU.
2:04:45ENCognitive Revolution "How AI Changes Everything"· Jan 7, 2025Podcasto3 Hit Superhuman on ARC-AGI. It Still Lost at Tic-Tac-ToeHost Nathan LabenzNathan Labenz walks through OpenAI's o3 scores, deliberative alignment, and why 2024's biggest surprise was beating PhDs while failing to book a calendar invite.
1:07:32EN
Unsupervised Learning: With Jacob Effron· Dec 18, 2024Podcasto1 Is a New Generation — and the Day AGI Arrives Will Feel BoringHost Jacob EffronOpenAI’s former chief research officer Bob McGrew on why o1 is a 100x leap, why agents stall on reliability, and why AGI may land as office tedium rather than a single dramatic moment.
48:18ENUnsupervised Learning: With Jacob Effron· Dec 6, 2024PodcastNoam Brown: There's No Hard Wall—Just Eight Orders of Magnitude of HeadroomHost Jacob EffronA ChatGPT query costs about a penny. The problems society cares about most, he says, are worth a million dollars.
1:49:41ENCognitive Revolution "How AI Changes Everything"· Nov 21, 2024PodcastA Team of Fifteen Matched Meta’s Post-Training on Meta’s Own BaseHost Nathan LabenzNathan Lambert walks through Tulu 3: the three-stage recipe, the 1 percent versus 14 percent lesson, and why open post-training now lives or dies on data and evals.
5:15:00EN
Lex Fridman· Nov 11, 2024Podcast · 2 speakersDario Amodei Has Seen This Scaling Movie Enough TimesGuest Dario Amodei · Host Lex FridmanAnthropic’s CEO puts numbers on frontier training costs and AGI, then hands the mic to the people who shape Claude’s character and look inside its weights.
2:24:18ENCognitive Revolution "How AI Changes Everything"· Oct 30, 2024PodcastMMLU Stays at Chance Until Late Training. Loss Is Only an Alarm.Host Nathan LabenzZyphra’s training lead walks through Zamba 2’s hybrid architecture, the evals that actually matter, and the trade secrets small labs still have to rediscover.
41:42EN
Sequoia Capital· Oct 22, 2024PodcastNeural Networks Are Still Waiting for Their ThermodynamicsOpenAI researcher Dan Roberts on why physicists keep migrating into AI, and why the field still lacks the equivalent of the ideal gas law.
1:06:48ENUnsupervised Learning: With Jacob Effron· Oct 3, 2024Podcasto1 Is Slow and Hard to Use. Percy Liang Still Calls It a Turning PointHost Jacob EffronStanford’s Percy Liang splits OpenAI’s o1 into a disappointing product and the most important research signal in years.
45:22ENSequoia Capital· Oct 2, 2024PodcastAlphaGo Thought 30 Seconds a Move. o1 Made “Think Longer” GeneralOpenAI researchers Noam Brown, Ilge Akkaya, and Hunter Lightman on teaching language models to reason, the generator-verifier gap, and a second scaling curve at inference time.
39:45ENSequoia Capital· Sep 24, 2024PodcastHarmonic’s Bet: Teach AI Math Directly, and the Riemann Hypothesis Falls by 2029Robinhood’s Vlad Tenev and Harmonic co-founder Tudor Achim tell Sequoia why math is reasoning, why Lean is the verifier, and why they refuse to wait for mathematical skill to emerge from scale.
1:18:32ENCognitive Revolution "How AI Changes Everything"· Sep 20, 2024PodcastA DNA Model That Can Tell Which Genes You Cannot TouchHost Nathan LabenzStanford's Brian Hie walks through hybrid architectures, a genome-scale language model trained only on DNA, and an antibody that binds 25 times tighter than nature.
2:04:15ENCognitive Revolution "How AI Changes Everything"· Aug 14, 2024PodcastA parrot cannot paraphrase — and Claude cannot be talked into harmHost Nathan LabenzRobert Wright of the Nonzero podcast interviews Nathan Labenz on whether large language models understand anything, what Anthropic’s 10 million features actually show, and why open weights collide with U.S.–China policy.
46:09EN
No Priors: AI, Machine Learning, Tech, & Startups· Aug 1, 2024Podcast · 2 speakersOriol Vinyals: The Days of Burning 90% of Compute on Pretraining Are NumberedHost Sarah Guo, Elad GilGoogle DeepMind’s VP of research on Gemini, long context, the coming shift from pretraining to RL, and why AGI may never have a finish line.
1:42:16ENCognitive Revolution "How AI Changes Everything"· Jul 4, 2024Podcast267 Papers in Seven Months: Albert Gu Explains the State Space Model RevolutionHost Nathan LabenzThe Mamba co-author walks through five years of recurrent-model work, why selective compression beats a growing KV cache, and what Mamba 2 trades away to train faster.
34:09ENNo Priors: AI, Machine Learning, Tech, & Startups· Jun 27, 2024Podcast · 2 speakersFive Independent Teams Found the Same 10-to-1 Mix That Beats TransformersHost Sarah Guo, Elad GilThe authors of S4 and Mamba argue that mostly state-space layers plus a dash of attention is the architecture that actually works—and they are shipping it first as real-time speech.
1:54:01ENCognitive Revolution "How AI Changes Everything"· Jun 26, 2024PodcastA Tiny Network Grew a Salt Crystal the Training Data Never ShowedHost Nathan LabenzTim Duignan trained tens of thousands of parameters on salt water. The model invented a crystal — and a continuum solvent theory he had spent a PhD failing to write by hand.
1:37:07ENCognitive Revolution "How AI Changes Everything"· Jun 22, 2024PodcastA Text-Only AI Outdiagnosed GPs. Google Still Won't Ship It.Host Nathan LabenzGoogle researchers Vivek Natarajan and Khaled Saab walk Nathan Labenz through five medical-AI papers, from radiology reports to an AI doctor that still has to earn trust.
1:59:15ENCognitive Revolution "How AI Changes Everything"· May 25, 2024PodcastA Protein Backbone in a Minute: The Real Progress, Bottlenecks, and Risks of AI BiologyHost Nathan LabenzThe White House set a thousand-fold lower reporting bar for biological models than for language models—and this conversation shows why that gap already looks prescient.
58:28ENCognitive Revolution "How AI Changes Everything"· May 22, 2024PodcastFrom Jailbreaking ChatGPT to Anthropic’s First Prompt Engineer: How Alex Albert Ships Claude 3Host Nathan LabenzA year after building jailbreakchat.com, Alex Albert walks Nathan Labenz through Claude 3’s writing, orchestration, character work, and the guardrails app developers still skip.
1:01:39ENCognitive Revolution "How AI Changes Everything"· Apr 13, 2024PodcastGPT-5 Wants 100 Trillion Tokens. Does Earth Have Enough?Host Nathan LabenzTraining GPT-3 took about a trillion tokens; GPT-4 took about ten trillion. The next jump is a data question as much as a compute one.
1:19:24ENCognitive Revolution "How AI Changes Everything"· Apr 5, 2024PodcastA Gibberish Prompt Unlocks What GPT-J Plans Three Tokens AheadHost Nathan LabenzNortheastern’s Bau Lab shows that a 40,000-parameter soft prompt can read a model’s future words, and that about ten attention heads carry the task itself.
1:20:44ENCognitive Revolution "How AI Changes Everything"· Mar 30, 2024PodcastSeeing Like a Mamba: Vision, Rotting States, and a Cell Model in 90 DaysHost Nathan LabenzNathan Labenz and Jason Meaux survey the vision papers, long-context experiments, and biology work that followed the original Mamba release.
2:47:17ENLex Fridman· Mar 7, 2024Podcast · 2 speakersIf You Want Human-Level AI, Abandon Generative ModelsGuest Yann Lecun · Host Lex FridmanYann LeCun tells Lex Fridman why autoregressive LLMs cannot plan, remember, or understand the physical world — and why open source is the only democratic answer.Load moreShowing 24 of 198