Results
248 articlesSort
2:13:07EN
Cognitive Revolution "How AI Changes Everything"· Jul 27, 2023PodcastHalf an Hour to a Circuit in GPT-2 Small — and a Quadratic Wall Before GPT-3Host Nathan LabenzArthur Conmy walks Nathan Labenz through ACDC, the algorithm that automates the most tedious step of mechanistic interpretability: finding which transformer components actually do a task.
12:20ENTesting UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.
1:33:56ENCognitive Revolution "How AI Changes Everything"· Jul 6, 2023PodcastThe AI Scouting Report: 90 Minutes From GPT-4's Exam Scores to Whether Models UnderstandHost Nathan LabenzNathan Labenz spends a solo episode walking through what general-purpose models can do, how they are trained, how capabilities unlock, and whether they understand anything at all.
1:32:22ENCognitive Revolution "How AI Changes Everything"· Jun 29, 2023PodcastA Million Bytes and 256 Symbols: Meta's MEGABYTE Wants to Throw the Tokenizer AwayHost Nathan LabenzLili Yu of Meta AI explains a multiscale transformer that predicts million-byte sequences, skips tokenization, and aims to model any file as raw bytes.
1:52:46ENCognitive Revolution "How AI Changes Everything"· Jun 27, 2023PodcastCharge Neural Nets by Connection Length, and the Black Box Splits Into Modules You Can SeeHost Nathan LabenzMIT physicist Ziming Liu walks Nathan Labenz through BIMT, a brain-inspired training trick that sparsifies networks until you can read them by looking.
59:28ENCognitive Revolution "How AI Changes Everything"· Jun 16, 2023PodcastFrom $500,000 to $50,000: MosaicML Made Training Your Own Model a Priced ProductHost Nathan LabenzJonathan Frankle and Abhi Venigalla explain who is training custom LLMs, why extraction beats chat, and how ALiBi stretches a 65k context window.
2:00:19ENCognitive Revolution "How AI Changes Everything"· Jun 6, 2023Podcast1.5 Million GPT-4 Fairy Tales Let a 33-Million-Parameter Model Out-Reason GPT-2Host Nathan LabenzTry this fill-in: Lily likes cats and dogs. She asked her mom for a dog. Mom said no, so she asked for a…
1:25:35ENCognitive Revolution "How AI Changes Everything"· May 21, 2023PodcastTwo and a Half Years From 33.3% to 86.5%: Google Sent Foundation Models to Medical SchoolHost Nathan LabenzVivek Natarajan walks Nathan Labenz through Med-PaLM and Med-PaLM 2: the data-light techniques, the nine-axis clinician evals, and why a high USMLE-style score is the wrong trophy.
42:18EN
No Priors: AI, Machine Learning, Tech, & Startups· May 18, 2023Podcast · 2 speakersTen Percent of Search Is Health — and the Doctor Is Googling TooHost Sarah Guo, Elad GilGoogle researcher Karan Singhal on Med-PaLM 2, the real bar for medical language models, and why medicine is a harder alignment lab than chatbots.
5:24ENGoogle I/O 2023: Bard, PaLM 2 and AI Across Google's ProductsMatthew Berman · Forward FutureMatthew Berman reviews Google's 2023 AI announcements and weighs its focus on improving established products.
4:14:33EN
Lex Fridman· May 9, 2023Podcast · 2 speakersThe Next Token Is Not a Proof: Stephen Wolfram on ChatGPT and Computational TruthGuest Stephen Wolfram · Host Lex FridmanIn his fourth conversation with Lex Fridman, Stephen Wolfram contrasts large language models with Wolfram|Alpha, then follows computational irreducibility from ChatGPT through observers, thermodynamics, and the three great theories of twentieth-century physics.
40:25ENNo Priors: AI, Machine Learning, Tech, & Startups· Apr 6, 2023Podcast · 2 speakersA 6-Billion-Parameter Clone of ChatGPT’s Core TrickHost Sarah Guo, Elad GilDatabricks CTO Matei Zaharia tells Sarah Guo and Elad Gil how Dolly learned instruction-following on fifty times less data than GPT-3 — and why he would rather look facts up than bake them into a trillion-parameter network.
3:28:47ENLex Fridman· Oct 29, 2022Podcast · 2 speakersKarpathy Calls Trained Neural Nets Complicated Alien ArtifactsGuest Andrej Karpathy · Host Lex FridmanOn Lex Fridman's podcast, Andrej Karpathy refuses the brain analogy, walks the Fermi paradox through Nick Lane's chemistry, and treats the Transformer as a general-purpose differentiable computer.
2:10:08ENLex Fridman· Jul 26, 2022Podcast · 2 speakersGato Is Only the BeginningGuest Oriol Vinyals · Host Lex FridmanDeepMind's Oriol Vinyals talks with Lex Fridman about generalist agents, thrown-away weights, and whether human-level AGI arrives in his lifetime.
2:10:39ENLex Fridman· Jul 1, 2022Podcast · 2 speakersDemis Hassabis: Solve Intelligence, Then Solve Everything ElseGuest Demis Hassabis · Host Lex FridmanThe DeepMind CEO tells Lex Fridman why the Turing Test is the wrong exam, how AlphaFold rewrote biology, and why the quiet radio sky suggests we are probably alone.
2:45:10ENLex Fridman· Jan 22, 2022Podcast · 2 speakersA Teenager Learns to Drive in Twenty Hours. A Car Still Cannot.Guest Yann Lecun · Host Lex FridmanYann LeCun tells Lex Fridman why self-supervised world models are the missing dark matter of intelligence, and why machines are not even at the level of a house cat.
2:31:57ENLex Fridman· Sep 20, 2021Podcast · 2 speakersJay McClelland on How Thought Emerges From Neural NetworksGuest Jay McClelland · Host Lex FridmanThe Stanford cognitive scientist talks with Lex Fridman about connectionism, backpropagation, David Rumelhart, and why intuition discovers what logic later proves.
2:51:33ENLex Fridman· Aug 29, 2021Podcast · 2 speakersThe Self Is a GPT Prompt: Wojciech Zaremba on Consciousness, Codex, and Fermi's SilenceGuest Wojciech Zaremba · Host Lex FridmanOpenAI co-founder Wojciech Zaremba tells Lex Fridman he thinks we might be alone in the universe — and that GPT-3, Codex, and a one-handed robot already hint at how intelligence is built.
2:18:29ENLex Fridman· Aug 8, 2021Podcast · 2 speakersYour Cortex Is 150,000 Brains Voting on a Coffee CupGuest Jeff Hawkins · Host Lex FridmanJeff Hawkins tells Lex Fridman that intelligence is learning a model of the world, the neocortex is tens of thousands of independent maps that vote, and the fastest path to machine intelligence is reverse-engineering that sheet.
2:30:30ENLex Fridman· Jul 31, 2021Podcast · 2 speakersThe Fallacy of the Successful First StepGuest Ishan Misra · Host Lex FridmanBerkeley's Jitendra Malik explains why computer vision still looks easy, why fully autonomous driving is not near, and what children know that today's networks do not.
1:56:17ENLex Fridman· Apr 19, 2021Podcast · 2 speakersIf You Reran Earth a Million Times, Would Anything Like Us Appear?Guest Risto Miikkulainen · Host Lex FridmanRisto Miikkulainen on neuroevolution, hyena raids, basil that never sleeps, and why variation-plus-selection still finds solutions backpropagation cannot see.
2:01:07ENLex Fridman· Dec 12, 2020Podcast · 2 speakersMichael Littman isn’t waiting for a runaway god. He’s watching us.Guest Michael Littman · Host Lex FridmanThe Brown reinforcement-learning researcher tells Lex Fridman why accidental superintelligence feels like a 747 assembling itself — and why social media, rote language, and theory of mind worry him more.
2:10:06ENLex Fridman· Aug 14, 2020Podcast · 2 speakersYou Might Have to Understand the World to Understand the Letter AGuest Dileep George · Host Lex FridmanDileep George on recursive cortical networks, why a five-year-old can read any new CAPTCHA, and what the Wright brothers actually learned from birds.
1:41:37ENLex Fridman· Jul 21, 2020Podcast · 2 speakersThe Fallacy of the Successful First Step: Jitendra Malik on Why Seeing Still Isn't SolvedGuest Jitendra Malik · Host Lex FridmanBerkeley's Jitendra Malik tells Lex Fridman why computer vision keeps underestimating itself, why full self-driving still needs cognition, and why vision is the parent of language.Load moreShowing 24 of 248