Ergebnisse
14 ArtikelSortieren
2:02:17EN
Cognitive Revolution "How AI Changes Everything"· 27. Aug. 2025PodcastSAEs Find the Nouns. Parameter Decomposition Looks for the VerbsModeration: Nathan LabenzGoodfire's Lee Sharkey argues that sparse autoencoders recover a network's variables, not the algorithms those variables run, and shows how stochastic parameter decomposition tries to recover the computations themselves.
1:37:05ENCognitive Revolution "How AI Changes Everything"· 19. Juni 2025PodcastAn Algebraic Geometer Quit Tenure Because the Bowl-Shaped Loss Plot Is a LieModeration: Nathan LabenzJesse Hoogland and Daniel Murfet of Timaeus argue that singularities in the loss landscape — not the smooth valleys in every slide deck — are what actually govern how neural networks learn, generalize, and go wrong.
2:12:00ENCognitive Revolution "How AI Changes Everything"· 15. Mai 2025PodcastGradient Descent at Test Time: Titans Pushes LLM Context to 10 Million TokensModeration: Nathan LabenzA Cornell PhD student's neural memory module holds about 70% accuracy where GPT-4's scores fall off a cliff.
2:33:39ENCognitive Revolution "How AI Changes Everything"· 27. Feb. 2025PodcastThe Attacker Goes Second: Why Nicholas Carlini Keeps Breaking AI DefensesModeration: Nathan LabenzA Google DeepMind security researcher on simple loss functions, 70% robust accuracy, and why the fix has to live in the system, not the model.
1:40:22ENCognitive Revolution "How AI Changes Everything"· 22. Jan. 2025PodcastTwenty-atom crystals taught an AI the physics of a heartbeatModeration: Nathan LabenzOrbital Materials' Jonathan Godwin and Tim Duignan tell Nathan Labenz how a neural network trained on tiny crystals simulated a potassium ion channel on a single 2017 GPU.
1:42:16ENCognitive Revolution "How AI Changes Everything"· 4. Juli 2024Podcast267 Papers in Seven Months: Albert Gu Explains the State Space Model RevolutionModeration: Nathan LabenzThe Mamba co-author walks through five years of recurrent-model work, why selective compression beats a growing KV cache, and what Mamba 2 trades away to train faster.
1:54:01ENCognitive Revolution "How AI Changes Everything"· 26. Juni 2024PodcastA Tiny Network Grew a Salt Crystal the Training Data Never ShowedModeration: Nathan LabenzTim Duignan trained tens of thousands of parameters on salt water. The model invented a crystal — and a continuum solvent theory he had spent a PhD failing to write by hand.
1:58:43ENCognitive Revolution "How AI Changes Everything"· 7. Feb. 2024PodcastA Worm With 302 Neurons Already Makes Trade-offs. AI Is Still on the Same Ladder.Moderation: Nathan LabenzMax Bennett maps 600 million years of brain evolution onto five breakthroughs — and asks which rungs today's models have actually reached.
1:19:24ENCognitive Revolution "How AI Changes Everything"· 17. Nov. 2023PodcastA Toy Paper Did Not Prove LLMs Cannot Generalize. The Discourse Still Ran With It.Moderation: Nathan LabenzNathan Labenz and Erik Torenberg unpack a viral DeepMind result, a weekend reproduction, and a premature war over voluntary AI commitments.
1:33:56ENCognitive Revolution "How AI Changes Everything"· 6. Juli 2023PodcastThe AI Scouting Report: 90 Minutes From GPT-4's Exam Scores to Whether Models UnderstandModeration: Nathan LabenzNathan Labenz spends a solo episode walking through what general-purpose models can do, how they are trained, how capabilities unlock, and whether they understand anything at all.
1:32:22ENCognitive Revolution "How AI Changes Everything"· 29. Juni 2023PodcastA Million Bytes and 256 Symbols: Meta's MEGABYTE Wants to Throw the Tokenizer AwayModeration: Nathan LabenzLili Yu of Meta AI explains a multiscale transformer that predicts million-byte sequences, skips tokenization, and aims to model any file as raw bytes.
1:52:46ENCognitive Revolution "How AI Changes Everything"· 27. Juni 2023PodcastCharge Neural Nets by Connection Length, and the Black Box Splits Into Modules You Can SeeModeration: Nathan LabenzMIT physicist Ziming Liu walks Nathan Labenz through BIMT, a brain-inspired training trick that sparsifies networks until you can read them by looking.
1:25:50ENCognitive Revolution "How AI Changes Everything"· 18. Apr. 2023PodcastPrompt Engineering Became Programming, and Riley Goodside Is Fine With ThatModeration: Nathan LabenzScale AI’s first staff prompt engineer on tool use, fine-tuning without amnesia, generate-then-rank, and why the 2023 job-of-the-future story never arrived.
1:03:10ENCognitive Revolution "How AI Changes Everything"PodcastPause Tokens, Analogical Prompts and Ring Attention: A Tour of the Transformer's Next UpgradesModeration: Nathan LabenzNathan Labenz and Trey Kollmer walk through five recent papers on pausing, backspacing, prompting, streaming and long-context training, and sketch how they might combine into a more capable model.