Ergebnisse
23 ArtikelSortieren
50:57EN
Unsupervised Learning: With Jacob Effron· 9. Juli 2026PodcastA Trillion Dollars of GPUs Will Be Worth $100 Billion in Five Years, Says LSTM's Jürgen SchmidhuberModeration: Jacob EffronThe AI pioneer tells Unsupervised Learning's Jacob Effron why he is wildly optimistic about the technology and deeply pessimistic about the model companies buying the chips.
2:59:44EN
Cognitive Revolution "How AI Changes Everything"· 3. Juni 2026PodcastTwo Endangered Languages Broke Transformers. Nested Learning Gave Models a Sleep Button.Moderation: Nathan LabenzGoogle researcher Ali Behrouz tells Nathan Labenz how stacking update frequencies — not just layers — and an offline sleep phase could give language models genuine continual learning.
1:13:33ENUnsupervised Learning: With Jacob Effron· 3. Juni 2026PodcastA Trillion Tokens Later, the Concept Finally Lands: Łukasz Kaiser on What Transformers Still MissModeration: Jacob EffronThe Attention Is All You Need co-author tells Unsupervised Learning that transformers will probably keep winning — and that they still do not learn the way people do.
2:12:00ENCognitive Revolution "How AI Changes Everything"· 15. Mai 2025PodcastGradient Descent at Test Time: Titans Pushes LLM Context to 10 Million TokensModeration: Nathan LabenzA Cornell PhD student's neural memory module holds about 70% accuracy where GPT-4's scores fall off a cliff.
1:04:54ENUnsupervised Learning: With Jacob Effron· 12. Nov. 2024PodcastHe bet company equity that Transformer would last — then drew an AI map for 12,000 companiesModeration: Jacob EffronDatabricks chief AI scientist Jonathan Frankle tells enterprises when to prompt, fine-tune, or pre-train, and why he still refuses to forecast the next architecture.
1:18:32ENCognitive Revolution "How AI Changes Everything"· 20. Sept. 2024PodcastA DNA Model That Can Tell Which Genes You Cannot TouchModeration: Nathan LabenzStanford's Brian Hie walks through hybrid architectures, a genome-scale language model trained only on DNA, and an antibody that binds 25 times tighter than nature.
44:16EN
No Priors: AI, Machine Learning, Tech, & Startups· 5. Sept. 2024Podcast · 2 StimmenA perfect demo is ten years from a product you can pay forModeration: Sarah Guo, Elad GilAndrej Karpathy uses Waymo's decade-long gap, Tesla's software bet, and a new AI course to argue that autonomous intelligence will stall at product and globalization, not at the first impressive clip.
1:42:16ENCognitive Revolution "How AI Changes Everything"· 4. Juli 2024Podcast267 Papers in Seven Months: Albert Gu Explains the State Space Model RevolutionModeration: Nathan LabenzThe Mamba co-author walks through five years of recurrent-model work, why selective compression beats a growing KV cache, and what Mamba 2 trades away to train faster.
34:09ENNo Priors: AI, Machine Learning, Tech, & Startups· 27. Juni 2024Podcast · 2 StimmenFive Independent Teams Found the Same 10-to-1 Mix That Beats TransformersModeration: Sarah Guo, Elad GilThe authors of S4 and Mamba argue that mostly state-space layers plus a dash of attention is the architecture that actually works—and they are shipping it first as real-time speech.
1:19:24ENCognitive Revolution "How AI Changes Everything"· 5. Apr. 2024PodcastA Gibberish Prompt Unlocks What GPT-J Plans Three Tokens AheadModeration: Nathan LabenzNortheastern’s Bau Lab shows that a 40,000-parameter soft prompt can read a model’s future words, and that about ten attention heads carry the task itself.
1:20:44ENCognitive Revolution "How AI Changes Everything"· 30. März 2024PodcastSeeing Like a Mamba: Vision, Rotting States, and a Cell Model in 90 DaysModeration: Nathan LabenzNathan Labenz and Jason Meaux survey the vision papers, long-context experiments, and biology work that followed the original Mamba release.
2:30:06ENCognitive Revolution "How AI Changes Everything"· 22. Dez. 2023PodcastTrained on a Thirtieth of GPT-4's Tokens, Mamba Beat Transformers on Home TurfModeration: Nathan LabenzIn a solo emergency episode, Nathan Labenz argues that Albert Gu and Tri Dao's selective state space model is the first architecture since 2017 that deserves to share the Transformer’s throne.
41:58ENNo Priors: AI, Machine Learning, Tech, & Startups· 2. Nov. 2023Podcast · 2 StimmenReliability is the bottleneck. Autonomy is what would make AI feel alive.Moderation: Sarah Guo, Elad GilIlya Sutskever talks with Sarah Guo and Elad Gil about AlexNet, OpenAI’s capped-profit bet, why smaller models mainly lose reliability, and the line he draws for digital life.
35:24ENNo Priors: AI, Machine Learning, Tech, & Startups· 24. Aug. 2023Podcast · 2 StimmenThe Author of Attention Is All You Need Now Compiles mRNA Like BytecodeModeration: Sarah Guo, Elad GilJakob Uszkoreit on why Transformers won, why models spend compute on the wrong things, and why drug discovery has to become generation rather than screening.
39:02ENCognitive Revolution "How AI Changes Everything"· 10. Aug. 2023PodcastAI’s product advantage is consistency. Its real weakness is getting conned.Moderation: Nathan LabenzNathan Labenz updates the Cognitive Revolution scouting report: jailbreaks, resume automation, Med-PaLM’s 40% radiology win, and what might follow Transformers.
2:13:07ENCognitive Revolution "How AI Changes Everything"· 27. Juli 2023PodcastHalf an Hour to a Circuit in GPT-2 Small — and a Quadratic Wall Before GPT-3Moderation: Nathan LabenzArthur Conmy walks Nathan Labenz through ACDC, the algorithm that automates the most tedious step of mechanistic interpretability: finding which transformer components actually do a task.
1:32:22ENCognitive Revolution "How AI Changes Everything"· 29. Juni 2023PodcastA Million Bytes and 256 Symbols: Meta's MEGABYTE Wants to Throw the Tokenizer AwayModeration: Nathan LabenzLili Yu of Meta AI explains a multiscale transformer that predicts million-byte sequences, skips tokenization, and aims to model any file as raw bytes.
2:00:19ENCognitive Revolution "How AI Changes Everything"· 6. Juni 2023Podcast1.5 Million GPT-4 Fairy Tales Let a 33-Million-Parameter Model Out-Reason GPT-2Moderation: Nathan LabenzTry this fill-in: Lily likes cats and dogs. She asked her mom for a dog. Mom said no, so she asked for a…
35:36ENNo Priors: AI, Machine Learning, Tech, & Startups· 13. Apr. 2023Podcast · 2 StimmenAGI as a side effect: Noam Shazeer on Transformers, Character.AI, and two-hour chatsModeration: Sarah Guo, Elad GilIn April 2023, the Transformer co-author told No Priors how a 22-person startup turned open-ended chat into a consumer product — and treated AGI as a byproduct of making the model smarter.
1:46:01EN
Lex Fridman· 29. Apr. 2019Podcast · 2 StimmenThe Night AlphaStar Beat TLO, the Team Went to a BarGast: Oriol Vinyals · Moderation: Lex FridmanOriol Vinyals on how DeepMind turned StarCraft II into a sequence problem, built a league of agents, and still refuses to call the game solved.
46:25ENLex Fridman· 17. Jan. 2019PodcastDeep Learning at the Edge of 2019: BERT, Autopilot, and the Ideas That Broke ThroughModeration: Lex FridmanA tour of the architectural, applied, and automation breakthroughs that defined deep learning in 2018 and set up 2019.
1:16:52ENCognitive Revolution "How AI Changes Everything"PodcastMamba After 90 Days: What 30 Papers Reveal About State Space Models, Hybrids, and Mixture of ExpertsModeration: Nathan LabenzNathan Labenz and AI scout Jason Meaux survey the first wave of Mamba-inspired research, from mechanistic studies and synthetic-task tradeoffs to hybrid architectures and MoE variants.
1:03:10ENCognitive Revolution "How AI Changes Everything"PodcastPause Tokens, Analogical Prompts and Ring Attention: A Tour of the Transformer's Next UpgradesModeration: Nathan LabenzNathan Labenz and Trey Kollmer walk through five recent papers on pausing, backspacing, prompting, streaming and long-context training, and sketch how they might combine into a more capable model.