Resultados
18 artículosOrdenar
50:57EN
Unsupervised Learning: With Jacob Effron· 9 jul 2026PódcastA Trillion Dollars of GPUs Will Be Worth $100 Billion in Five Years, Says LSTM's Jürgen SchmidhuberPresenta: Jacob EffronThe AI pioneer tells Unsupervised Learning's Jacob Effron why he is wildly optimistic about the technology and deeply pessimistic about the model companies buying the chips.
2:59:44EN
Cognitive Revolution "How AI Changes Everything"· 3 jun 2026PódcastTwo Endangered Languages Broke Transformers. Nested Learning Gave Models a Sleep Button.Presenta: Nathan LabenzGoogle researcher Ali Behrouz tells Nathan Labenz how stacking update frequencies — not just layers — and an offline sleep phase could give language models genuine continual learning.
1:13:33ENUnsupervised Learning: With Jacob Effron· 3 jun 2026PódcastA Trillion Tokens Later, the Concept Finally Lands: Łukasz Kaiser on What Transformers Still MissPresenta: Jacob EffronThe Attention Is All You Need co-author tells Unsupervised Learning that transformers will probably keep winning — and that they still do not learn the way people do.
2:12:00ENCognitive Revolution "How AI Changes Everything"· 15 may 2025PódcastGradient Descent at Test Time: Titans Pushes LLM Context to 10 Million TokensPresenta: Nathan LabenzA Cornell PhD student's neural memory module holds about 70% accuracy where GPT-4's scores fall off a cliff.
1:04:54ENUnsupervised Learning: With Jacob Effron· 12 nov 2024PódcastHe bet company equity that Transformer would last — then drew an AI map for 12,000 companiesPresenta: Jacob EffronDatabricks chief AI scientist Jonathan Frankle tells enterprises when to prompt, fine-tune, or pre-train, and why he still refuses to forecast the next architecture.
1:18:32ENCognitive Revolution "How AI Changes Everything"· 20 sept 2024PódcastA DNA Model That Can Tell Which Genes You Cannot TouchPresenta: Nathan LabenzStanford's Brian Hie walks through hybrid architectures, a genome-scale language model trained only on DNA, and an antibody that binds 25 times tighter than nature.
1:42:16ENCognitive Revolution "How AI Changes Everything"· 4 jul 2024Pódcast267 Papers in Seven Months: Albert Gu Explains the State Space Model RevolutionPresenta: Nathan LabenzThe Mamba co-author walks through five years of recurrent-model work, why selective compression beats a growing KV cache, and what Mamba 2 trades away to train faster.
1:19:24ENCognitive Revolution "How AI Changes Everything"· 5 abr 2024PódcastA Gibberish Prompt Unlocks What GPT-J Plans Three Tokens AheadPresenta: Nathan LabenzNortheastern’s Bau Lab shows that a 40,000-parameter soft prompt can read a model’s future words, and that about ten attention heads carry the task itself.
1:20:44ENCognitive Revolution "How AI Changes Everything"· 30 mar 2024PódcastSeeing Like a Mamba: Vision, Rotting States, and a Cell Model in 90 DaysPresenta: Nathan LabenzNathan Labenz and Jason Meaux survey the vision papers, long-context experiments, and biology work that followed the original Mamba release.
2:30:06ENCognitive Revolution "How AI Changes Everything"· 22 dic 2023PódcastTrained on a Thirtieth of GPT-4's Tokens, Mamba Beat Transformers on Home TurfPresenta: Nathan LabenzIn a solo emergency episode, Nathan Labenz argues that Albert Gu and Tri Dao's selective state space model is the first architecture since 2017 that deserves to share the Transformer’s throne.
39:02ENCognitive Revolution "How AI Changes Everything"· 10 ago 2023PódcastAI’s product advantage is consistency. Its real weakness is getting conned.Presenta: Nathan LabenzNathan Labenz updates the Cognitive Revolution scouting report: jailbreaks, resume automation, Med-PaLM’s 40% radiology win, and what might follow Transformers.
2:13:07ENCognitive Revolution "How AI Changes Everything"· 27 jul 2023PódcastHalf an Hour to a Circuit in GPT-2 Small — and a Quadratic Wall Before GPT-3Presenta: Nathan LabenzArthur Conmy walks Nathan Labenz through ACDC, the algorithm that automates the most tedious step of mechanistic interpretability: finding which transformer components actually do a task.
1:32:22ENCognitive Revolution "How AI Changes Everything"· 29 jun 2023PódcastA Million Bytes and 256 Symbols: Meta's MEGABYTE Wants to Throw the Tokenizer AwayPresenta: Nathan LabenzLili Yu of Meta AI explains a multiscale transformer that predicts million-byte sequences, skips tokenization, and aims to model any file as raw bytes.
2:00:19ENCognitive Revolution "How AI Changes Everything"· 6 jun 2023Pódcast1.5 Million GPT-4 Fairy Tales Let a 33-Million-Parameter Model Out-Reason GPT-2Presenta: Nathan LabenzTry this fill-in: Lily likes cats and dogs. She asked her mom for a dog. Mom said no, so she asked for a…
46:25EN
Lex Fridman· 17 ene 2019PódcastDeep Learning at the Edge of 2019: BERT, Autopilot, and the Ideas That Broke ThroughPresenta: Lex FridmanA tour of the architectural, applied, and automation breakthroughs that defined deep learning in 2018 and set up 2019.
9:59ENLex FridmanPódcastIs Language or Vision Harder? Ilya Sutskever on the Unity of Machine LearningPresenta: Lex FridmanIn a short clip from his 2020 conversation with Lex Fridman, Ilya Sutskever explains why vision, language and reinforcement learning share the same few principles, and why asking which problem is harder is the wrong question.
1:16:52ENCognitive Revolution "How AI Changes Everything"PódcastMamba After 90 Days: What 30 Papers Reveal About State Space Models, Hybrids, and Mixture of ExpertsPresenta: Nathan LabenzNathan Labenz and AI scout Jason Meaux survey the first wave of Mamba-inspired research, from mechanistic studies and synthetic-task tradeoffs to hybrid architectures and MoE variants.
1:03:10ENCognitive Revolution "How AI Changes Everything"PódcastPause Tokens, Analogical Prompts and Ring Attention: A Tour of the Transformer's Next UpgradesPresenta: Nathan LabenzNathan Labenz and Trey Kollmer walk through five recent papers on pausing, backspacing, prompting, streaming and long-context training, and sketch how they might combine into a more capable model.