필터 결과
24개정렬
50:57EN
Unsupervised Learning: With Jacob Effron· 2026년 7월 9일팟캐스트A Trillion Dollars of GPUs Will Be Worth $100 Billion in Five Years, Says LSTM's Jürgen Schmidhuber진행자 Jacob EffronThe AI pioneer tells Unsupervised Learning's Jacob Effron why he is wildly optimistic about the technology and deeply pessimistic about the model companies buying the chips.
2:59:44EN
Cognitive Revolution "How AI Changes Everything"· 2026년 6월 3일팟캐스트Two Endangered Languages Broke Transformers. Nested Learning Gave Models a Sleep Button.진행자 Nathan LabenzGoogle researcher Ali Behrouz tells Nathan Labenz how stacking update frequencies — not just layers — and an offline sleep phase could give language models genuine continual learning.
1:13:33ENUnsupervised Learning: With Jacob Effron· 2026년 6월 3일팟캐스트A Trillion Tokens Later, the Concept Finally Lands: Łukasz Kaiser on What Transformers Still Miss진행자 Jacob EffronThe Attention Is All You Need co-author tells Unsupervised Learning that transformers will probably keep winning — and that they still do not learn the way people do.
2:12:00ENCognitive Revolution "How AI Changes Everything"· 2025년 5월 15일팟캐스트Gradient Descent at Test Time: Titans Pushes LLM Context to 10 Million Tokens진행자 Nathan LabenzA Cornell PhD student's neural memory module holds about 70% accuracy where GPT-4's scores fall off a cliff.
1:04:54ENUnsupervised Learning: With Jacob Effron· 2024년 11월 12일팟캐스트He bet company equity that Transformer would last — then drew an AI map for 12,000 companies진행자 Jacob EffronDatabricks chief AI scientist Jonathan Frankle tells enterprises when to prompt, fine-tune, or pre-train, and why he still refuses to forecast the next architecture.
1:18:32ENCognitive Revolution "How AI Changes Everything"· 2024년 9월 20일팟캐스트A DNA Model That Can Tell Which Genes You Cannot Touch진행자 Nathan LabenzStanford's Brian Hie walks through hybrid architectures, a genome-scale language model trained only on DNA, and an antibody that binds 25 times tighter than nature.
44:16EN
No Priors: AI, Machine Learning, Tech, & Startups· 2024년 9월 5일팟캐스트 · 2명A perfect demo is ten years from a product you can pay for진행자 Sarah Guo, Elad GilAndrej Karpathy uses Waymo's decade-long gap, Tesla's software bet, and a new AI course to argue that autonomous intelligence will stall at product and globalization, not at the first impressive clip.
1:42:16ENCognitive Revolution "How AI Changes Everything"· 2024년 7월 4일팟캐스트267 Papers in Seven Months: Albert Gu Explains the State Space Model Revolution진행자 Nathan LabenzThe Mamba co-author walks through five years of recurrent-model work, why selective compression beats a growing KV cache, and what Mamba 2 trades away to train faster.
34:09ENNo Priors: AI, Machine Learning, Tech, & Startups· 2024년 6월 27일팟캐스트 · 2명Five Independent Teams Found the Same 10-to-1 Mix That Beats Transformers진행자 Sarah Guo, Elad GilThe authors of S4 and Mamba argue that mostly state-space layers plus a dash of attention is the architecture that actually works—and they are shipping it first as real-time speech.
1:19:24ENCognitive Revolution "How AI Changes Everything"· 2024년 4월 5일팟캐스트A Gibberish Prompt Unlocks What GPT-J Plans Three Tokens Ahead진행자 Nathan LabenzNortheastern’s Bau Lab shows that a 40,000-parameter soft prompt can read a model’s future words, and that about ten attention heads carry the task itself.
1:20:44ENCognitive Revolution "How AI Changes Everything"· 2024년 3월 30일팟캐스트Seeing Like a Mamba: Vision, Rotting States, and a Cell Model in 90 Days진행자 Nathan LabenzNathan Labenz and Jason Meaux survey the vision papers, long-context experiments, and biology work that followed the original Mamba release.
2:30:06ENCognitive Revolution "How AI Changes Everything"· 2023년 12월 22일팟캐스트Trained on a Thirtieth of GPT-4's Tokens, Mamba Beat Transformers on Home Turf진행자 Nathan LabenzIn a solo emergency episode, Nathan Labenz argues that Albert Gu and Tri Dao's selective state space model is the first architecture since 2017 that deserves to share the Transformer’s throne.
41:58ENNo Priors: AI, Machine Learning, Tech, & Startups· 2023년 11월 2일팟캐스트 · 2명Reliability is the bottleneck. Autonomy is what would make AI feel alive.진행자 Sarah Guo, Elad GilIlya Sutskever talks with Sarah Guo and Elad Gil about AlexNet, OpenAI’s capped-profit bet, why smaller models mainly lose reliability, and the line he draws for digital life.
35:24ENNo Priors: AI, Machine Learning, Tech, & Startups· 2023년 8월 24일팟캐스트 · 2명The Author of Attention Is All You Need Now Compiles mRNA Like Bytecode진행자 Sarah Guo, Elad GilJakob Uszkoreit on why Transformers won, why models spend compute on the wrong things, and why drug discovery has to become generation rather than screening.
39:02ENCognitive Revolution "How AI Changes Everything"· 2023년 8월 10일팟캐스트AI’s product advantage is consistency. Its real weakness is getting conned.진행자 Nathan LabenzNathan Labenz updates the Cognitive Revolution scouting report: jailbreaks, resume automation, Med-PaLM’s 40% radiology win, and what might follow Transformers.
2:13:07ENCognitive Revolution "How AI Changes Everything"· 2023년 7월 27일팟캐스트Half an Hour to a Circuit in GPT-2 Small — and a Quadratic Wall Before GPT-3진행자 Nathan LabenzArthur Conmy walks Nathan Labenz through ACDC, the algorithm that automates the most tedious step of mechanistic interpretability: finding which transformer components actually do a task.
1:32:22ENCognitive Revolution "How AI Changes Everything"· 2023년 6월 29일팟캐스트A Million Bytes and 256 Symbols: Meta's MEGABYTE Wants to Throw the Tokenizer Away진행자 Nathan LabenzLili Yu of Meta AI explains a multiscale transformer that predicts million-byte sequences, skips tokenization, and aims to model any file as raw bytes.
2:00:19ENCognitive Revolution "How AI Changes Everything"· 2023년 6월 6일팟캐스트1.5 Million GPT-4 Fairy Tales Let a 33-Million-Parameter Model Out-Reason GPT-2진행자 Nathan LabenzTry this fill-in: Lily likes cats and dogs. She asked her mom for a dog. Mom said no, so she asked for a…
35:36ENNo Priors: AI, Machine Learning, Tech, & Startups· 2023년 4월 13일팟캐스트 · 2명AGI as a side effect: Noam Shazeer on Transformers, Character.AI, and two-hour chats진행자 Sarah Guo, Elad GilIn April 2023, the Transformer co-author told No Priors how a 22-person startup turned open-ended chat into a consumer product — and treated AGI as a byproduct of making the model smarter.
1:46:01EN
Lex Fridman· 2019년 4월 29일팟캐스트 · 2명The Night AlphaStar Beat TLO, the Team Went to a Bar게스트 Oriol Vinyals · 진행자 Lex FridmanOriol Vinyals on how DeepMind turned StarCraft II into a sequence problem, built a league of agents, and still refuses to call the game solved.
46:25ENLex Fridman· 2019년 1월 17일팟캐스트Deep Learning at the Edge of 2019: BERT, Autopilot, and the Ideas That Broke Through진행자 Lex FridmanA tour of the architectural, applied, and automation breakthroughs that defined deep learning in 2018 and set up 2019.
9:59ENLex Fridman팟캐스트Is Language or Vision Harder? Ilya Sutskever on the Unity of Machine Learning진행자 Lex FridmanIn a short clip from his 2020 conversation with Lex Fridman, Ilya Sutskever explains why vision, language and reinforcement learning share the same few principles, and why asking which problem is harder is the wrong question.
1:16:52ENCognitive Revolution "How AI Changes Everything"팟캐스트Mamba After 90 Days: What 30 Papers Reveal About State Space Models, Hybrids, and Mixture of Experts진행자 Nathan LabenzNathan Labenz and AI scout Jason Meaux survey the first wave of Mamba-inspired research, from mechanistic studies and synthetic-task tradeoffs to hybrid architectures and MoE variants.
1:03:10ENCognitive Revolution "How AI Changes Everything"팟캐스트Pause Tokens, Analogical Prompts and Ring Attention: A Tour of the Transformer's Next Upgrades진행자 Nathan LabenzNathan Labenz and Trey Kollmer walk through five recent papers on pausing, backspacing, prompting, streaming and long-context training, and sketch how they might combine into a more capable model.