필터 결과
248개정렬
34:09ENFive Independent Teams Found the Same 10-to-1 Mix That Beats Transformers진행자 Sarah Guo, Elad GilThe authors of S4 and Mamba argue that mostly state-space layers plus a dash of attention is the architecture that actually works—and they are shipping it first as real-time speech.
1:54:01ENA Tiny Network Grew a Salt Crystal the Training Data Never Showed진행자 Nathan LabenzTim Duignan trained tens of thousands of parameters on salt water. The model invented a crystal — and a continuum solvent theory he had spent a PhD failing to write by hand.
1:37:07ENA Text-Only AI Outdiagnosed GPs. Google Still Won't Ship It.진행자 Nathan LabenzGoogle researchers Vivek Natarajan and Khaled Saab walk Nathan Labenz through five medical-AI papers, from radiology reports to an AI doctor that still has to earn trust.
1:59:15ENA Protein Backbone in a Minute: The Real Progress, Bottlenecks, and Risks of AI Biology진행자 Nathan LabenzThe White House set a thousand-fold lower reporting bar for biological models than for language models—and this conversation shows why that gap already looks prescient.
58:28ENFrom Jailbreaking ChatGPT to Anthropic’s First Prompt Engineer: How Alex Albert Ships Claude 3진행자 Nathan LabenzA year after building jailbreakchat.com, Alex Albert walks Nathan Labenz through Claude 3’s writing, orchestration, character work, and the guardrails app developers still skip.
12:50ENTesting Smaug: Hosted 70B Versus a Smaller Local ModelMatthew Berman · Forward FutureMatthew Berman compares two Smaug configurations on Snake, math and reasoning puzzles.
27:07ENGPT-4o's Launch: Voice, Vision and a More Conversational InterfaceMatthew Berman, Mira Murati · Forward FutureMatthew Berman reviews OpenAI's May 2024 demonstrations of GPT-4o and considers what a faster multimodal assistant could enable.
17:12ENTesting the Mystery 'gpt2-chatbot' Model in April 2024Matthew Berman · Forward FutureMatthew Berman tries an anonymous model on coding, arithmetic and reasoning tasks while its identity remains uncertain.
16:28ENTesting Reka Core: Multimodal Benchmarks, Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman reviews Reka’s reported model comparisons and tests Core on code, logic and image understanding.
15:01ENTesting Llama 3 at Launch: Code, Reasoning and Image GenerationMatthew Berman · Forward FutureMatthew Berman tries Meta AI’s new interface on a snake game, logic puzzles and rapid image generation.
1:01:39ENGPT-5 Wants 100 Trillion Tokens. Does Earth Have Enough?진행자 Nathan LabenzTraining GPT-3 took about a trillion tokens; GPT-4 took about ten trillion. The next jump is a data question as much as a compute one.
1:19:24ENA Gibberish Prompt Unlocks What GPT-J Plans Three Tokens Ahead진행자 Nathan LabenzNortheastern’s Bau Lab shows that a 40,000-parameter soft prompt can read a model’s future words, and that about ten attention heads carry the task itself.
14:23ENTesting DBRX: Coding Strengths and Reasoning GapsMatthew Berman · Forward FutureMatthew Berman examines Databricks’ open-weight model and puts it through coding, arithmetic and reasoning prompts.
1:20:44ENSeeing Like a Mamba: Vision, Rotting States, and a Cell Model in 90 Days진행자 Nathan LabenzNathan Labenz and Jason Meaux survey the vision papers, long-context experiments, and biology work that followed the original Mamba release.
2:47:17ENIf You Want Human-Level AI, Abandon Generative Models게스트 Yann Lecun · 진행자 Lex FridmanYann LeCun tells Lex Fridman why autoregressive LLMs cannot plan, remember, or understand the physical world — and why open source is the only democratic answer.
23:00ENTesting Google Gemma 7B at Launch: Setup MattersMatthew Berman · Forward FutureMatthew Berman compares local and hosted tests of Google’s early open-weight model.
1:58:43ENA Worm With 302 Neurons Already Makes Trade-offs. AI Is Still on the Same Ladder.진행자 Nathan LabenzMax Bennett maps 600 million years of brain evolution onto five breakthroughs — and asks which rungs today's models have actually reached.
40:58EN99% of Factory Robots Are Dumb. Covariant Wants the Smart Ones Working in Warehouses First진행자 Sarah Guo, Elad GilFormer OpenAI researcher Peter Chen explains why robot foundation models have to be trained on production floors, not in labs.
2:30:06ENTrained on a Thirtieth of GPT-4's Tokens, Mamba Beat Transformers on Home Turf진행자 Nathan LabenzIn a solo emergency episode, Nathan Labenz argues that Albert Gu and Tri Dao's selective state space model is the first architecture since 2017 that deserves to share the Transformer’s throne.
1:19:24ENA Toy Paper Did Not Prove LLMs Cannot Generalize. The Discourse Still Ran With It.진행자 Nathan LabenzNathan Labenz and Erik Torenberg unpack a viral DeepMind result, a weekend reproduction, and a premature war over voluntary AI commitments.
1:21:50ENA 16K Context Window Holds About 350 Rows. That's Why Tables Need an Agent.진행자 Nathan LabenzGretel AI founder Alex Watson tells Nathan Labenz why most company data is still a spreadsheet, why GPT-4 is the wrong tool for generating it, and how differential privacy lets a model learn a disease without learning a patient.
41:58ENReliability is the bottleneck. Autonomy is what would make AI feel alive.진행자 Sarah Guo, Elad GilIlya Sutskever talks with Sarah Guo and Elad Gil about AlexNet, OpenAI’s capped-profit bet, why smaller models mainly lose reliability, and the line he draws for digital life.
1:19:52EN1,000 H100s Take 115 Days; 22,000 Take Five진행자 Nathan LabenzNathan Labenz and Trey Kollmer walk through cluster math that turns GPT-4-scale training into a weekly experiment, then four papers on search-augmented models, recursive code improvers, spatial maps inside Llama 2, and what networks do when they have no idea.
37:01ENDNA Is Code, but You Compile It with a Pipette진행자 Sarah Guo, Elad GilGinkgo Bioworks CEO Jason Kelly tells No Priors why cells are worth the magic, why biology has no AWS, and why a pandemic should look like cybersecurity.
더 보기248개 중 24개 표시







