Results
274 articlesSort
14:23EN
Matthew Berman· Mar 31, 2024Testing DBRX: Coding Strengths and Reasoning GapsMatthew Berman · Forward FutureMatthew Berman examines Databricks’ open-weight model and puts it through coding, arithmetic and reasoning prompts.
1:20:44EN
Cognitive Revolution "How AI Changes Everything"· Mar 30, 2024PodcastSeeing Like a Mamba: Vision, Rotting States, and a Cell Model in 90 DaysHost Nathan LabenzNathan Labenz and Jason Meaux survey the vision papers, long-context experiments, and biology work that followed the original Mamba release.
22:17ENMatthew Berman· Mar 21, 2024Q* Rumors, Energy-Based Models, and Research on ReasoningMatthew Berman, Yann Lecun · Forward FutureMatthew Berman examines an anonymous, unverified account of Q* and compares its ideas with published research on teaching language models to reason.
2:47:17EN
Lex Fridman· Mar 7, 2024Podcast · 2 speakersIf You Want Human-Level AI, Abandon Generative ModelsGuest Yann Lecun · Host Lex FridmanYann LeCun tells Lex Fridman why autoregressive LLMs cannot plan, remember, or understand the physical world — and why open source is the only democratic answer.
23:00ENMatthew Berman· Feb 22, 2024Testing Google Gemma 7B at Launch: Setup MattersMatthew Berman · Forward FutureMatthew Berman compares local and hosted tests of Google’s early open-weight model.
1:58:43ENCognitive Revolution "How AI Changes Everything"· Feb 7, 2024PodcastA Worm With 302 Neurons Already Makes Trade-offs. AI Is Still on the Same Ladder.Host Nathan LabenzMax Bennett maps 600 million years of brain evolution onto five breakthroughs — and asks which rungs today's models have actually reached.
0:42ENMatthew Berman· Jan 31, 2024LLaVA 1.6 Adds Higher-Resolution Image UnderstandingMatthew Berman · Forward FutureMatthew Berman reviews the January 2024 release of LLaVA 1.6 and its local availability through Ollama.
40:58EN
No Priors: AI, Machine Learning, Tech, & Startups· Jan 25, 2024Podcast · 2 speakers99% of Factory Robots Are Dumb. Covariant Wants the Smart Ones Working in Warehouses FirstHost Sarah Guo, Elad GilFormer OpenAI researcher Peter Chen explains why robot foundation models have to be trained on production floors, not in labs.
2:30:06ENCognitive Revolution "How AI Changes Everything"· Dec 22, 2023PodcastTrained on a Thirtieth of GPT-4's Tokens, Mamba Beat Transformers on Home TurfHost Nathan LabenzIn a solo emergency episode, Nathan Labenz argues that Albert Gu and Tri Dao's selective state space model is the first architecture since 2017 that deserves to share the Transformer’s throne.
1:19:24ENCognitive Revolution "How AI Changes Everything"· Nov 17, 2023PodcastA Toy Paper Did Not Prove LLMs Cannot Generalize. The Discourse Still Ran With It.Host Nathan LabenzNathan Labenz and Erik Torenberg unpack a viral DeepMind result, a weekend reproduction, and a premature war over voluntary AI commitments.
1:21:50ENCognitive Revolution "How AI Changes Everything"· Nov 14, 2023PodcastA 16K Context Window Holds About 350 Rows. That's Why Tables Need an Agent.Host Nathan LabenzGretel AI founder Alex Watson tells Nathan Labenz why most company data is still a spreadsheet, why GPT-4 is the wrong tool for generating it, and how differential privacy lets a model learn a disease without learning a patient.
41:58ENNo Priors: AI, Machine Learning, Tech, & Startups· Nov 2, 2023Podcast · 2 speakersReliability is the bottleneck. Autonomy is what would make AI feel alive.Host Sarah Guo, Elad GilIlya Sutskever talks with Sarah Guo and Elad Gil about AlexNet, OpenAI’s capped-profit bet, why smaller models mainly lose reliability, and the line he draws for digital life.
1:19:52ENCognitive Revolution "How AI Changes Everything"· Oct 18, 2023Podcast1,000 H100s Take 115 Days; 22,000 Take FiveHost Nathan LabenzNathan Labenz and Trey Kollmer walk through cluster math that turns GPT-4-scale training into a weekly experiment, then four papers on search-augmented models, recursive code improvers, spatial maps inside Llama 2, and what networks do when they have no idea.
37:01ENNo Priors: AI, Machine Learning, Tech, & Startups· Sep 28, 2023Podcast · 2 speakersDNA Is Code, but You Compile It with a PipetteHost Sarah Guo, Elad GilGinkgo Bioworks CEO Jason Kelly tells No Priors why cells are worth the magic, why biology has no AWS, and why a pandemic should look like cybersecurity.
12:49ENMatthew Berman· Sep 14, 2023Falcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.
36:33EN
20VC with Harry Stebbings· Aug 31, 2023Podcast · 2 speakersNoam Shazeer on Character.AI, the Cost of Training Models and the Uses of General AIGuest Noam Shazeer · Host Harry StebbingsThe Character.AI co-founder explains his consumer strategy, language-model training and why he expects users to invent applications the company cannot predict.
55:08ENCognitive Revolution "How AI Changes Everything"· Aug 29, 2023PodcastOne Model Inside 38 Products: Paige Bailey on How Google Trains and Ships PaLM 2Host Nathan LabenzAt Google I/O in May 2023, PaLM 2 arrived already running in more than two dozen products — and its lead product manager walks through what that actually took.
6:28ENMatthew Berman· Aug 29, 2023A Historical GPT-3.5 Fine-Tuning WalkthroughMatthew Berman · Forward FutureMatthew Berman demonstrates generating synthetic examples in Colab and training a model to use a distinctive tone.
52:48ENCognitive Revolution "How AI Changes Everything"· Aug 25, 2023PodcastOpenAI Cut Fine-Tuning 90 Percent, and Founders Crossed Llama 2 Off the ListHost Nathan LabenzNathan Labenz and Erik Torenberg walk through GPT-3.5 Turbo fine-tuning, why self-hosting still loses on total cost, and what is actually working in code, school, and medicine.
35:24ENNo Priors: AI, Machine Learning, Tech, & Startups· Aug 24, 2023Podcast · 2 speakersThe Author of Attention Is All You Need Now Compiles mRNA Like BytecodeHost Sarah Guo, Elad GilJakob Uszkoreit on why Transformers won, why models spend compute on the wrong things, and why drug discovery has to become generation rather than screening.
7:09ENMatthew Berman· Jul 28, 2023AI News in July 2023: SDXL, Worldcoin, and Biological ComputingMatthew Berman · Forward FutureMatthew Berman reviews a week of AI developments, from Google’s Gemini project and new generative models to biometric identity and experiments with cultured neurons.
2:13:07ENCognitive Revolution "How AI Changes Everything"· Jul 27, 2023PodcastHalf an Hour to a Circuit in GPT-2 Small — and a Quadratic Wall Before GPT-3Host Nathan LabenzArthur Conmy walks Nathan Labenz through ACDC, the algorithm that automates the most tedious step of mechanistic interpretability: finding which transformer components actually do a task.
5:53ENMatthew Berman· Jul 18, 2023Petals: Distributing Large Language Model Inference Across DevicesMatthew Berman · Forward FutureIn 2023, Matthew Berman explains Petals as a way to use large models through a network of participating computers rather than loading every layer on one device.
12:20ENMatthew Berman· Jul 10, 2023Testing UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.Load moreShowing 24 of 274