絞り込み結果
273 件並び順
0:42ENLLaVA 1.6 Adds Higher-Resolution Image UnderstandingMatthew Berman · Forward FutureMatthew Berman reviews the January 2024 release of LLaVA 1.6 and its local availability through Ollama.
40:58EN99% of Factory Robots Are Dumb. Covariant Wants the Smart Ones Working in Warehouses Firstホスト Sarah Guo, Elad GilFormer OpenAI researcher Peter Chen explains why robot foundation models have to be trained on production floors, not in labs.
2:30:06ENTrained on a Thirtieth of GPT-4's Tokens, Mamba Beat Transformers on Home Turfホスト Nathan LabenzIn a solo emergency episode, Nathan Labenz argues that Albert Gu and Tri Dao's selective state space model is the first architecture since 2017 that deserves to share the Transformer’s throne.
1:19:24ENA Toy Paper Did Not Prove LLMs Cannot Generalize. The Discourse Still Ran With It.ホスト Nathan LabenzNathan Labenz and Erik Torenberg unpack a viral DeepMind result, a weekend reproduction, and a premature war over voluntary AI commitments.
1:21:50ENA 16K Context Window Holds About 350 Rows. That's Why Tables Need an Agent.ホスト Nathan LabenzGretel AI founder Alex Watson tells Nathan Labenz why most company data is still a spreadsheet, why GPT-4 is the wrong tool for generating it, and how differential privacy lets a model learn a disease without learning a patient.
41:58ENReliability is the bottleneck. Autonomy is what would make AI feel alive.ホスト Sarah Guo, Elad GilIlya Sutskever talks with Sarah Guo and Elad Gil about AlexNet, OpenAI’s capped-profit bet, why smaller models mainly lose reliability, and the line he draws for digital life.
1:19:52EN1,000 H100s Take 115 Days; 22,000 Take Fiveホスト Nathan LabenzNathan Labenz and Trey Kollmer walk through cluster math that turns GPT-4-scale training into a weekly experiment, then four papers on search-augmented models, recursive code improvers, spatial maps inside Llama 2, and what networks do when they have no idea.
37:01ENDNA Is Code, but You Compile It with a Pipetteホスト Sarah Guo, Elad GilGinkgo Bioworks CEO Jason Kelly tells No Priors why cells are worth the magic, why biology has no AWS, and why a pandemic should look like cybersecurity.
12:49ENFalcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.
36:33ENNoam Shazeer on Character.AI, the Cost of Training Models and the Uses of General AIゲスト Noam Shazeer · ホスト Harry StebbingsThe Character.AI co-founder explains his consumer strategy, language-model training and why he expects users to invent applications the company cannot predict.
55:08ENOne Model Inside 38 Products: Paige Bailey on How Google Trains and Ships PaLM 2ホスト Nathan LabenzAt Google I/O in May 2023, PaLM 2 arrived already running in more than two dozen products — and its lead product manager walks through what that actually took.
6:28ENA Historical GPT-3.5 Fine-Tuning WalkthroughMatthew Berman · Forward FutureMatthew Berman demonstrates generating synthetic examples in Colab and training a model to use a distinctive tone.
52:48ENOpenAI Cut Fine-Tuning 90 Percent, and Founders Crossed Llama 2 Off the Listホスト Nathan LabenzNathan Labenz and Erik Torenberg walk through GPT-3.5 Turbo fine-tuning, why self-hosting still loses on total cost, and what is actually working in code, school, and medicine.
35:24ENThe Author of Attention Is All You Need Now Compiles mRNA Like Bytecodeホスト Sarah Guo, Elad GilJakob Uszkoreit on why Transformers won, why models spend compute on the wrong things, and why drug discovery has to become generation rather than screening.
7:09ENAI News in July 2023: SDXL, Worldcoin, and Biological ComputingMatthew Berman · Forward FutureMatthew Berman reviews a week of AI developments, from Google’s Gemini project and new generative models to biometric identity and experiments with cultured neurons.
2:13:07ENHalf an Hour to a Circuit in GPT-2 Small — and a Quadratic Wall Before GPT-3ホスト Nathan LabenzArthur Conmy walks Nathan Labenz through ACDC, the algorithm that automates the most tedious step of mechanistic interpretability: finding which transformer components actually do a task.
5:53ENPetals: Distributing Large Language Model Inference Across DevicesMatthew Berman · Forward FutureIn 2023, Matthew Berman explains Petals as a way to use large models through a network of participating computers rather than loading every layer on one device.
12:20ENTesting UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.
1:33:56ENThe AI Scouting Report: 90 Minutes From GPT-4's Exam Scores to Whether Models Understandホスト Nathan LabenzNathan Labenz spends a solo episode walking through what general-purpose models can do, how they are trained, how capabilities unlock, and whether they understand anything at all.
18:08ENSix Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
1:32:22ENA Million Bytes and 256 Symbols: Meta's MEGABYTE Wants to Throw the Tokenizer Awayホスト Nathan LabenzLili Yu of Meta AI explains a multiscale transformer that predicts million-byte sequences, skips tokenization, and aims to model any file as raw bytes.
1:52:46ENCharge Neural Nets by Connection Length, and the Black Box Splits Into Modules You Can Seeホスト Nathan LabenzMIT physicist Ziming Liu walks Nathan Labenz through BIMT, a brain-inspired training trick that sparsifies networks until you can read them by looking.
4:36ENTesting WizardCoder 15B as a Local Coding AssistantMatthew Berman · Forward FutureMatthew Berman runs the 2023 WizardCoder model locally, testing small Python exercises and a longer Snake game.
59:28ENFrom $500,000 to $50,000: MosaicML Made Training Your Own Model a Priced Productホスト Nathan LabenzJonathan Frankle and Abhi Venigalla explain who is training custom LLMs, why extraction beats chat, and how ALiBi stretches a 65k context window.
もっと見る273 件中 24 件を表示









