필터 결과
279개정렬
52:48ENOpenAI Cut Fine-Tuning 90 Percent, and Founders Crossed Llama 2 Off the List진행자 Nathan LabenzNathan Labenz and Erik Torenberg walk through GPT-3.5 Turbo fine-tuning, why self-hosting still loses on total cost, and what is actually working in code, school, and medicine.
35:24ENThe Author of Attention Is All You Need Now Compiles mRNA Like Bytecode진행자 Sarah Guo, Elad GilJakob Uszkoreit on why Transformers won, why models spend compute on the wrong things, and why drug discovery has to become generation rather than screening.
7:09ENAI News in July 2023: SDXL, Worldcoin, and Biological ComputingMatthew Berman · Forward FutureMatthew Berman reviews a week of AI developments, from Google’s Gemini project and new generative models to biometric identity and experiments with cultured neurons.
2:13:07ENHalf an Hour to a Circuit in GPT-2 Small — and a Quadratic Wall Before GPT-3진행자 Nathan LabenzArthur Conmy walks Nathan Labenz through ACDC, the algorithm that automates the most tedious step of mechanistic interpretability: finding which transformer components actually do a task.
5:53ENPetals: Distributing Large Language Model Inference Across DevicesMatthew Berman · Forward FutureIn 2023, Matthew Berman explains Petals as a way to use large models through a network of participating computers rather than loading every layer on one device.
12:20ENTesting UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.
1:33:56ENThe AI Scouting Report: 90 Minutes From GPT-4's Exam Scores to Whether Models Understand진행자 Nathan LabenzNathan Labenz spends a solo episode walking through what general-purpose models can do, how they are trained, how capabilities unlock, and whether they understand anything at all.
18:08ENSix Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
1:32:22ENA Million Bytes and 256 Symbols: Meta's MEGABYTE Wants to Throw the Tokenizer Away진행자 Nathan LabenzLili Yu of Meta AI explains a multiscale transformer that predicts million-byte sequences, skips tokenization, and aims to model any file as raw bytes.
1:52:46ENCharge Neural Nets by Connection Length, and the Black Box Splits Into Modules You Can See진행자 Nathan LabenzMIT physicist Ziming Liu walks Nathan Labenz through BIMT, a brain-inspired training trick that sparsifies networks until you can read them by looking.
4:36ENTesting WizardCoder 15B as a Local Coding AssistantMatthew Berman · Forward FutureMatthew Berman runs the 2023 WizardCoder model locally, testing small Python exercises and a longer Snake game.
59:28ENFrom $500,000 to $50,000: MosaicML Made Training Your Own Model a Priced Product진행자 Nathan LabenzJonathan Frankle and Abhi Venigalla explain who is training custom LLMs, why extraction beats chat, and how ALiBi stretches a 65k context window.
2:00:19EN1.5 Million GPT-4 Fairy Tales Let a 33-Million-Parameter Model Out-Reason GPT-2진행자 Nathan LabenzTry this fill-in: Lily likes cats and dogs. She asked her mom for a dog. Mom said no, so she asked for a…
11:49ENTesting Wizard-Vicuna 30B: Responses, Reasoning, and CodeMatthew Berman · Forward FutureMatthew Berman examines a model marketed as uncensored, demonstrates a 2023 cloud setup, and runs an informal collection of tests.
1:25:35ENTwo and a Half Years From 33.3% to 86.5%: Google Sent Foundation Models to Medical School진행자 Nathan LabenzVivek Natarajan walks Nathan Labenz through Med-PaLM and Med-PaLM 2: the data-light techniques, the nine-axis clinician evals, and why a high USMLE-style score is the wrong trophy.
42:18ENTen Percent of Search Is Health — and the Doctor Is Googling Too진행자 Sarah Guo, Elad GilGoogle researcher Karan Singhal on Med-PaLM 2, the real bar for medical language models, and why medicine is a harder alignment lab than chatbots.
5:24ENGoogle I/O 2023: Bard, PaLM 2 and AI Across Google's ProductsMatthew Berman · Forward FutureMatthew Berman reviews Google's 2023 AI announcements and weighs its focus on improving established products.
4:14:33ENThe Next Token Is Not a Proof: Stephen Wolfram on ChatGPT and Computational Truth게스트 Stephen Wolfram · 진행자 Lex FridmanIn his fourth conversation with Lex Fridman, Stephen Wolfram contrasts large language models with Wolfram|Alpha, then follows computational irreducibility from ChatGPT through observers, thermodynamics, and the three great theories of twentieth-century physics.
40:25ENA 6-Billion-Parameter Clone of ChatGPT’s Core Trick진행자 Sarah Guo, Elad GilDatabricks CTO Matei Zaharia tells Sarah Guo and Elad Gil how Dolly learned instruction-following on fifty times less data than GPT-3 — and why he would rather look facts up than bake them into a trillion-parameter network.
8:05ENA 2023 Guide to Running the Original GPT4All Model LocallyMatthew Berman · Forward FutureMatthew Berman demonstrates an early CPU-based GPT4All release, its terminal installation and the resources available for fine-tuning.
7:55ENHow to Train a Custom Image Model in Leonardo.aiMatthew Berman · Forward FutureMatthew Berman walks through Leonardo.ai’s 2023 model galleries, training-set guidance, and custom model workflow, then shares results from several experiments.
1:03:29ZH多模态论文串讲:BLIP、CoCa 与 BEiT-3从图文数据清理到统一预训练,梳理三种视觉语言模型的结构、目标函数与相互联系。
1:07:10ZHInstructGPT 论文精读:从人工反馈到语言模型对齐从监督微调、奖励模型到 PPO,梳理 InstructGPT 的训练流程、实验结果与局限。
3:28:47ENKarpathy Calls Trained Neural Nets Complicated Alien Artifacts게스트 Andrej Karpathy · 진행자 Lex FridmanOn Lex Fridman's podcast, Andrej Karpathy refuses the brain analogy, walks the Fermi paradox through Nick Lane's chemistry, and treats the Transformer as a general-purpose differentiable computer.
더 보기279개 중 24개 표시









