Resultados
344 artículosOrdenar
4:35ENRunning WizardCoder on a Cloud GPU: A 2023 RunPod WalkthroughMatthew Berman · Forward FutureMatthew Berman demonstrates downloading a quantized 13B coding model into a hosted text-generation interface, then explains how to stop the pod and avoid ongoing charges.
36:33ENNoam Shazeer on Character.AI, the Cost of Training Models and the Uses of General AIInvitado: Noam Shazeer · Presenta: Harry StebbingsThe Character.AI co-founder explains his consumer strategy, language-model training and why he expects users to invent applications the company cannot predict.
55:08ENOne Model Inside 38 Products: Paige Bailey on How Google Trains and Ships PaLM 2Presenta: Nathan LabenzAt Google I/O in May 2023, PaLM 2 arrived already running in more than two dozen products — and its lead product manager walks through what that actually took.
6:28ENA Historical GPT-3.5 Fine-Tuning WalkthroughMatthew Berman · Forward FutureMatthew Berman demonstrates generating synthetic examples in Colab and training a model to use a distinctive tone.
52:48ENOpenAI Cut Fine-Tuning 90 Percent, and Founders Crossed Llama 2 Off the ListPresenta: Nathan LabenzNathan Labenz and Erik Torenberg walk through GPT-3.5 Turbo fine-tuning, why self-hosting still loses on total cost, and what is actually working in code, school, and medicine.
35:24ENThe Author of Attention Is All You Need Now Compiles mRNA Like BytecodePresenta: Sarah Guo, Elad GilJakob Uszkoreit on why Transformers won, why models spend compute on the wrong things, and why drug discovery has to become generation rather than screening.
7:09ENAI News in July 2023: SDXL, Worldcoin, and Biological ComputingMatthew Berman · Forward FutureMatthew Berman reviews a week of AI developments, from Google’s Gemini project and new generative models to biometric identity and experiments with cultured neurons.
2:13:07ENHalf an Hour to a Circuit in GPT-2 Small — and a Quadratic Wall Before GPT-3Presenta: Nathan LabenzArthur Conmy walks Nathan Labenz through ACDC, the algorithm that automates the most tedious step of mechanistic interpretability: finding which transformer components actually do a task.
4:59ENTesting Airoboros L2 70B on Coding, Writing and ReasoningMatthew Berman · Forward FutureMatthew Berman runs a small set of prompts against a Llama 2 fine-tune, finding useful structured output alongside failures on code and logic.
9:40ENTesting Llama 2 70B on Coding, Writing and ReasoningMatthew Berman · Forward FutureMatthew Berman tries Meta’s 70-billion-parameter chat model through a hosted interface, highlighting both useful outputs and inconsistent reasoning.
5:53ENPetals: Distributing Large Language Model Inference Across DevicesMatthew Berman · Forward FutureIn 2023, Matthew Berman explains Petals as a way to use large models through a network of participating computers rather than loading every layer on one device.
8:04ENWizardLM 13B v1.1 Tested on Coding, Writing and LogicMatthew Berman · Forward FutureMatthew Berman tries an instruction-tuned model on a small set of prompts, with mixed results and several subjective scoring choices.
12:20ENTesting UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.
1:33:56ENThe AI Scouting Report: 90 Minutes From GPT-4's Exam Scores to Whether Models UnderstandPresenta: Nathan LabenzNathan Labenz spends a solo episode walking through what general-purpose models can do, how they are trained, how capabilities unlock, and whether they understand anything at all.
18:08ENSix Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
1:32:22ENA Million Bytes and 256 Symbols: Meta's MEGABYTE Wants to Throw the Tokenizer AwayPresenta: Nathan LabenzLili Yu of Meta AI explains a multiscale transformer that predicts million-byte sequences, skips tokenization, and aims to model any file as raw bytes.
1:52:46ENCharge Neural Nets by Connection Length, and the Black Box Splits Into Modules You Can SeePresenta: Nathan LabenzMIT physicist Ziming Liu walks Nathan Labenz through BIMT, a brain-inspired training trick that sparsifies networks until you can read them by looking.
13:50ENMPT-30B: Running MosaicML’s Model Locally and Testing Its Chat VariantMatthew Berman · Forward FutureMatthew Berman reviews MosaicML’s June 2023 release, demonstrates a local setup, and puts the hosted chat model through an informal prompt rubric.
4:36ENTesting WizardCoder 15B as a Local Coding AssistantMatthew Berman · Forward FutureMatthew Berman runs the 2023 WizardCoder model locally, testing small Python exercises and a longer Snake game.
59:28ENFrom $500,000 to $50,000: MosaicML Made Training Your Own Model a Priced ProductPresenta: Nathan LabenzJonathan Frankle and Abhi Venigalla explain who is training custom LLMs, why extraction beats chat, and how ALiBi stretches a 65k context window.
2:00:19EN1.5 Million GPT-4 Fairy Tales Let a 33-Million-Parameter Model Out-Reason GPT-2Presenta: Nathan LabenzTry this fill-in: Lily likes cats and dogs. She asked her mom for a dog. Mom said no, so she asked for a…
11:49ENTesting Wizard-Vicuna 30B: Responses, Reasoning, and CodeMatthew Berman · Forward FutureMatthew Berman examines a model marketed as uncensored, demonstrates a 2023 cloud setup, and runs an informal collection of tests.
1:25:35ENTwo and a Half Years From 33.3% to 86.5%: Google Sent Foundation Models to Medical SchoolPresenta: Nathan LabenzVivek Natarajan walks Nathan Labenz through Med-PaLM and Med-PaLM 2: the data-light techniques, the nine-axis clinician evals, and why a high USMLE-style score is the wrong trophy.
42:18ENTen Percent of Search Is Health — and the Doctor Is Googling TooPresenta: Sarah Guo, Elad GilGoogle researcher Karan Singhal on Med-PaLM 2, the real bar for medical language models, and why medicine is a harder alignment lab than chatbots.
Cargar másMostrando 24 de 344









