필터 결과
269개정렬
9:46ENOrca Mini V2 vs. OpenOrca: A 2023 Informal Model ComparisonMatthew Berman · Forward FutureMatthew Berman tests two Orca-inspired models on coding, writing and reasoning, with results shaped by prompt setup and subjective scoring.
8:04ENWizardLM 13B v1.1 Tested on Coding, Writing and LogicMatthew Berman · Forward FutureMatthew Berman tries an instruction-tuned model on a small set of prompts, with mixed results and several subjective scoring choices.
12:20ENTesting UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.
54:00ENDouwe Kiela on Data, Retrieval and Enterprise AI게스트 Douwe Kiela · 진행자 Harry StebbingsThe Contextual AI CEO discusses language model trade-offs, evaluation, open models and the hurdles to enterprise use.
18:08ENSix Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
7:21ENTesting Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.
13:50ENMPT-30B: Running MosaicML’s Model Locally and Testing Its Chat VariantMatthew Berman · Forward FutureMatthew Berman reviews MosaicML’s June 2023 release, demonstrates a local setup, and puts the hosted chat model through an informal prompt rubric.
10:23ENTesting Hosted Falcon 40B and Document Chat in h2oGPTMatthew Berman · Forward FutureMatthew Berman tries H2O.ai’s 2023 hosted Falcon 40B interface on coding, writing and reasoning prompts, then demonstrates document chat.
11:49ENTesting Wizard-Vicuna 30B: Responses, Reasoning, and CodeMatthew Berman · Forward FutureMatthew Berman examines a model marketed as uncensored, demonstrates a 2023 cloud setup, and runs an informal collection of tests.
1:33:51ENGPT-4 still writes SQL that will not run. She put a guardrail on the model진행자 Nathan LabenzShreya Rajpal built Guardrails AI so developers can encode what “correct” means, validate the pieces, and send failures back to the model instead of hoping the prompt holds.
1:25:35ENTwo and a Half Years From 33.3% to 86.5%: Google Sent Foundation Models to Medical School진행자 Nathan LabenzVivek Natarajan walks Nathan Labenz through Med-PaLM and Med-PaLM 2: the data-light techniques, the nine-axis clinician evals, and why a high USMLE-style score is the wrong trophy.
42:18ENTen Percent of Search Is Health — and the Doctor Is Googling Too진행자 Sarah Guo, Elad GilGoogle researcher Karan Singhal on Med-PaLM 2, the real bar for medical language models, and why medicine is a harder alignment lab than chatbots.
1:28:43ENClinical Guidelines Are 11% Evidence. Curai’s Founder Still Wants GPT-4 in the Exam Room진행자 Nathan LabenzNeal Khosla of Curai Health argues that large language models already match median U.S. physicians on today’s tests — and that the real work is scaffolding, supervision, and a doctor’s signature.
58:24ENAmong 100 Random Doctors, Zak Kohane Would Be Surprised If One Beat GPT-4진행자 Nathan LabenzHarvard's biomedical informatics chair on a rare newborn case, why drug-style trials will not certify a general medical model, and why the AI should still work for the patient.
6:53ENStableVicuna’s 2023 Release: An Early RLHF Chatbot Put to the TestMatthew Berman · Forward FutureMatthew Berman reviews the 13-billion-parameter model and tests poetry, simple code, reasoning and a resignation email.
1:21:06ENEveryone Talks About RLHF. Almost Nobody Is Doing It.진행자 Nathan LabenzHumanloop CEO Raza Habib on why an LLM API is maybe five percent of a working product, and what actually fills the rest.
6:24ENBloombergGPT: Mixing Financial and General Data for a Language ModelMatthew Berman · Forward FutureMatthew Berman examines the 2023 finance-focused research model, its training corpus, evaluation and decision not to release weights.
1:56:16ENThey Used Humans as Stand-In AIs. Now 250,000 People Run Elicit.진행자 Nathan LabenzOught's founders tell Nathan Labenz why open-ended reasoning has to be decomposed, supervised, and grounded—not scaled until it merely looks persuasive.
1:23:53ENGPT-4, 24 Hours Later: No Safety Locks, a Captcha Hire, and a U.S.–China Deadlock진행자 Nathan LabenzA day after OpenAI shipped GPT-4, ChinaTalk sat a red teamer, a pessimist, and a policy researcher down to argue over capability, safety, and a race nobody can brake.
11:53ENTesting GPT-4 Against GPT-3.5 at LaunchMatthew Berman · Forward FutureMatthew Berman reviews OpenAI's March 2023 GPT-4 announcement and compares the models on scheduling, reasoning, safety and travel prompts.
1:13:06ENLockheed Martin's CTO on Autonomy, the Moon, and the Culture of Not Getting It Wrong게스트 Keoki Jackson · 진행자 Lex FridmanKeoki Jackson tells Lex Fridman why going back to the Moon is the easy part—and why proving a learning system will still do the right thing is not.
1:45:49ENTrust at Scale: Elicit's Founders on Reasoning Languages, World Models and Automating the Company진행자 Nathan LabenzAndreas Stuhlmüller and Jungwon Byun explain how Elicit keeps frontier models checkable for high-stakes science, and where they think AI reasoning is heading.
1:25:13ENCodex Is Not Just a Coding Tool: OpenAI's Plan for an Agent That Behaves Like a Teammate진행자 Lenny RachitskyCodex product lead Alexander Embiricos explains the 20x growth, why every useful agent may need to write code, and why human review speed is the real bottleneck.
1:33:50ENEvals Are the New PRDs: Inside Anthropic's Research Product Team진행자 Lenny RachitskyDianne Penn, Anthropic's head of product for research and Labs, explains how the company found its identity, how her team turns user feedback into evals, and why human judgment still matters.
더 보기269개 중 24개 표시









