Results
269 articlesSort
55:08EN
Cognitive Revolution "How AI Changes Everything"· Aug 29, 2023PodcastOne Model Inside 38 Products: Paige Bailey on How Google Trains and Ships PaLM 2Host Nathan LabenzAt Google I/O in May 2023, PaLM 2 arrived already running in more than two dozen products — and its lead product manager walks through what that actually took.
39:45EN
No Priors: AI, Machine Learning, Tech, & Startups· Jul 27, 2023Podcast · 2 speakersPalantir's 13th Employee: The Model Is a Stochastic Genie. Ontology Is the Stake That Tethers ItHost Sarah Guo, Elad GilCTO Shyam Sankar on 550 microservices, air-gapped submarines, and why Palantir's ontology is what large language models were waiting for.
5:34EN
Matthew Berman· Jul 26, 2023FreeWilly2: A 2023 Prompt Test with Uncertain FormattingMatthew Berman · Forward FutureMatthew Berman retries an instruction-tuned Llama 2 model after a poor first run, finding mixed results and a likely template problem.
4:59ENMatthew Berman· Jul 25, 2023Testing Airoboros L2 70B on Coding, Writing and ReasoningMatthew Berman · Forward FutureMatthew Berman runs a small set of prompts against a Llama 2 fine-tune, finding useful structured output alongside failures on code and logic.
11:07ENMatthew Berman· Jul 24, 2023Installing Llama 2 13B Chat and Testing Its ResponsesMatthew Berman · Forward FutureMatthew Berman demonstrates a 2023 local setup and tests a 13-billion-parameter chat model on coding, writing, arithmetic and reasoning. His small set of prompts illustrates both useful outputs and mistakes.
9:46ENMatthew Berman· Jul 17, 2023Orca Mini V2 vs. OpenOrca: A 2023 Informal Model ComparisonMatthew Berman · Forward FutureMatthew Berman tests two Orca-inspired models on coding, writing and reasoning, with results shaped by prompt setup and subjective scoring.
8:04ENMatthew Berman· Jul 11, 2023WizardLM 13B v1.1 Tested on Coding, Writing and LogicMatthew Berman · Forward FutureMatthew Berman tries an instruction-tuned model on a small set of prompts, with mixed results and several subjective scoring choices.
12:20ENMatthew Berman· Jul 10, 2023Testing UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.
54:00EN
20VC with Harry Stebbings· Jun 30, 2023Podcast · 2 speakersDouwe Kiela on Data, Retrieval and Enterprise AIGuest Douwe Kiela · Host Harry StebbingsThe Contextual AI CEO discusses language model trade-offs, evaluation, open models and the hurdles to enterprise use.
18:08ENMatthew Berman· Jun 29, 2023Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
7:21ENMatthew Berman· Jun 26, 2023Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.
13:50ENMatthew Berman· Jun 23, 2023MPT-30B: Running MosaicML’s Model Locally and Testing Its Chat VariantMatthew Berman · Forward FutureMatthew Berman reviews MosaicML’s June 2023 release, demonstrates a local setup, and puts the hosted chat model through an informal prompt rubric.
10:23ENMatthew Berman· Jun 15, 2023Testing Hosted Falcon 40B and Document Chat in h2oGPTMatthew Berman · Forward FutureMatthew Berman tries H2O.ai’s 2023 hosted Falcon 40B interface on coding, writing and reasoning prompts, then demonstrates document chat.
11:49ENMatthew Berman· Jun 1, 2023Testing Wizard-Vicuna 30B: Responses, Reasoning, and CodeMatthew Berman · Forward FutureMatthew Berman examines a model marketed as uncensored, demonstrates a 2023 cloud setup, and runs an informal collection of tests.
1:33:51ENCognitive Revolution "How AI Changes Everything"· May 23, 2023PodcastGPT-4 still writes SQL that will not run. She put a guardrail on the modelHost Nathan LabenzShreya Rajpal built Guardrails AI so developers can encode what “correct” means, validate the pieces, and send failures back to the model instead of hoping the prompt holds.
1:25:35ENCognitive Revolution "How AI Changes Everything"· May 21, 2023PodcastTwo and a Half Years From 33.3% to 86.5%: Google Sent Foundation Models to Medical SchoolHost Nathan LabenzVivek Natarajan walks Nathan Labenz through Med-PaLM and Med-PaLM 2: the data-light techniques, the nine-axis clinician evals, and why a high USMLE-style score is the wrong trophy.
42:18ENNo Priors: AI, Machine Learning, Tech, & Startups· May 18, 2023Podcast · 2 speakersTen Percent of Search Is Health — and the Doctor Is Googling TooHost Sarah Guo, Elad GilGoogle researcher Karan Singhal on Med-PaLM 2, the real bar for medical language models, and why medicine is a harder alignment lab than chatbots.
1:28:43ENCognitive Revolution "How AI Changes Everything"· May 16, 2023PodcastClinical Guidelines Are 11% Evidence. Curai’s Founder Still Wants GPT-4 in the Exam RoomHost Nathan LabenzNeal Khosla of Curai Health argues that large language models already match median U.S. physicians on today’s tests — and that the real work is scaffolding, supervision, and a doctor’s signature.
58:24ENCognitive Revolution "How AI Changes Everything"· May 11, 2023PodcastAmong 100 Random Doctors, Zak Kohane Would Be Surprised If One Beat GPT-4Host Nathan LabenzHarvard's biomedical informatics chair on a rare newborn case, why drug-style trials will not certify a general medical model, and why the AI should still work for the patient.
6:53ENMatthew Berman· May 4, 2023StableVicuna’s 2023 Release: An Early RLHF Chatbot Put to the TestMatthew Berman · Forward FutureMatthew Berman reviews the 13-billion-parameter model and tests poetry, simple code, reasoning and a resignation email.
1:21:06ENCognitive Revolution "How AI Changes Everything"· Apr 27, 2023PodcastEveryone Talks About RLHF. Almost Nobody Is Doing It.Host Nathan LabenzHumanloop CEO Raza Habib on why an LLM API is maybe five percent of a working product, and what actually fills the rest.
6:24ENMatthew Berman· Apr 6, 2023BloombergGPT: Mixing Financial and General Data for a Language ModelMatthew Berman · Forward FutureMatthew Berman examines the 2023 finance-focused research model, its training corpus, evaluation and decision not to release weights.
1:56:16ENCognitive Revolution "How AI Changes Everything"· Apr 6, 2023PodcastThey Used Humans as Stand-In AIs. Now 250,000 People Run Elicit.Host Nathan LabenzOught's founders tell Nathan Labenz why open-ended reasoning has to be decomposed, supervised, and grounded—not scaled until it merely looks persuasive.
1:23:53ENCognitive Revolution "How AI Changes Everything"· Mar 17, 2023PodcastGPT-4, 24 Hours Later: No Safety Locks, a Captcha Hire, and a U.S.–China DeadlockHost Nathan LabenzA day after OpenAI shipped GPT-4, ChinaTalk sat a red teamer, a pessimist, and a policy researcher down to argue over capability, safety, and a race nobody can brake.Load moreShowing 24 of 269