Results
206 articlesSort
18:08EN
Matthew Berman· Jun 29, 2023Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
4:36ENMatthew Berman· Jun 20, 2023Testing WizardCoder 15B as a Local Coding AssistantMatthew Berman · Forward FutureMatthew Berman runs the 2023 WizardCoder model locally, testing small Python exercises and a longer Snake game.
19:38ENMatthew Berman· Jun 9, 2023Orca: Teaching a Smaller Model with GPT-4 ExplanationsMatthew Berman · Forward FutureMatthew Berman reviews Microsoft Research’s 2023 Orca paper and its approach to training a 13-billion-parameter model on detailed teacher responses.
10:40ENMatthew Berman· Jun 7, 2023Testing Nous Hermes 13B Locally: Mixed Reasoning and Unsafe ResponsesMatthew Berman · Forward FutureMatthew Berman compares a 2023 quantized model on hosted and local hardware, with uneven results across coding, logic and safety.
11:42ENMatthew Berman· May 31, 2023Guanaco and QLoRA: A 2023 Fine-Tuning and Model TestMatthew Berman · Forward FutureMatthew Berman reviews the QLoRA paper, explains the reported memory savings and tries Guanaco 65B on an informal prompt set.
1:25:35EN
Cognitive Revolution "How AI Changes Everything"· May 21, 2023PodcastTwo and a Half Years From 33.3% to 86.5%: Google Sent Foundation Models to Medical SchoolHost Nathan LabenzVivek Natarajan walks Nathan Labenz through Med-PaLM and Med-PaLM 2: the data-light techniques, the nine-axis clinician evals, and why a high USMLE-style score is the wrong trophy.
10:16ENMatthew Berman· May 21, 2023DarkBERT: Adapting a Language Model to Dark-Web TextMatthew Berman · Forward FutureMatthew Berman reviews research on a RoBERTa-based model and its cybersecurity evaluations.
11:07ENMatthew Berman· May 16, 2023Testing MosaicML MPT-7B Chat and StoryWriter in 2023Matthew Berman · Forward FutureMatthew Berman examines MPT-7B model variants, their licenses and a mixed set of local tests.
58:24ENCognitive Revolution "How AI Changes Everything"· May 11, 2023PodcastAmong 100 Random Doctors, Zak Kohane Would Be Surprised If One Beat GPT-4Host Nathan LabenzHarvard's biomedical informatics chair on a rare newborn case, why drug-style trials will not certify a general medical model, and why the AI should still work for the patient.
9:58ENMatthew Berman· Apr 26, 2023HuggingChat’s 2023 Debut: Testing Writing, Reasoning and Python CodeMatthew Berman · Forward FutureMatthew Berman tries the early OpenAssistant-powered HuggingChat on writing, arithmetic, logic and a Snake game, then compares a few outputs with GPT-3.5 and GPT-4. The results illustrate both promise and limitations in this small historical test.
53:37EN
No Priors: AI, Machine Learning, Tech, & Startups· Mar 9, 2023Podcast · 2 speakers30 models, 42 scenarios, 7 metrics: Percy Liang's public checkup for language modelsHost Sarah Guo, Elad GilA PubMed-only model once led the U.S. medical licensing exam — until a system roughly 200 times larger overtook it.
2:34:20EN
Lex Fridman· Aug 30, 2020Podcast · 2 speakersIntelligence Is How Efficiently You Acquire Skills You Were Not Prepared ForGuest François Chollet · Host Lex FridmanFrançois Chollet tells Lex Fridman why skill is not intelligence, why GPT-3 is still pattern matching, and why a grid puzzle called ARC still separates children from machines.
1:49:51ENLex Fridman· Jun 27, 2020Podcast · 2 speakersThe Idea Once Called a Devolution Now Powers Almost Every New ChipGuest David Patterson · Host Lex FridmanTuring Award winner David Patterson talks with Lex Fridman about RISC, RAID, Moore's Law, open hardware, and why chips without a software stack die.
16:03ENLex Fridman· Feb 22, 2020Podcast · 2 speakersQuantum Supremacy Is a Well-Defined Speedup, Not a Useful TaskGuest Scott Aaronson · Host Lex FridmanScott Aaronson explains what Google's 53-qubit experiment actually demonstrated, how it was verified, and why complexity theory can offer evidence but not proof against classical spoofing.
57:57EN
Jane Street· May 8, 2019Sebastian Funk on a Fast, Safe and Maintainable Packet ProcessorSebastian Funk · Jane StreetA single-core market-data case study shows how latency targets, allocation control and generated code can coexist with high-level abstractions.
11:11ENLex FridmanPodcast · 2 speakersYann LeCun on Benchmarks, Interactive Environments, and Why Human Intelligence Is Not GeneralGuest Yann Lecun · Host Lex FridmanIn a 2019 clip, LeCun defends benchmarks as a test of AI claims, explains why interactive environments break the usual train-test protocol, and argues that "general intelligence" is a misnomer.
1:22:57ENCognitive Revolution "How AI Changes Everything"PodcastHuman-Level but Not Human-Like: A GPT-4 Red Teamer on What He Saw Behind the MaskHost Nathan LabenzNathan Labenz recounts two months of full-time testing of an early GPT-4, from the AI doctor of his dreams to a model that would plan assassinations on request.
14:41ENLex FridmanPodcast · 2 speakersTalking for 20 Minutes: How the Alexa Prize Turns Real Customers into a Testbed for Conversational AIGuest Rohit Prasad · Host Lex FridmanRohit Prasad, head scientist of Amazon Alexa, explains the Alexa Prize grand challenge, how it is judged and why true conversation still needs reasoning.
16:41ENLex FridmanPodcastAlphaFold 2 and the Protein-Folding Breakthrough: Why Lex Fridman Calls It a Landmark for AI and BiologyHost Lex FridmanA quick explainer on DeepMind's CASP14 result, how protein folding works, how AlphaFold 1 and 2 likely differ, and what the advance could unlock.
57:21ENCognitive Revolution "How AI Changes Everything"PodcastGemini 2.0 Flash Goes to Production: Pricing, Model Lineup and What Developers Should Build NextHost Nathan LabenzGoogle DeepMind's Logan Kilpatrick walks through launch-day Gemini 2.0 releases, rate limits, model naming, and where he sees startup opportunities.
1:00:25ENLex FridmanPodcast · 2 speakersCan Machines Think? A Guided Tour of Turing's Test, Its Critics and Its SuccessorsGuest Turing Test · Host Lex FridmanLex Fridman walks through Alan Turing's 1950 paper, the objections to it, and the benchmarks that have tried to replace or extend the imitation game.
1:22:17ENCognitive Revolution "How AI Changes Everything"PodcastOne Set of Weights, Fourteen Medical Tasks: Inside Google's Multimodal Med-PaLM MHost Nathan LabenzVivek Natarajan and Tao Tu explain how Google built a single generalist biomedical model that reads images, genomics and text, and what it will take to put it in front of patients.