Results
243 articlesSort
1:54:17EN
Cognitive Revolution "How AI Changes Everything"· Aug 28, 2024PodcastMetaculus Flagged Covid in January 2020. Now It Is Putting AI on the Forecasting DeskHost Nathan LabenzNathan Labenz talks with Metaculus CEO Deger Turan about epistemic security, a year-long bot tournament, and why a useful forecast is harder than an accurate one.
1:12:31EN
Sequoia Capital· Aug 27, 2024PodcastA Bare Model Closes 35% of Airline Changes. Sierra's Agents Clear 70% of Real Tickets.Clay Bavor on why putting a raw LLM in front of customers does not math, and how AgentOS, supervisor agents, and outcome pricing change the arithmetic.
9:43EN
Matthew Berman· Aug 26, 2024Matthew Berman Tests Jamba 1.5 on Coding and Reasoning PromptsMatthew Berman · Forward FutureA 2024 hands-on test of AI21’s hybrid model finds slow output in one hosted session and mixed answers to a small set of prompts.
15:24ENMatthew Berman· Aug 13, 2024Testing the Anonymous sus-column-r Model, Later Identified as Grok-2Matthew Berman · Forward FutureMatthew Berman tests a mysterious 2024 Arena model on coding and reasoning; its verbose answers prompted speculation about OpenAI that the later identification contradicted.
57:55ENMatthew Berman· Aug 12, 2024A First AI Livestream: Model Rumors, RAG, Agents, and Audience QuestionsMatthew Berman · Forward FutureMatthew Berman tests a livestream in August 2024 and answers viewers’ questions about AI tools, model evaluation, company knowledge, and future agents.
12:17ENMatthew Berman· Aug 7, 2024Testing Gemini 1.5 Pro on Code, Reasoning, Images and VideoMatthew Berman · Forward FutureMatthew Berman compares standard and experimental Gemini versions in an informal 2024 review, finding mixed results and repeated output errors.
11:34ENMatthew Berman· Aug 1, 2024Testing Mistral Large 2: Coding, Reasoning and Safety in 2024Matthew Berman · Forward FutureMatthew Berman tests Mistral’s 123-billion-parameter model with small coding tasks, logic puzzles and ethical hypotheticals. The results are promising but narrowly scoped.
42:08ENSequoia Capital· Jul 30, 2024PodcastMeta Trained a 405B Teacher on 16,000 GPUs — Then Told the World to Distill ItTwo days after Llama 3.1 405B shipped, Meta's generative-AI product lead walks Sequoia through why the most expensive model in the family is free, and why he thinks the frontier itself is heading toward commodity.
13:40ENMatthew Berman· Jul 29, 2024Testing Llama 3.1 8B: Benchmark Gains and Mixed Practical ResultsMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and other prompts on the small model and finds several failures despite stronger reported benchmarks.
5:50ENMatthew Berman· Jul 27, 2024A Mixture-of-Agents Demo Using Groq and StreamlitMatthew Berman · Forward FutureMatthew Berman walks through a 2024 Groq-powered multi-agent project, from setup to inspecting its layered responses.
10:02ENMatthew Berman· Jul 24, 2024Testing Llama 3.1 405B on Coding, Arithmetic and ReasoningMatthew Berman · Forward FutureMatthew Berman tries Meta's 2024 open-weight model on an informal set of prompts and demonstrates a sponsored dataset workflow.
13:19ENMatthew Berman· Jul 20, 2024Testing GPT-4o Mini Against GPT-4o at LaunchMatthew Berman · Forward FutureMatthew Berman compares OpenAI's 2024 small model on coding, reasoning and image prompts, with a sponsored HP and Intel laptop segment.
25:56EN
No Priors: AI, Machine Learning, Tech, & Startups· Jul 11, 2024Podcast · 2 speakersA Prompt Cannot Hold a Good Design: Six AI Practitioners at Midyear 2024Host Sarah Guo, Elad GilSarah Guo and Elad Gil stitch together clips from Stripe, Figma, Figure, OpenAI's Sora team, Cognition, and Scale into a half-year snapshot of what people actually shipping AI were willing to claim.
1:16:22ENCognitive Revolution "How AI Changes Everything"· Jul 9, 2024PodcastHe Spent 20 Hours Crafting a Prompt. DSPy Beat Him AnywayHost Nathan LabenzSander Schulhoff walks through The Prompt Report — a 78-page survey of what actually works when you prompt large language models.
8:53ENMatthew Berman· Jul 8, 2024RouteLLM: Routing Queries Between Strong and Cheaper ModelsMatthew Berman · Forward FutureMatthew Berman explains a 2024 research framework that uses preference data to choose a model for each query.
59:11ENSequoia Capital· Jun 25, 2024PodcastDon't Train a Model. Factory's Founders Say Go Dig for GoldMatan Grinberg and Eno Reyes tell Sequoia's Training Data why they sell a fleet of job-specific droids on top of other people's models — and how that stack just took SWE-bench from 14% to 19%.
10:57ENMatthew Berman· Jun 24, 2024Testing Claude 3.5 Sonnet: Coding, Reasoning, and VisionMatthew Berman · Forward FutureMatthew Berman puts Anthropic’s June 2024 model through informal coding, math, puzzle, and image-understanding prompts.
12:55ENMatthew Berman· Jun 23, 2024Testing Mixture-of-Agents on Coding, Arithmetic and ReasoningMatthew Berman · Forward FutureMatthew Berman tries a multi-model setup on his informal LLM rubric and finds strong individual answers alongside coding and counting failures.
1:37:07ENCognitive Revolution "How AI Changes Everything"· Jun 22, 2024PodcastA Text-Only AI Outdiagnosed GPs. Google Still Won't Ship It.Host Nathan LabenzGoogle researchers Vivek Natarajan and Khaled Saab walk Nathan Labenz through five medical-AI papers, from radiology reports to an AI doctor that still has to earn trust.
1:25:10ENCognitive Revolution "How AI Changes Everything"· Jun 15, 2024PodcastA Tenth of Google's Index, 99.9% Recall: How 20 People Built Brave SearchHost Nathan LabenzJosep M. Pujol walks Cognitive Revolution through Brave's privacy-first index, hybrid retrieval stack, and the Search API Nathan Labenz now wants his own product team to use.
26:00ENNo Priors: AI, Machine Learning, Tech, & Startups· Jun 11, 2024Podcast · 2 speakersWhy a Zapier founder thinks AGI research has been stalled for four yearsHost Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
58:28ENCognitive Revolution "How AI Changes Everything"· May 22, 2024PodcastFrom Jailbreaking ChatGPT to Anthropic’s First Prompt Engineer: How Alex Albert Ships Claude 3Host Nathan LabenzA year after building jailbreakchat.com, Alex Albert walks Nathan Labenz through Claude 3’s writing, orchestration, character work, and the guardrails app developers still skip.
39:00ENNo Priors: AI, Machine Learning, Tech, & Startups· May 22, 2024Podcast · 2 speakersJPMorgan Has 150 Petabytes. GPT-4 Trained on Less Than One.Host Sarah Guo, Elad GilScale AI founder Alexandr Wang tells No Priors why easy internet data is exhausted, why expert-plus-model teams still win, and why the path to AGI looks more like curing cancer than inventing a vaccine.
12:50ENMatthew Berman· May 22, 2024Testing Smaug: Hosted 70B Versus a Smaller Local ModelMatthew Berman · Forward FutureMatthew Berman compares two Smaug configurations on Snake, math and reasoning puzzles.Load moreShowing 24 of 243