Resultados
269 artículosOrdenar
9:51EN
Matthew Berman· 7 ago 2024Strawberry Rumors and Two Anonymous Chatbot Reasoning TestsMatthew Berman · Forward FutureIn August 2024, Matthew Berman examined speculation about OpenAI’s next model and tested mystery chatbots on simple reasoning puzzles. Later disclosures clarified the identity of one of them.
12:17ENMatthew Berman· 7 ago 2024Testing Gemini 1.5 Pro on Code, Reasoning, Images and VideoMatthew Berman · Forward FutureMatthew Berman compares standard and experimental Gemini versions in an informal 2024 review, finding mixed results and repeated output errors.
11:34ENMatthew Berman· 1 ago 2024Testing Mistral Large 2: Coding, Reasoning and Safety in 2024Matthew Berman · Forward FutureMatthew Berman tests Mistral’s 123-billion-parameter model with small coding tasks, logic puzzles and ethical hypotheticals. The results are promising but narrowly scoped.
42:08EN
Sequoia Capital· 30 jul 2024PódcastMeta Trained a 405B Teacher on 16,000 GPUs — Then Told the World to Distill ItTwo days after Llama 3.1 405B shipped, Meta's generative-AI product lead walks Sequoia through why the most expensive model in the family is free, and why he thinks the frontier itself is heading toward commodity.
13:40ENMatthew Berman· 29 jul 2024Testing Llama 3.1 8B: Benchmark Gains and Mixed Practical ResultsMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and other prompts on the small model and finds several failures despite stronger reported benchmarks.
5:50ENMatthew Berman· 27 jul 2024A Mixture-of-Agents Demo Using Groq and StreamlitMatthew Berman · Forward FutureMatthew Berman walks through a 2024 Groq-powered multi-agent project, from setup to inspecting its layered responses.
10:02ENMatthew Berman· 24 jul 2024Testing Llama 3.1 405B on Coding, Arithmetic and ReasoningMatthew Berman · Forward FutureMatthew Berman tries Meta's 2024 open-weight model on an informal set of prompts and demonstrates a sponsored dataset workflow.
13:19ENMatthew Berman· 20 jul 2024Testing GPT-4o Mini Against GPT-4o at LaunchMatthew Berman · Forward FutureMatthew Berman compares OpenAI's 2024 small model on coding, reasoning and image prompts, with a sponsored HP and Intel laptop segment.
8:52ENMatthew Berman· 14 jul 2024Yi-Large Tested: Coding, Arithmetic and Logic PuzzlesMatthew Berman · Forward FutureMatthew Berman puts 01.AI's hosted model through a small set of coding and reasoning prompts, with mixed results and some questionable grading.
25:56EN
No Priors: AI, Machine Learning, Tech, & Startups· 11 jul 2024Pódcast · 2 vocesA Prompt Cannot Hold a Good Design: Six AI Practitioners at Midyear 2024Presenta: Sarah Guo, Elad GilSarah Guo and Elad Gil stitch together clips from Stripe, Figma, Figure, OpenAI's Sora team, Cognition, and Scale into a half-year snapshot of what people actually shipping AI were willing to claim.
1:16:22EN
Cognitive Revolution "How AI Changes Everything"· 9 jul 2024PódcastHe Spent 20 Hours Crafting a Prompt. DSPy Beat Him AnywayPresenta: Nathan LabenzSander Schulhoff walks through The Prompt Report — a 78-page survey of what actually works when you prompt large language models.
8:53ENMatthew Berman· 8 jul 2024RouteLLM: Routing Queries Between Strong and Cheaper ModelsMatthew Berman · Forward FutureMatthew Berman explains a 2024 research framework that uses preference data to choose a model for each query.
59:11ENSequoia Capital· 25 jun 2024PódcastDon't Train a Model. Factory's Founders Say Go Dig for GoldMatan Grinberg and Eno Reyes tell Sequoia's Training Data why they sell a fleet of job-specific droids on top of other people's models — and how that stack just took SWE-bench from 14% to 19%.
10:57ENMatthew Berman· 24 jun 2024Testing Claude 3.5 Sonnet: Coding, Reasoning, and VisionMatthew Berman · Forward FutureMatthew Berman puts Anthropic’s June 2024 model through informal coding, math, puzzle, and image-understanding prompts.
12:55ENMatthew Berman· 23 jun 2024Testing Mixture-of-Agents on Coding, Arithmetic and ReasoningMatthew Berman · Forward FutureMatthew Berman tries a multi-model setup on his informal LLM rubric and finds strong individual answers alongside coding and counting failures.
1:37:07ENCognitive Revolution "How AI Changes Everything"· 22 jun 2024PódcastA Text-Only AI Outdiagnosed GPs. Google Still Won't Ship It.Presenta: Nathan LabenzGoogle researchers Vivek Natarajan and Khaled Saab walk Nathan Labenz through five medical-AI papers, from radiology reports to an AI doctor that still has to earn trust.
1:25:10ENCognitive Revolution "How AI Changes Everything"· 15 jun 2024PódcastA Tenth of Google's Index, 99.9% Recall: How 20 People Built Brave SearchPresenta: Nathan LabenzJosep M. Pujol walks Cognitive Revolution through Brave's privacy-first index, hybrid retrieval stack, and the Search API Nathan Labenz now wants his own product team to use.
26:00ENNo Priors: AI, Machine Learning, Tech, & Startups· 11 jun 2024Pódcast · 2 vocesWhy a Zapier founder thinks AGI research has been stalled for four yearsPresenta: Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
58:28ENCognitive Revolution "How AI Changes Everything"· 22 may 2024PódcastFrom Jailbreaking ChatGPT to Anthropic’s First Prompt Engineer: How Alex Albert Ships Claude 3Presenta: Nathan LabenzA year after building jailbreakchat.com, Alex Albert walks Nathan Labenz through Claude 3’s writing, orchestration, character work, and the guardrails app developers still skip.
39:00ENNo Priors: AI, Machine Learning, Tech, & Startups· 22 may 2024Pódcast · 2 vocesJPMorgan Has 150 Petabytes. GPT-4 Trained on Less Than One.Presenta: Sarah Guo, Elad GilScale AI founder Alexandr Wang tells No Priors why easy internet data is exhausted, why expert-plus-model teams still win, and why the path to AGI looks more like curing cancer than inventing a vaccine.
12:50ENMatthew Berman· 22 may 2024Testing Smaug: Hosted 70B Versus a Smaller Local ModelMatthew Berman · Forward FutureMatthew Berman compares two Smaug configurations on Snake, math and reasoning puzzles.
54:25ENCognitive Revolution "How AI Changes Everything"· 9 may 2024PódcastJail Only for Perjury: Scott Wiener Walks Through California's Frontier AI BillPresenta: Nathan LabenzSB 1047 sets the same 10^26 FLOPs threshold as the Biden executive order, and the San Francisco senator wants testing without a licensing regime.
1:05:52ENCognitive Revolution "How AI Changes Everything"· 3 may 2024PódcastInfinite AI Interns Are Already on the JobPresenta: Nathan LabenzNathan Labenz tells computer-science students how to stand out when models are beating doctors on routine work and firms are hiring fewer juniors.
19:09ENMatthew Berman· 28 abr 2024OSWorld: Evaluating Computer-Use Agents in Real ApplicationsMatthew Berman · Forward FutureMatthew Berman explains the 2024 benchmark’s observation–action loop, task-specific checks and early results, with the limitations of its experimental setup.Cargar másMostrando 24 de 269