Ergebnisse
269 ArtikelSortieren
15:24EN
Matthew Berman· 13. Aug. 2024Testing the Anonymous sus-column-r Model, Later Identified as Grok-2Matthew Berman · Forward FutureMatthew Berman tests a mysterious 2024 Arena model on coding and reasoning; its verbose answers prompted speculation about OpenAI that the later identification contradicted.
57:55ENMatthew Berman· 12. Aug. 2024A First AI Livestream: Model Rumors, RAG, Agents, and Audience QuestionsMatthew Berman · Forward FutureMatthew Berman tests a livestream in August 2024 and answers viewers’ questions about AI tools, model evaluation, company knowledge, and future agents.
9:51ENMatthew Berman· 7. Aug. 2024Strawberry Rumors and Two Anonymous Chatbot Reasoning TestsMatthew Berman · Forward FutureIn August 2024, Matthew Berman examined speculation about OpenAI’s next model and tested mystery chatbots on simple reasoning puzzles. Later disclosures clarified the identity of one of them.
12:17ENMatthew Berman· 7. Aug. 2024Testing Gemini 1.5 Pro on Code, Reasoning, Images and VideoMatthew Berman · Forward FutureMatthew Berman compares standard and experimental Gemini versions in an informal 2024 review, finding mixed results and repeated output errors.
11:34ENMatthew Berman· 1. Aug. 2024Testing Mistral Large 2: Coding, Reasoning and Safety in 2024Matthew Berman · Forward FutureMatthew Berman tests Mistral’s 123-billion-parameter model with small coding tasks, logic puzzles and ethical hypotheticals. The results are promising but narrowly scoped.
42:08EN
Sequoia Capital· 30. Juli 2024PodcastMeta Trained a 405B Teacher on 16,000 GPUs — Then Told the World to Distill ItTwo days after Llama 3.1 405B shipped, Meta's generative-AI product lead walks Sequoia through why the most expensive model in the family is free, and why he thinks the frontier itself is heading toward commodity.
13:40ENMatthew Berman· 29. Juli 2024Testing Llama 3.1 8B: Benchmark Gains and Mixed Practical ResultsMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and other prompts on the small model and finds several failures despite stronger reported benchmarks.
5:50ENMatthew Berman· 27. Juli 2024A Mixture-of-Agents Demo Using Groq and StreamlitMatthew Berman · Forward FutureMatthew Berman walks through a 2024 Groq-powered multi-agent project, from setup to inspecting its layered responses.
10:02ENMatthew Berman· 24. Juli 2024Testing Llama 3.1 405B on Coding, Arithmetic and ReasoningMatthew Berman · Forward FutureMatthew Berman tries Meta's 2024 open-weight model on an informal set of prompts and demonstrates a sponsored dataset workflow.
13:19ENMatthew Berman· 20. Juli 2024Testing GPT-4o Mini Against GPT-4o at LaunchMatthew Berman · Forward FutureMatthew Berman compares OpenAI's 2024 small model on coding, reasoning and image prompts, with a sponsored HP and Intel laptop segment.
8:52ENMatthew Berman· 14. Juli 2024Yi-Large Tested: Coding, Arithmetic and Logic PuzzlesMatthew Berman · Forward FutureMatthew Berman puts 01.AI's hosted model through a small set of coding and reasoning prompts, with mixed results and some questionable grading.
25:56EN
No Priors: AI, Machine Learning, Tech, & Startups· 11. Juli 2024Podcast · 2 StimmenA Prompt Cannot Hold a Good Design: Six AI Practitioners at Midyear 2024Moderation: Sarah Guo, Elad GilSarah Guo and Elad Gil stitch together clips from Stripe, Figma, Figure, OpenAI's Sora team, Cognition, and Scale into a half-year snapshot of what people actually shipping AI were willing to claim.
1:16:22EN
Cognitive Revolution "How AI Changes Everything"· 9. Juli 2024PodcastHe Spent 20 Hours Crafting a Prompt. DSPy Beat Him AnywayModeration: Nathan LabenzSander Schulhoff walks through The Prompt Report — a 78-page survey of what actually works when you prompt large language models.
8:53ENMatthew Berman· 8. Juli 2024RouteLLM: Routing Queries Between Strong and Cheaper ModelsMatthew Berman · Forward FutureMatthew Berman explains a 2024 research framework that uses preference data to choose a model for each query.
59:11ENSequoia Capital· 25. Juni 2024PodcastDon't Train a Model. Factory's Founders Say Go Dig for GoldMatan Grinberg and Eno Reyes tell Sequoia's Training Data why they sell a fleet of job-specific droids on top of other people's models — and how that stack just took SWE-bench from 14% to 19%.
10:57ENMatthew Berman· 24. Juni 2024Testing Claude 3.5 Sonnet: Coding, Reasoning, and VisionMatthew Berman · Forward FutureMatthew Berman puts Anthropic’s June 2024 model through informal coding, math, puzzle, and image-understanding prompts.
12:55ENMatthew Berman· 23. Juni 2024Testing Mixture-of-Agents on Coding, Arithmetic and ReasoningMatthew Berman · Forward FutureMatthew Berman tries a multi-model setup on his informal LLM rubric and finds strong individual answers alongside coding and counting failures.
1:37:07ENCognitive Revolution "How AI Changes Everything"· 22. Juni 2024PodcastA Text-Only AI Outdiagnosed GPs. Google Still Won't Ship It.Moderation: Nathan LabenzGoogle researchers Vivek Natarajan and Khaled Saab walk Nathan Labenz through five medical-AI papers, from radiology reports to an AI doctor that still has to earn trust.
1:25:10ENCognitive Revolution "How AI Changes Everything"· 15. Juni 2024PodcastA Tenth of Google's Index, 99.9% Recall: How 20 People Built Brave SearchModeration: Nathan LabenzJosep M. Pujol walks Cognitive Revolution through Brave's privacy-first index, hybrid retrieval stack, and the Search API Nathan Labenz now wants his own product team to use.
26:00ENNo Priors: AI, Machine Learning, Tech, & Startups· 11. Juni 2024Podcast · 2 StimmenWhy a Zapier founder thinks AGI research has been stalled for four yearsModeration: Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
58:28ENCognitive Revolution "How AI Changes Everything"· 22. Mai 2024PodcastFrom Jailbreaking ChatGPT to Anthropic’s First Prompt Engineer: How Alex Albert Ships Claude 3Moderation: Nathan LabenzA year after building jailbreakchat.com, Alex Albert walks Nathan Labenz through Claude 3’s writing, orchestration, character work, and the guardrails app developers still skip.
39:00ENNo Priors: AI, Machine Learning, Tech, & Startups· 22. Mai 2024Podcast · 2 StimmenJPMorgan Has 150 Petabytes. GPT-4 Trained on Less Than One.Moderation: Sarah Guo, Elad GilScale AI founder Alexandr Wang tells No Priors why easy internet data is exhausted, why expert-plus-model teams still win, and why the path to AGI looks more like curing cancer than inventing a vaccine.
12:50ENMatthew Berman· 22. Mai 2024Testing Smaug: Hosted 70B Versus a Smaller Local ModelMatthew Berman · Forward FutureMatthew Berman compares two Smaug configurations on Snake, math and reasoning puzzles.
54:25ENCognitive Revolution "How AI Changes Everything"· 9. Mai 2024PodcastJail Only for Perjury: Scott Wiener Walks Through California's Frontier AI BillModeration: Nathan LabenzSB 1047 sets the same 10^26 FLOPs threshold as the Biden executive order, and the San Francisco senator wants testing without a licensing regime.Mehr laden24 von 269 angezeigt