필터 결과
269개정렬
10:57EN
Matthew Berman· 2024년 9월 13일Testing OpenAI o1-preview: Tetris, Physical Reasoning and a North Pole ErrorMatthew Berman · Forward FutureIn September 2024, Matthew Berman runs the new reasoning-model preview through a personal rubric and examines where its answers succeed or fail.
1:31:56ENMatthew Berman· 2024년 9월 12일Testing OpenAI o1 on Puzzles, Code and Reasoning: A Launch-Day LivestreamMatthew Berman · Forward FutureMatthew Berman tries o1-preview and o1-mini on word counts, Tetris, physical reasoning and a word puzzle, with viewers checking the results.
19:38ENMatthew Berman· 2024년 9월 9일Reflection 70B: Conflicting Results and Unanswered QuestionsMatthew Berman · Forward FutureMatthew Berman reviews his early coverage, independent evaluations and competing claims about the September 2024 release.
12:03ENMatthew Berman· 2024년 9월 6일Reflection 70B: Self-Correction Claims and the Limits of a 2024 DemoMatthew Berman · Forward FutureMatthew Berman reviews a model trained to generate reflection steps. Its initial benchmark claims later proved difficult for independent evaluators to reproduce.
35:30ENMatthew Berman· 2024년 9월 6일Reflection 70B: Its Creators Explain the Proposed Self-Correction MethodMatthew Berman, Matt Shumer, Sahil Chaudhary · Forward FutureA launch-day discussion with Matt Shumer and Sahil Chaudhary covers synthetic data, selective reflection and evaluation limits.
1:54:17EN
Cognitive Revolution "How AI Changes Everything"· 2024년 8월 28일팟캐스트Metaculus Flagged Covid in January 2020. Now It Is Putting AI on the Forecasting Desk진행자 Nathan LabenzNathan Labenz talks with Metaculus CEO Deger Turan about epistemic security, a year-long bot tournament, and why a useful forecast is harder than an accurate one.
1:12:31EN
Sequoia Capital· 2024년 8월 27일팟캐스트A Bare Model Closes 35% of Airline Changes. Sierra's Agents Clear 70% of Real Tickets.Clay Bavor on why putting a raw LLM in front of customers does not math, and how AgentOS, supervisor agents, and outcome pricing change the arithmetic.
9:43ENMatthew Berman· 2024년 8월 26일Matthew Berman Tests Jamba 1.5 on Coding and Reasoning PromptsMatthew Berman · Forward FutureA 2024 hands-on test of AI21’s hybrid model finds slow output in one hosted session and mixed answers to a small set of prompts.
11:39ENMatthew Berman· 2024년 8월 15일Grok 2 Beta: Matthew Berman Tests Reasoning and FLUX Image GenerationMatthew Berman · Forward FutureA 2024 look at xAI’s Grok 2 and Grok 2 mini covers early benchmark claims, a failed reasoning test and image-generation experiments.
15:24ENMatthew Berman· 2024년 8월 13일Testing the Anonymous sus-column-r Model, Later Identified as Grok-2Matthew Berman · Forward FutureMatthew Berman tests a mysterious 2024 Arena model on coding and reasoning; its verbose answers prompted speculation about OpenAI that the later identification contradicted.
57:55ENMatthew Berman· 2024년 8월 12일A First AI Livestream: Model Rumors, RAG, Agents, and Audience QuestionsMatthew Berman · Forward FutureMatthew Berman tests a livestream in August 2024 and answers viewers’ questions about AI tools, model evaluation, company knowledge, and future agents.
9:51ENMatthew Berman· 2024년 8월 7일Strawberry Rumors and Two Anonymous Chatbot Reasoning TestsMatthew Berman · Forward FutureIn August 2024, Matthew Berman examined speculation about OpenAI’s next model and tested mystery chatbots on simple reasoning puzzles. Later disclosures clarified the identity of one of them.
12:17ENMatthew Berman· 2024년 8월 7일Testing Gemini 1.5 Pro on Code, Reasoning, Images and VideoMatthew Berman · Forward FutureMatthew Berman compares standard and experimental Gemini versions in an informal 2024 review, finding mixed results and repeated output errors.
11:34ENMatthew Berman· 2024년 8월 1일Testing Mistral Large 2: Coding, Reasoning and Safety in 2024Matthew Berman · Forward FutureMatthew Berman tests Mistral’s 123-billion-parameter model with small coding tasks, logic puzzles and ethical hypotheticals. The results are promising but narrowly scoped.
42:08ENSequoia Capital· 2024년 7월 30일팟캐스트Meta Trained a 405B Teacher on 16,000 GPUs — Then Told the World to Distill ItTwo days after Llama 3.1 405B shipped, Meta's generative-AI product lead walks Sequoia through why the most expensive model in the family is free, and why he thinks the frontier itself is heading toward commodity.
13:40ENMatthew Berman· 2024년 7월 29일Testing Llama 3.1 8B: Benchmark Gains and Mixed Practical ResultsMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and other prompts on the small model and finds several failures despite stronger reported benchmarks.
5:50ENMatthew Berman· 2024년 7월 27일A Mixture-of-Agents Demo Using Groq and StreamlitMatthew Berman · Forward FutureMatthew Berman walks through a 2024 Groq-powered multi-agent project, from setup to inspecting its layered responses.
10:02ENMatthew Berman· 2024년 7월 24일Testing Llama 3.1 405B on Coding, Arithmetic and ReasoningMatthew Berman · Forward FutureMatthew Berman tries Meta's 2024 open-weight model on an informal set of prompts and demonstrates a sponsored dataset workflow.
13:19ENMatthew Berman· 2024년 7월 20일Testing GPT-4o Mini Against GPT-4o at LaunchMatthew Berman · Forward FutureMatthew Berman compares OpenAI's 2024 small model on coding, reasoning and image prompts, with a sponsored HP and Intel laptop segment.
8:52ENMatthew Berman· 2024년 7월 14일Yi-Large Tested: Coding, Arithmetic and Logic PuzzlesMatthew Berman · Forward FutureMatthew Berman puts 01.AI's hosted model through a small set of coding and reasoning prompts, with mixed results and some questionable grading.
25:56EN
No Priors: AI, Machine Learning, Tech, & Startups· 2024년 7월 11일팟캐스트 · 2명A Prompt Cannot Hold a Good Design: Six AI Practitioners at Midyear 2024진행자 Sarah Guo, Elad GilSarah Guo and Elad Gil stitch together clips from Stripe, Figma, Figure, OpenAI's Sora team, Cognition, and Scale into a half-year snapshot of what people actually shipping AI were willing to claim.
1:16:22ENCognitive Revolution "How AI Changes Everything"· 2024년 7월 9일팟캐스트He Spent 20 Hours Crafting a Prompt. DSPy Beat Him Anyway진행자 Nathan LabenzSander Schulhoff walks through The Prompt Report — a 78-page survey of what actually works when you prompt large language models.
8:53ENMatthew Berman· 2024년 7월 8일RouteLLM: Routing Queries Between Strong and Cheaper ModelsMatthew Berman · Forward FutureMatthew Berman explains a 2024 research framework that uses preference data to choose a model for each query.
59:11ENSequoia Capital· 2024년 6월 25일팟캐스트Don't Train a Model. Factory's Founders Say Go Dig for GoldMatan Grinberg and Eno Reyes tell Sequoia's Training Data why they sell a fleet of job-specific droids on top of other people's models — and how that stack just took SWE-bench from 14% to 19%.더 보기269개 중 24개 표시