Recently updated channels

Pick one to see only that channelBrowse all channels →
Matthew Bermanyesterday +250Theo - t3․ggyesterday +19AI Engineeryesterday +6The Buildersyesterday +1a16zyesterday +2硅谷101yesterday +1SemiAnalysisyesterday +1Chris WilliamsonyesterdayCheeky PintyesterdayInvest Like The Bestyesterday

Results

121 articles
Sort
TopicBenchmarksPersonMatthew Berman
7 slides15:46EN
Matthew Berman· Apr 16, 2025OpenAI o3 and o4-mini: Tool Use, Benchmarks and the First Codex CLIMatthew Berman · Forward FutureMatthew Berman reviews OpenAI’s April 2025 reasoning-model release, a scientific image-analysis demonstration and the debut of its terminal coding agent.OpenAIReasoning & test-time computeBenchmarks+2
4 slides21:16EN
Matthew Berman· Apr 14, 2025GPT-4.1, Mini and Nano: Coding, Long Context and 2025 API PricingMatthew Berman · Forward FutureMatthew Berman reviews OpenAI’s April 2025 model launch, selected coding benchmarks and demonstrations, and a sponsored Box evaluation.OpenAICoding agentsContext engineering+2
3 slides7:33EN
Matthew Berman· Apr 4, 2025Ace Computer-Use Agent: Fast Desktop and Browser DemonstrationsMatthew Berman · Forward FutureMatthew Berman reviews General Agents’ examples and reported click accuracy and latency, while noting he has not yet tested Ace himself.Computer useAgentsBenchmarks
6 slides11:31EN
Matthew Berman· Mar 29, 2025AI News in March 2025: GPT-4o, Gemini, DeepSeek and MCPMatthew Berman · Forward FutureMatthew Berman reviews model updates, the ARC-AGI-2 benchmark, image generators and early adoption of Model Context Protocol.Foundation ModelsBenchmarksMCP+2
6 slides18:31EN
Matthew Berman· Mar 26, 2025Gemini 2.5 Pro Experimental: Coding Demos and Launch BenchmarksMatthew Berman · Forward FutureIn March 2025, Matthew Berman tests Google’s experimental model on interactive simulations and reviews its launch benchmarks, including their limits.GeminiCoding agentsBenchmarks+2
5 slides19:32EN
Matthew Berman· Feb 28, 2025GPT-4.5’s Launch: Conversational Style, Benchmarks and CostMatthew Berman · Forward FutureMatthew Berman examines OpenAI’s February 2025 research preview, its selected demonstrations, reported evaluations and high launch pricing.Models & trainingBenchmarksAI cost & performance+1
4 slides9:35EN
Matthew Berman· Feb 25, 2025Claude 3.7 Sonnet and Claude Code: An Early Coding TestMatthew Berman · Forward FutureMatthew Berman reviews Anthropic’s 2025 launch benchmarks and builds an AI-controlled Snake game, then tests math and recent information.Coding agentsBenchmarksAnthropic+1
4 slides13:24EN
Matthew Berman· Feb 18, 2025Grok 3’s 2025 Launch: Benchmarks, Reasoning and DeepSearchMatthew Berman, Elon Musk · Forward FutureMatthew Berman reviews xAI’s launch charts, a historical user-preference leaderboard and an early product demonstration.Foundation ModelsBenchmarksReasoning & test-time compute+1
6 slides18:05EN
Matthew Berman· Feb 16, 2025OpenAI’s Coding-Competition Study: o1-ioi, o3 and the Limits of the ResultsMatthew Berman, Sam Altman · Forward FutureMatthew Berman interprets OpenAI’s 2025 paper on reinforcement learning and programming contests. The results are strong on the studied benchmarks, but do not establish AGI or remove humans from model development.Reasoning & test-time computeReinforcement LearningBenchmarks+2
3 slides6:50EN
Matthew Berman· Feb 12, 2025DeepScaleR: A Small Reasoning Model Tested on Competition MathMatthew Berman · Forward FutureMatthew Berman reviews a 1.5B model’s reported benchmark results and runs a quantized version locally on one AIME problem.Reinforcement LearningBenchmarksLocal inference+2
Slides13:04EN
Matthew Berman· Feb 4, 2025Deep Research, AI Takeoff and the Limits of Early ReactionsMatthew Berman, Sam Altman · Forward FutureMatthew Berman surveys February 2025 reactions to OpenAI’s research agent and argues that reasoning and tools could accelerate AI progress.AI agentsAGI TimelinesBenchmarks+2
4 slides9:58EN
Matthew Berman· Jan 31, 2025OpenAI o3-mini Launch: Reasoning Effort, Benchmarks and a Snake TestMatthew Berman · Forward FutureIn January 2025, Matthew Berman reviews OpenAI’s reported results and tries two coding examples with different reasoning settings.OpenAIReasoning & test-time computeBenchmarks+1
5 slides37:58EN
Matthew Berman· Jan 23, 2025OpenAI Operator’s 2025 Launch: Browser Tasks, Human Control and LimitsMatthew Berman, Sam Altman · Forward FutureMatthew Berman watches the early Operator demonstration, from restaurant bookings and groceries to safety controls and benchmark results.Computer useAgentsAI Safety+1
5 slides8:52EN
Matthew Berman· Jan 21, 2025Industry Reactions to DeepSeek R1’s 2025 ReleaseMatthew Berman · Forward FutureMatthew Berman reviews early reactions to DeepSeek R1, from open-weight reasoning models and local hardware to benchmark results and API pricing.Open-weight modelsReasoning & test-time computeBenchmarks+2
6 slides21:02EN
Matthew Berman· Dec 24, 2024Reactions to OpenAI’s 2024 o3 Preview: Benchmarks, Cost and LimitsMatthew Berman · Forward FutureMatthew Berman surveys the responses to the o3 preview, from mathematical benchmarks to debates about AGI, compute and reliability.BenchmarksReasoning & test-time computeAGI+2
6 slides26:23EN
Matthew Berman· Dec 20, 2024OpenAI’s o3 Announcement: Benchmark Gains and the Question of AGIMatthew Berman, Sam Altman, Mark Chen, Greg Kamradt, Hongyu Ren · Forward FutureMatthew Berman reviews the December 2024 o3 and o3-mini announcement, including coding, math and ARC-AGI results. He calls the results evidence of AGI, a conclusion the benchmarks alone cannot establish.OpenAIBenchmarksReasoning & test-time compute+2
3 slides9:00EN
Matthew Berman· Dec 20, 2024Best-of-N Jailbreaking: What Repeated Prompt Variations Revealed in 2024Matthew Berman · Forward FutureMatthew Berman reviews research on how repeated input variations can expose safety failures in text, vision and audio models.Agent red teamingAI SafetyMultimodal AI+2
7 slides14:50EN
Matthew Berman· Nov 19, 2024AI News in November 2024: Mistral, Gemini, Nuclear Safety and Medical AIMatthew Berman · Forward FutureMatthew Berman surveys Le Chat updates, model rankings, nuclear safeguards and a diagnostic reasoning study.AI StrategyBenchmarksAI Safety+2
3 slides11:56EN
Matthew Berman· Nov 3, 2024IBM Granite 3.0 and InstructLab: Small Models for Enterprise AIMatthew Berman · Forward FutureMatthew Berman reviews IBM's 2024 model family and its approach to adding domain knowledge. IBM partnered on the video and invited him to its event.Models & trainingEnterprise AIFine-tuning+2
6 slides10:39EN
Matthew Berman· Oct 29, 2024Zamba2-7B: A Hybrid Mamba–Transformer Model Tested on Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman compares Zyphra’s efficiency claims with his own informal tests, including Python games, spatial puzzles and simple word tasks.Models & trainingOpen-weight modelsBenchmarks+2
5 slides9:38EN
Matthew Berman· Oct 15, 2024Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.Foundation ModelsEvalsBenchmarks+2
6 slides26:43EN
Matthew Berman· Oct 10, 2024Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.EvalsReasoning & test-time computeAI research+2
4 slides11:14EN
Matthew Berman· Sep 18, 2024Pixtral 12B: Testing a 2024 Vision-Language ModelMatthew Berman · Forward FutureMatthew Berman runs informal image, text and interface-generation tests of Mistral’s Pixtral on a sponsor-provided cloud GPU.Multimodal AIVision & videoOpen-weight models+1
6 slides18:09EN
Matthew Berman· Sep 17, 2024AI News in September 2024: Copilot, NotebookLM, o1 and World ModelsMatthew Berman · Forward FutureMatthew Berman reviews a week of AI announcements, from workplace assistants and audio overviews to benchmark results, generative video and spatial AI.AI researchAI agentsGenerative media+2
Load moreShowing 24 of 121