Results
48 articlesSort
25:50ENKimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.
12:14ENGemini 4 Argon Tested: 3D Demos, a Spreadsheet Prototype and Benchmark ResultsMatthew Berman · Forward FutureMatthew Berman tests Google’s model on games and visual projects, then compares reported coding and agent benchmarks.
10:36ENMeta Muse Wonder Tested: Strong Benchmarks, Mixed Demos and Quota FrictionMatthew Berman · Forward FutureMatthew Berman tests Meta’s models on browser demos and reviews their published benchmark scores, availability and cost.
21:29ENMistral Large 4 Preview: European Open Weights, Cyber Benchmarks and Setup FrictionMatthew Berman · Forward FutureMatthew Berman reviews the model’s reported specifications and benchmarks, then tests it in an agent coding workflow.
16:59ENClaude Sonnet 5.5 Tested: Games, 3D Scenes and a Lower-Cost Opus AlternativeMatthew Berman · Forward FutureMatthew Berman demonstrates generated projects and compares Sonnet’s reported benchmark scores and API prices with Opus.
31:59ENClaude Opus 5.5: Benchmarks, Cost and Anthropic’s Approach to PacingMatthew Berman, Thariq · Forward FutureMatthew Berman reviews the release and speaks with Anthropic’s Thariq about daily workflows, evaluation and agent harnesses.
16:57ENGrok 4.7 Compared: Coding, Knowledge Work and Cost per TaskMatthew Berman · Forward FutureMatthew Berman examines reported benchmarks and prices while noting missing competitors and limited hands-on testing.
1:05:23ENMatthew Berman Tests GPT-6 Astra: Benchmarks, Browser Agents and GamesMatthew Berman · Forward FutureAn early-access tour compares model benchmarks and pricing with practical browser workflows, presentations and a wide range of generated games.
16:50ENGemini 3.8 Flash: Benchmarks, Cost and Hands-On Coding TestsMatthew Berman · Forward FutureMatthew Berman compares Google's September 2026 model announcement with several practical visual and web-building examples.
13:09ENAI News: Ultrafast Inference, Claude Watermarks and New ModelsMatthew Berman · Forward FutureMatthew Berman reviews an ultrafast coding preview, text watermarking, Grok Bot, open-weight models and Computer History.
15:37ENMatthew Berman on Qwen3.8-Max, AI Costs and Open-Weight CompetitionMatthew Berman · Forward FutureA 2026 review of reported benchmark results and research demonstrations leads to questions about deployment economics and geopolitical dependence.
52:29ENClaude Opus 5: Benchmarks, Cost per Task, and Early ImpressionsMatthew Berman · Forward FutureMatthew Berman reacts to the model launch, examines reported benchmark and pricing data, and explains why the cost of completing a task matters more than token price alone.
17:03ENDeepSWE: Testing Coding Agents on Longer Software TasksMatthew Berman · Forward FutureMatthew Berman reviews Datacurve’s benchmark, its verifier audit and the tradeoffs of comparing models under a shared harness.
31:22ENCursor Composer 2.5 and the Economics of Coding ModelsMatthew Berman, Sundar Pichai · Forward FutureMatthew Berman examines coding benchmarks, model costs and enterprise budgets, then considers Cursor’s partnership with SpaceX and Anthropic’s demand for compute.
9:47ENGemma 4: Smaller Open-Weight Models for Local AIMatthew Berman · Forward FutureMatthew Berman reviews Google’s model sizes, multimodal features and reported benchmarks, with an eye toward local agents.
0:37ENGemini 3.1 Pro: A Look at the Reported Benchmark ScoresMatthew Berman · Forward FutureMatthew Berman reacts to a Gemini 3.1 Pro comparison and highlights results on Humanity’s Last Exam.
11:49ENMatthew Berman Reviews Claude Sonnet 4.6: Benchmarks, Computer Use and SafetyMatthew Berman · Forward FutureA launch-day overview examines Anthropic’s reported knowledge-work and agent results, along with prompt-injection and capability evaluations.
1:11ENGemini 3's Launch: Benchmarks, Antigravity, and AgentsMatthew Berman · Forward FutureMatthew Berman summarizes Google's November 2025 model launch and its developer and assistant demos.
8:47ENWhy Identical LLM Prompts Can Produce Different Answers at Temperature ZeroMatthew Berman · Forward FutureMatthew Berman explains Thinking Machines Lab’s work on batch-invariant inference and what its reproducibility experiment actually showed.
1:43:51ENGPT-5, Cline and SWE-bench: How to Judge AI Coding AgentsMatthew Berman, Matt Wolfe, Ray Fernando, Saoud Razwan, Nick, Ofir, Carlos, John, Kilian · Forward FutureMatthew Berman and guests discuss early GPT-5 impressions, the economics of Cline, and why coding benchmark results depend on the evaluation setup.
1:01ENOpenAI’s gpt-oss Release and a Coding BenchmarkMatthew Berman · Forward FutureMatthew Berman introduces two open-weight models and reviews a Codeforces comparison from the launch.
22:05ENApple’s “Illusion of Thinking”: Puzzle Limits and a Code-Assisted TestMatthew Berman, Ilya Sutskever · Forward FutureMatthew Berman reviews Apple’s reasoning-model experiments and tests a different way to solve Tower of Hanoi using generated code.
15:13ENAbsolute Zero: Training a Reasoner on Self-Generated Coding TasksMatthew Berman · Forward FutureMatthew Berman examines a 2025 paper in which a pretrained language model proposes and solves code tasks using verifiable feedback.
15:15ENEarly Reactions to OpenAI o3 and o4-mini: Tool Use, Math and MistakesMatthew Berman · Forward FutureMatthew Berman reviews 2025 demos and benchmark reports, from location guessing and coding to simple failures that challenge the hype.
Load moreShowing 24 of 48









