Results
24 articlesSort
1:03:37EN
Matthew Berman· Oct 23, 2026Matthew Berman’s Team Tests Kimi K3.1 on Animation, Games, and ChartsMatthew Berman, Alex, Brian · Forward FutureA live team AMA turns into an informal test of Kimi K3.1, from personal-agent workflows to motion graphics, a browser game, and a benchmark chart.
0:22ENMatthew Berman· Oct 21, 2026A Robot Bodyguard Video Shows Dramatic Rescue ScenariosMatthew Berman · Forward FutureMatthew Berman reacts to a short robot demonstration depicting fighting and vehicle-rescue scenarios.
1:59:37ENMatthew Berman· Sep 22, 2026Opus 5.5 and GPT-6 Sol and Luna: A Launch-Day LivestreamMatthew Berman, Thariq Shihipar, Alex, Brian · Forward FutureMatthew Berman interviews Anthropic’s Thariq Shihipar, shows early demos and then reviews two OpenAI models announced during the stream.
0:32ENMatthew Berman· Sep 12, 2026DeepSeek’s Rubik’s Cube Demo Fails to Scramble and Solve CorrectlyMatthew Berman · Forward FutureMatthew Berman examines a cube simulation generated with DeepSeek V4.1 Flash through the Codex harness.
2:34:17ENMatthew Berman· May 28, 2026Matthew Berman Tests Claude Opus 4.8 and Dynamic Workflows LiveMatthew Berman · Forward FutureA launch-day walkthrough compares Anthropic’s reported benchmarks with informal coding experiments and a multi-agent website redesign.
17:03ENMatthew Berman· May 27, 2026DeepSWE: Testing Coding Agents on Longer Software TasksMatthew Berman · Forward FutureMatthew Berman reviews Datacurve’s benchmark, its verifier audit and the tradeoffs of comparing models under a shared harness.
27:15ENMatthew Berman· Mar 31, 2026Meta-Harness: Searching for Better AI Agent InfrastructureMatthew Berman · Forward FutureMatthew Berman reviews a paper on using a coding agent to iteratively improve model harnesses and discusses its experimental limits.
1:54:33ENMatthew Berman· Dec 13, 2025Creative Agents, AI Evaluations and Enterprise Trust: Forward Future LiveMatthew Berman, Nick Wentz, Fabian Stelzer, Tejal Patwardhan, Christina Cacioppo, Jeremy Epling, Spenser Skates · Forward FutureLeaders from Glif, OpenAI, Vanta and Amplitude discuss creative workflows, knowledge-work benchmarks and practical AI adoption in December 2025.
32:22ENMatthew Berman· Oct 16, 2025Qwen Image Edit Plus Compared With Nano Banana, Seedream and GPT Image 1Matthew Berman · Forward FutureMatthew Berman compares four image-editing models across compositing, precise edits, style transfer, object removal and weather effects.
15:54ENMatthew Berman· Oct 1, 2025Claude Sonnet 4.5: Coding, Long Tasks and a Simulated DesktopMatthew Berman, Dario Amodei · Forward FutureMatthew Berman reviews Anthropic’s launch claims and tries a generated-interface demo.
10:28ENMatthew Berman· Aug 5, 2025OpenAI’s gpt-oss Models: Open Weights, Benchmarks and SafetyMatthew Berman · Forward FutureMatthew Berman reviews the 120b and 20b models, local deployment claims, selected evaluations and the scope of OpenAI’s safety testing.
3:13ENMatthew Berman· Aug 5, 2025Claude Opus 4.1: Anthropic’s August 2025 Benchmark UpdateMatthew Berman · Forward FutureMatthew Berman reviews the model’s reported coding, reasoning and tool-use results, including one benchmark that declined.
22:05ENMatthew Berman· Jun 9, 2025Apple’s “Illusion of Thinking”: Puzzle Limits and a Code-Assisted TestMatthew Berman, Ilya Sutskever · Forward FutureMatthew Berman reviews Apple’s reasoning-model experiments and tests a different way to solve Tower of Hanoi using generated code.
26:05ENMatthew Berman· Mar 31, 2025Inside Claude: What Interpretability Research Reveals—and What It Cannot Yet ExplainMatthew Berman · Forward FutureMatthew Berman examines Anthropic’s case studies on multilingual features, planning, arithmetic, hallucinations and safety.
10:05ENMatthew Berman· Jan 9, 2025A Chess Experiment Shows How an AI Model Exploited Its Test EnvironmentMatthew Berman · Forward FuturePalisade Research’s small o1-preview test and related alignment studies illustrate why objectives, permissions and evaluation conditions matter.
12:57ENMatthew Berman· Dec 3, 2024AWS Automated Reasoning Checks: A Sponsored Policy Verification DemoMatthew Berman · Forward FutureMatthew Berman demonstrates a Bedrock preview that checks generated answers against formalized policy rules.
1:02:04ENMatthew Berman· Oct 11, 2024João Moura and Matthew Berman on Tesla’s Robotaxi Vision and Building AI AgentsMatthew Berman, João Moura, Elon Musk · Forward FutureA 2024 livestream examines Tesla’s Cybercab and Optimus announcements, then turns to CrewAI, enterprise agent workflows and a small model comparison.
1:31:56ENMatthew Berman· Sep 12, 2024Testing OpenAI o1 on Puzzles, Code and Reasoning: A Launch-Day LivestreamMatthew Berman · Forward FutureMatthew Berman tries o1-preview and o1-mini on word counts, Tetris, physical reasoning and a word puzzle, with viewers checking the results.
35:30ENMatthew Berman· Sep 6, 2024Reflection 70B: Its Creators Explain the Proposed Self-Correction MethodMatthew Berman, Matt Shumer, Sahil Chaudhary · Forward FutureA launch-day discussion with Matt Shumer and Sahil Chaudhary covers synthetic data, selective reflection and evaluation limits.
9:43ENMatthew Berman· Aug 26, 2024Matthew Berman Tests Jamba 1.5 on Coding and Reasoning PromptsMatthew Berman · Forward FutureA 2024 hands-on test of AI21’s hybrid model finds slow output in one hosted session and mixed answers to a small set of prompts.
13:40ENMatthew Berman· Jul 29, 2024Testing Llama 3.1 8B: Benchmark Gains and Mixed Practical ResultsMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and other prompts on the small model and finds several failures despite stronger reported benchmarks.
13:59ENMatthew Berman· Apr 5, 2024SWE-agent Tutorial: Navigating Repositories and Attempting GitHub FixesMatthew Berman, Carlos · Forward FutureMatthew Berman sets up a research coding agent, hits an installation problem and a cost limit, then shows an author’s successful SymPy benchmark example.
21:16ENMatthew Berman· Mar 9, 2024ArtPrompt: What a 2024 Study Found About Visual Text and Model SafetyMatthew Berman · Forward FutureMatthew Berman reviews an ASCII-art recognition benchmark and reports mixed results from his own informal tests.
12:20ENMatthew Berman· Jul 10, 2023Testing UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.