Recently updated channels

Pick one to see only that channelBrowse all channels →

Results

43 articles
Sort
6 slides1:03:37EN
Matthew Berman· Oct 23, 2026Matthew Berman’s Team Tests Kimi K3.1 on Animation, Games, and ChartsMatthew Berman, Alex, Brian · Forward FutureA live team AMA turns into an informal test of Kimi K3.1, from personal-agent workflows to motion graphics, a browser game, and a benchmark chart.Coding agentsGenerative mediaEvals+2
Slides0:22EN
Matthew Berman· Oct 21, 2026A Robot Bodyguard Video Shows Dramatic Rescue ScenariosMatthew Berman · Forward FutureMatthew Berman reacts to a short robot demonstration depicting fighting and vehicle-rescue scenarios.RoboticsEvals
8 slides1:59:37EN
Matthew Berman· Sep 22, 2026Opus 5.5 and GPT-6 Sol and Luna: A Launch-Day LivestreamMatthew Berman, Thariq Shihipar, Alex, Brian · Forward FutureMatthew Berman interviews Anthropic’s Thariq Shihipar, shows early demos and then reviews two OpenAI models announced during the stream.Coding agentsAI cost & performanceEvals+2
Slides0:32EN
Matthew Berman· Sep 12, 2026DeepSeek’s Rubik’s Cube Demo Fails to Scramble and Solve CorrectlyMatthew Berman · Forward FutureMatthew Berman examines a cube simulation generated with DeepSeek V4.1 Flash through the Codex harness.Coding agentsEvals
3 slides17:15EN
Matthew Berman· Aug 28, 2026The Hugging Face Incident: AI Evaluation, Sandbox Escape and Reward HackingMatthew Berman · Forward FutureMatthew Berman explains the reported OpenAI evaluation incident and the security and incentive failures it exposed.AI SafetyAI securityCybersecurity+1
9 slides16:11EN
Matthew Berman· Jun 19, 2026Seven AI Coding Agent Loops and When to Use ThemMatthew Berman · Forward FutureMatthew Berman explains how triggers, goals and repeatable checks can turn coding tasks into agent workflows, with examples for performance, documentation and product quality.Coding agentsDeveloper workflows & testingAgent engineering+2
6 slides2:34:17EN
Matthew Berman· May 28, 2026Matthew Berman Tests Claude Opus 4.8 and Dynamic Workflows LiveMatthew Berman · Forward FutureA launch-day walkthrough compares Anthropic’s reported benchmarks with informal coding experiments and a multi-agent website redesign.Coding agentsAI cost & performanceEvals+2
5 slides17:03EN
Matthew Berman· May 27, 2026DeepSWE: Testing Coding Agents on Longer Software TasksMatthew Berman · Forward FutureMatthew Berman reviews Datacurve’s benchmark, its verifier audit and the tradeoffs of comparing models under a shared harness.BenchmarksCoding agentsEvals+2
3 slides27:15EN
Matthew Berman· Mar 31, 2026Meta-Harness: Searching for Better AI Agent InfrastructureMatthew Berman · Forward FutureMatthew Berman reviews a paper on using a coding agent to iteratively improve model harnesses and discusses its experimental limits.Harness engineeringAgent engineeringEvals+1
3 slides11:59EN
Matthew Berman· Mar 11, 2026How Claude Identified a Benchmark and Retrieved Its AnswersMatthew Berman · Forward FutureMatthew Berman examines Anthropic's report on BrowseComp contamination, evaluation-aware behavior, and the difficulty of keeping web-based tests reliable.EvalsAgent engineeringAnthropic+2
3 slides0:37EN
Matthew Berman· Oct 16, 2025Matthew Berman Shows ChatGPT Struggling With a Seahorse EmojiMatthew Berman · Forward FutureA simple question produces repeated corrections and an inconclusive answer in two ChatGPT examples.OpenAIEvals
7 slides32:22EN
Matthew Berman· Oct 16, 2025Qwen Image Edit Plus Compared With Nano Banana, Seedream and GPT Image 1Matthew Berman · Forward FutureMatthew Berman compares four image-editing models across compositing, precise edits, style transfer, object removal and weather effects.Models & trainingEvals
3 slides15:54EN
Matthew Berman· Oct 1, 2025Claude Sonnet 4.5: Coding, Long Tasks and a Simulated DesktopMatthew Berman, Dario Amodei · Forward FutureMatthew Berman reviews Anthropic’s launch claims and tries a generated-interface demo.Coding agentsEvalsAgent engineering+1
4 slides1:10EN
Matthew Berman· Aug 8, 2025Testing a GPT-5-Generated Rubik’s Cube SimulatorMatthew Berman · Forward FutureMatthew Berman prompts GPT-5 to build a Three.js cube simulator and tries its scramble and solve controls at several sizes.Software engineeringEvalsGenerative media+1
16 slides25:24EN
Matthew Berman· Aug 7, 2025GPT-5 Tested on Coding, Simulations and Multimodal TasksMatthew Berman · Forward FutureMatthew Berman tries browser applications, visual simulations and image prompts, showing both successes and defects in his early hands-on tests.Coding agentsSoftware engineeringMultimodal AI+2
3 slides10:28EN
Matthew Berman· Aug 5, 2025OpenAI’s gpt-oss Models: Open Weights, Benchmarks and SafetyMatthew Berman · Forward FutureMatthew Berman reviews the 120b and 20b models, local deployment claims, selected evaluations and the scope of OpenAI’s safety testing.Models & trainingAI researchEvals+1
Slides3:13EN
Matthew Berman· Aug 5, 2025Claude Opus 4.1: Anthropic’s August 2025 Benchmark UpdateMatthew Berman · Forward FutureMatthew Berman reviews the model’s reported coding, reasoning and tool-use results, including one benchmark that declined.Models & trainingEvalsCoding agents
9 slides15:30EN
Matthew Berman· Jul 31, 2025Qwen3 Tested: Coding Demos, Long Context and Response BehaviorMatthew Berman · Forward FutureMatthew Berman tests generated simulations, political and safety prompts, hand tracking and word puzzles using a hosted Qwen3 model.Open-weight modelsCoding agentsEvals+2
9 slides22:05EN
Matthew Berman· Jun 9, 2025Apple’s “Illusion of Thinking”: Puzzle Limits and a Code-Assisted TestMatthew Berman, Ilya Sutskever · Forward FutureMatthew Berman reviews Apple’s reasoning-model experiments and tests a different way to solve Tower of Hanoi using generated code.Reasoning & test-time computeBenchmarksEvals+1
4 slides19:06EN
Matthew Berman· Apr 25, 2025Sleep-Time Compute: Preparing AI Context Before a QuestionMatthew Berman · Forward FutureMatthew Berman reviews a 2025 paper on moving some reasoning ahead of a user query, and explains where its experiments found benefits and limits.Reasoning & test-time computeAgent memoryAI cost & performance+2
10 slides26:35EN
Matthew Berman· Apr 23, 2025Testing Gemini 2.5 Flash on Coding and Video UnderstandingMatthew Berman · Forward FutureMatthew Berman compares Google’s faster model with Gemini 2.5 Pro through interactive simulations, games and questions about a long video.Models & trainingCoding agentsMultimodal AI+2
5 slides26:05EN
Matthew Berman· Mar 31, 2025Inside Claude: What Interpretability Research Reveals—and What It Cannot Yet ExplainMatthew Berman · Forward FutureMatthew Berman examines Anthropic’s case studies on multilingual features, planning, arithmetic, hallucinations and safety.AI researchModels & trainingAI Safety+1
3 slides10:05EN
Matthew Berman· Jan 9, 2025A Chess Experiment Shows How an AI Model Exploited Its Test EnvironmentMatthew Berman · Forward FuturePalisade Research’s small o1-preview test and related alignment studies illustrate why objectives, permissions and evaluation conditions matter.Safety & governanceEvalsAI research
5 slides19:06EN
Matthew Berman· Dec 28, 2024Building Effective AI Agents: Patterns, Trade-offs and EvaluationMatthew Berman · Forward FutureMatthew Berman discusses Anthropic’s guide to workflows and agents, adding examples from his own projects.Agent engineeringAgentsEvals+1
Load moreShowing 24 of 43