Results
21 articlesSort
17:15EN
Matthew Berman· Aug 28, 2026The Hugging Face Incident: AI Evaluation, Sandbox Escape and Reward HackingMatthew Berman · Forward FutureMatthew Berman explains the reported OpenAI evaluation incident and the security and incentive failures it exposed.
16:11ENMatthew Berman· Jun 19, 2026Seven AI Coding Agent Loops and When to Use ThemMatthew Berman · Forward FutureMatthew Berman explains how triggers, goals and repeatable checks can turn coding tasks into agent workflows, with examples for performance, documentation and product quality.
17:03ENMatthew Berman· May 27, 2026DeepSWE: Testing Coding Agents on Longer Software TasksMatthew Berman · Forward FutureMatthew Berman reviews Datacurve’s benchmark, its verifier audit and the tradeoffs of comparing models under a shared harness.
25:15ENMatthew Berman· Apr 8, 2026Matthew Berman on Claude Mythos, Project Glasswing and AI SecurityMatthew Berman · Forward FutureBerman examines Anthropic’s limited cybersecurity preview and its reported capabilities, then weighs the promise and risks of increasingly capable AI systems.
27:15ENMatthew Berman· Mar 31, 2026Meta-Harness: Searching for Better AI Agent InfrastructureMatthew Berman · Forward FutureMatthew Berman reviews a paper on using a coding agent to iteratively improve model harnesses and discusses its experimental limits.
15:54ENMatthew Berman· Oct 1, 2025Claude Sonnet 4.5: Coding, Long Tasks and a Simulated DesktopMatthew Berman, Dario Amodei · Forward FutureMatthew Berman reviews Anthropic’s launch claims and tries a generated-interface demo.
25:24ENMatthew Berman· Aug 7, 2025GPT-5 Tested on Coding, Simulations and Multimodal TasksMatthew Berman · Forward FutureMatthew Berman tries browser applications, visual simulations and image prompts, showing both successes and defects in his early hands-on tests.
15:30ENMatthew Berman· Jul 31, 2025Qwen3 Tested: Coding Demos, Long Context and Response BehaviorMatthew Berman · Forward FutureMatthew Berman tests generated simulations, political and safety prompts, hand tracking and word puzzles using a hosted Qwen3 model.
22:05ENMatthew Berman· Jun 9, 2025Apple’s “Illusion of Thinking”: Puzzle Limits and a Code-Assisted TestMatthew Berman, Ilya Sutskever · Forward FutureMatthew Berman reviews Apple’s reasoning-model experiments and tests a different way to solve Tower of Hanoi using generated code.
19:06ENMatthew Berman· Apr 25, 2025Sleep-Time Compute: Preparing AI Context Before a QuestionMatthew Berman · Forward FutureMatthew Berman reviews a 2025 paper on moving some reasoning ahead of a user query, and explains where its experiments found benefits and limits.
26:35ENMatthew Berman· Apr 23, 2025Testing Gemini 2.5 Flash on Coding and Video UnderstandingMatthew Berman · Forward FutureMatthew Berman compares Google’s faster model with Gemini 2.5 Pro through interactive simulations, games and questions about a long video.
26:05ENMatthew Berman· Mar 31, 2025Inside Claude: What Interpretability Research Reveals—and What It Cannot Yet ExplainMatthew Berman · Forward FutureMatthew Berman examines Anthropic’s case studies on multilingual features, planning, arithmetic, hallucinations and safety.
19:06ENMatthew Berman· Dec 28, 2024Building Effective AI Agents: Patterns, Trade-offs and EvaluationMatthew Berman · Forward FutureMatthew Berman discusses Anthropic’s guide to workflows and agents, adding examples from his own projects.
24:08ENMatthew Berman· Dec 12, 2024What Apollo’s 2024 Scheming Tests Found in Language ModelsMatthew Berman · Forward FutureMatthew Berman reviews experiments on deceptive actions, concealment and sandbagging, with the study’s staged goals and sandbox limitations in view.
26:43ENMatthew Berman· Oct 10, 2024Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.
19:38ENMatthew Berman· Sep 9, 2024Reflection 70B: Conflicting Results and Unanswered QuestionsMatthew Berman · Forward FutureMatthew Berman reviews his early coverage, independent evaluations and competing claims about the September 2024 release.
16:28ENMatthew Berman· Apr 23, 2024Testing Reka Core: Multimodal Benchmarks, Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman reviews Reka’s reported model comparisons and tests Core on code, logic and image understanding.
15:01ENMatthew Berman· Apr 19, 2024Testing Llama 3 at Launch: Code, Reasoning and Image GenerationMatthew Berman · Forward FutureMatthew Berman tries Meta AI’s new interface on a snake game, logic puzzles and rapid image generation.
21:16ENMatthew Berman· Mar 9, 2024ArtPrompt: What a 2024 Study Found About Visual Text and Model SafetyMatthew Berman · Forward FutureMatthew Berman reviews an ASCII-art recognition benchmark and reports mixed results from his own informal tests.
23:00ENMatthew Berman· Feb 22, 2024Testing Google Gemma 7B at Launch: Setup MattersMatthew Berman · Forward FutureMatthew Berman compares local and hosted tests of Google’s early open-weight model.
18:08ENMatthew Berman· Jun 29, 2023Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.