필터 결과
22개정렬
17:15EN
Matthew Berman· 2026년 8월 28일The Hugging Face Incident: AI Evaluation, Sandbox Escape and Reward HackingMatthew Berman · Forward FutureMatthew Berman explains the reported OpenAI evaluation incident and the security and incentive failures it exposed.
16:11ENMatthew Berman· 2026년 6월 19일Seven AI Coding Agent Loops and When to Use ThemMatthew Berman · Forward FutureMatthew Berman explains how triggers, goals and repeatable checks can turn coding tasks into agent workflows, with examples for performance, documentation and product quality.
17:03ENMatthew Berman· 2026년 5월 27일DeepSWE: Testing Coding Agents on Longer Software TasksMatthew Berman · Forward FutureMatthew Berman reviews Datacurve’s benchmark, its verifier audit and the tradeoffs of comparing models under a shared harness.
25:15ENMatthew Berman· 2026년 4월 8일Matthew Berman on Claude Mythos, Project Glasswing and AI SecurityMatthew Berman · Forward FutureBerman examines Anthropic’s limited cybersecurity preview and its reported capabilities, then weighs the promise and risks of increasingly capable AI systems.
27:15ENMatthew Berman· 2026년 3월 31일Meta-Harness: Searching for Better AI Agent InfrastructureMatthew Berman · Forward FutureMatthew Berman reviews a paper on using a coding agent to iteratively improve model harnesses and discusses its experimental limits.
15:54ENMatthew Berman· 2025년 10월 1일Claude Sonnet 4.5: Coding, Long Tasks and a Simulated DesktopMatthew Berman, Dario Amodei · Forward FutureMatthew Berman reviews Anthropic’s launch claims and tries a generated-interface demo.
25:24ENMatthew Berman· 2025년 8월 7일GPT-5 Tested on Coding, Simulations and Multimodal TasksMatthew Berman · Forward FutureMatthew Berman tries browser applications, visual simulations and image prompts, showing both successes and defects in his early hands-on tests.
15:30ENMatthew Berman· 2025년 7월 31일Qwen3 Tested: Coding Demos, Long Context and Response BehaviorMatthew Berman · Forward FutureMatthew Berman tests generated simulations, political and safety prompts, hand tracking and word puzzles using a hosted Qwen3 model.
22:05ENMatthew Berman· 2025년 6월 9일Apple’s “Illusion of Thinking”: Puzzle Limits and a Code-Assisted TestMatthew Berman, Ilya Sutskever · Forward FutureMatthew Berman reviews Apple’s reasoning-model experiments and tests a different way to solve Tower of Hanoi using generated code.
19:06ENMatthew Berman· 2025년 4월 25일Sleep-Time Compute: Preparing AI Context Before a QuestionMatthew Berman · Forward FutureMatthew Berman reviews a 2025 paper on moving some reasoning ahead of a user query, and explains where its experiments found benefits and limits.
26:35ENMatthew Berman· 2025년 4월 23일Testing Gemini 2.5 Flash on Coding and Video UnderstandingMatthew Berman · Forward FutureMatthew Berman compares Google’s faster model with Gemini 2.5 Pro through interactive simulations, games and questions about a long video.
26:05ENMatthew Berman· 2025년 3월 31일Inside Claude: What Interpretability Research Reveals—and What It Cannot Yet ExplainMatthew Berman · Forward FutureMatthew Berman examines Anthropic’s case studies on multilingual features, planning, arithmetic, hallucinations and safety.
19:06ENMatthew Berman· 2024년 12월 28일Building Effective AI Agents: Patterns, Trade-offs and EvaluationMatthew Berman · Forward FutureMatthew Berman discusses Anthropic’s guide to workflows and agents, adding examples from his own projects.
24:08ENMatthew Berman· 2024년 12월 12일What Apollo’s 2024 Scheming Tests Found in Language ModelsMatthew Berman · Forward FutureMatthew Berman reviews experiments on deceptive actions, concealment and sandbagging, with the study’s staged goals and sandbox limitations in view.
26:43ENMatthew Berman· 2024년 10월 10일Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.
19:38ENMatthew Berman· 2024년 9월 9일Reflection 70B: Conflicting Results and Unanswered QuestionsMatthew Berman · Forward FutureMatthew Berman reviews his early coverage, independent evaluations and competing claims about the September 2024 release.
19:09ENMatthew Berman· 2024년 4월 28일OSWorld: Evaluating Computer-Use Agents in Real ApplicationsMatthew Berman · Forward FutureMatthew Berman explains the 2024 benchmark’s observation–action loop, task-specific checks and early results, with the limitations of its experimental setup.
16:28ENMatthew Berman· 2024년 4월 23일Testing Reka Core: Multimodal Benchmarks, Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman reviews Reka’s reported model comparisons and tests Core on code, logic and image understanding.
15:01ENMatthew Berman· 2024년 4월 19일Testing Llama 3 at Launch: Code, Reasoning and Image GenerationMatthew Berman · Forward FutureMatthew Berman tries Meta AI’s new interface on a snake game, logic puzzles and rapid image generation.
21:16ENMatthew Berman· 2024년 3월 9일ArtPrompt: What a 2024 Study Found About Visual Text and Model SafetyMatthew Berman · Forward FutureMatthew Berman reviews an ASCII-art recognition benchmark and reports mixed results from his own informal tests.
23:00ENMatthew Berman· 2024년 2월 22일Testing Google Gemma 7B at Launch: Setup MattersMatthew Berman · Forward FutureMatthew Berman compares local and hosted tests of Google’s early open-weight model.
18:08ENMatthew Berman· 2023년 6월 29일Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.