絞り込み結果
39 件並び順
0:22EN
Matthew Berman· 2026年10月21日A Robot Bodyguard Video Shows Dramatic Rescue ScenariosMatthew Berman · Forward FutureMatthew Berman reacts to a short robot demonstration depicting fighting and vehicle-rescue scenarios.
0:32ENMatthew Berman· 2026年9月12日DeepSeek’s Rubik’s Cube Demo Fails to Scramble and Solve CorrectlyMatthew Berman · Forward FutureMatthew Berman examines a cube simulation generated with DeepSeek V4.1 Flash through the Codex harness.
17:15ENMatthew Berman· 2026年8月28日The Hugging Face Incident: AI Evaluation, Sandbox Escape and Reward HackingMatthew Berman · Forward FutureMatthew Berman explains the reported OpenAI evaluation incident and the security and incentive failures it exposed.
16:11ENMatthew Berman· 2026年6月19日Seven AI Coding Agent Loops and When to Use ThemMatthew Berman · Forward FutureMatthew Berman explains how triggers, goals and repeatable checks can turn coding tasks into agent workflows, with examples for performance, documentation and product quality.
2:34:17ENMatthew Berman· 2026年5月28日Matthew Berman Tests Claude Opus 4.8 and Dynamic Workflows LiveMatthew Berman · Forward FutureA launch-day walkthrough compares Anthropic’s reported benchmarks with informal coding experiments and a multi-agent website redesign.
17:03ENMatthew Berman· 2026年5月27日DeepSWE: Testing Coding Agents on Longer Software TasksMatthew Berman · Forward FutureMatthew Berman reviews Datacurve’s benchmark, its verifier audit and the tradeoffs of comparing models under a shared harness.
27:15ENMatthew Berman· 2026年3月31日Meta-Harness: Searching for Better AI Agent InfrastructureMatthew Berman · Forward FutureMatthew Berman reviews a paper on using a coding agent to iteratively improve model harnesses and discusses its experimental limits.
11:59ENMatthew Berman· 2026年3月11日How Claude Identified a Benchmark and Retrieved Its AnswersMatthew Berman · Forward FutureMatthew Berman examines Anthropic's report on BrowseComp contamination, evaluation-aware behavior, and the difficulty of keeping web-based tests reliable.
0:37ENMatthew Berman· 2025年10月16日Matthew Berman Shows ChatGPT Struggling With a Seahorse EmojiMatthew Berman · Forward FutureA simple question produces repeated corrections and an inconclusive answer in two ChatGPT examples.
32:22ENMatthew Berman· 2025年10月16日Qwen Image Edit Plus Compared With Nano Banana, Seedream and GPT Image 1Matthew Berman · Forward FutureMatthew Berman compares four image-editing models across compositing, precise edits, style transfer, object removal and weather effects.
1:10ENMatthew Berman· 2025年8月8日Testing a GPT-5-Generated Rubik’s Cube SimulatorMatthew Berman · Forward FutureMatthew Berman prompts GPT-5 to build a Three.js cube simulator and tries its scramble and solve controls at several sizes.
25:24ENMatthew Berman· 2025年8月7日GPT-5 Tested on Coding, Simulations and Multimodal TasksMatthew Berman · Forward FutureMatthew Berman tries browser applications, visual simulations and image prompts, showing both successes and defects in his early hands-on tests.
10:28ENMatthew Berman· 2025年8月5日OpenAI’s gpt-oss Models: Open Weights, Benchmarks and SafetyMatthew Berman · Forward FutureMatthew Berman reviews the 120b and 20b models, local deployment claims, selected evaluations and the scope of OpenAI’s safety testing.
3:13ENMatthew Berman· 2025年8月5日Claude Opus 4.1: Anthropic’s August 2025 Benchmark UpdateMatthew Berman · Forward FutureMatthew Berman reviews the model’s reported coding, reasoning and tool-use results, including one benchmark that declined.
15:30ENMatthew Berman· 2025年7月31日Qwen3 Tested: Coding Demos, Long Context and Response BehaviorMatthew Berman · Forward FutureMatthew Berman tests generated simulations, political and safety prompts, hand tracking and word puzzles using a hosted Qwen3 model.
19:06ENMatthew Berman· 2025年4月25日Sleep-Time Compute: Preparing AI Context Before a QuestionMatthew Berman · Forward FutureMatthew Berman reviews a 2025 paper on moving some reasoning ahead of a user query, and explains where its experiments found benefits and limits.
26:35ENMatthew Berman· 2025年4月23日Testing Gemini 2.5 Flash on Coding and Video UnderstandingMatthew Berman · Forward FutureMatthew Berman compares Google’s faster model with Gemini 2.5 Pro through interactive simulations, games and questions about a long video.
26:05ENMatthew Berman· 2025年3月31日Inside Claude: What Interpretability Research Reveals—and What It Cannot Yet ExplainMatthew Berman · Forward FutureMatthew Berman examines Anthropic’s case studies on multilingual features, planning, arithmetic, hallucinations and safety.
10:05ENMatthew Berman· 2025年1月9日A Chess Experiment Shows How an AI Model Exploited Its Test EnvironmentMatthew Berman · Forward FuturePalisade Research’s small o1-preview test and related alignment studies illustrate why objectives, permissions and evaluation conditions matter.
19:06ENMatthew Berman· 2024年12月28日Building Effective AI Agents: Patterns, Trade-offs and EvaluationMatthew Berman · Forward FutureMatthew Berman discusses Anthropic’s guide to workflows and agents, adding examples from his own projects.
24:08ENMatthew Berman· 2024年12月12日What Apollo’s 2024 Scheming Tests Found in Language ModelsMatthew Berman · Forward FutureMatthew Berman reviews experiments on deceptive actions, concealment and sandbagging, with the study’s staged goals and sandbox limitations in view.
12:57ENMatthew Berman· 2024年12月3日AWS Automated Reasoning Checks: A Sponsored Policy Verification DemoMatthew Berman · Forward FutureMatthew Berman demonstrates a Bedrock preview that checks generated answers against formalized policy rules.
26:43ENMatthew Berman· 2024年10月10日Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.
19:38ENMatthew Berman· 2024年9月9日Reflection 70B: Conflicting Results and Unanswered QuestionsMatthew Berman · Forward FutureMatthew Berman reviews his early coverage, independent evaluations and competing claims about the September 2024 release.もっと見る39 件中 24 件を表示