필터 결과
24개정렬
0:36EN
Matthew Berman· 2026년 10월 25일Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.
0:22ENMatthew Berman· 2026년 10월 21일A Robot Bodyguard Video Shows Dramatic Rescue ScenariosMatthew Berman · Forward FutureMatthew Berman reacts to a short robot demonstration depicting fighting and vehicle-rescue scenarios.
0:32ENMatthew Berman· 2026년 9월 12일DeepSeek’s Rubik’s Cube Demo Fails to Scramble and Solve CorrectlyMatthew Berman · Forward FutureMatthew Berman examines a cube simulation generated with DeepSeek V4.1 Flash through the Codex harness.
2:22ENMatthew Berman· 2026년 5월 29일Pioneer Agent and Automated Fine-Tuning of Small ModelsMatthew Berman · Forward FutureIn a Fastino-sponsored video, Matthew Berman describes a system that automates parts of model adaptation and discusses its reported benchmark results.
11:59ENMatthew Berman· 2026년 3월 11일How Claude Identified a Benchmark and Retrieved Its AnswersMatthew Berman · Forward FutureMatthew Berman examines Anthropic's report on BrowseComp contamination, evaluation-aware behavior, and the difficulty of keeping web-based tests reliable.
0:37ENMatthew Berman· 2025년 10월 16일Matthew Berman Shows ChatGPT Struggling With a Seahorse EmojiMatthew Berman · Forward FutureA simple question produces repeated corrections and an inconclusive answer in two ChatGPT examples.
1:10ENMatthew Berman· 2025년 8월 8일Testing a GPT-5-Generated Rubik’s Cube SimulatorMatthew Berman · Forward FutureMatthew Berman prompts GPT-5 to build a Three.js cube simulator and tries its scramble and solve controls at several sizes.
10:28ENMatthew Berman· 2025년 8월 5일OpenAI’s gpt-oss Models: Open Weights, Benchmarks and SafetyMatthew Berman · Forward FutureMatthew Berman reviews the 120b and 20b models, local deployment claims, selected evaluations and the scope of OpenAI’s safety testing.
3:13ENMatthew Berman· 2025년 8월 5일Claude Opus 4.1: Anthropic’s August 2025 Benchmark UpdateMatthew Berman · Forward FutureMatthew Berman reviews the model’s reported coding, reasoning and tool-use results, including one benchmark that declined.
10:05ENMatthew Berman· 2025년 1월 9일A Chess Experiment Shows How an AI Model Exploited Its Test EnvironmentMatthew Berman · Forward FuturePalisade Research’s small o1-preview test and related alignment studies illustrate why objectives, permissions and evaluation conditions matter.
12:57ENMatthew Berman· 2024년 12월 3일AWS Automated Reasoning Checks: A Sponsored Policy Verification DemoMatthew Berman · Forward FutureMatthew Berman demonstrates a Bedrock preview that checks generated answers against formalized policy rules.
12:03ENMatthew Berman· 2024년 9월 6일Reflection 70B: Self-Correction Claims and the Limits of a 2024 DemoMatthew Berman · Forward FutureMatthew Berman reviews a model trained to generate reflection steps. Its initial benchmark claims later proved difficult for independent evaluators to reproduce.
9:43ENMatthew Berman· 2024년 8월 26일Matthew Berman Tests Jamba 1.5 on Coding and Reasoning PromptsMatthew Berman · Forward FutureA 2024 hands-on test of AI21’s hybrid model finds slow output in one hosted session and mixed answers to a small set of prompts.
12:17ENMatthew Berman· 2024년 8월 7일Testing Gemini 1.5 Pro on Code, Reasoning, Images and VideoMatthew Berman · Forward FutureMatthew Berman compares standard and experimental Gemini versions in an informal 2024 review, finding mixed results and repeated output errors.
13:40ENMatthew Berman· 2024년 7월 29일Testing Llama 3.1 8B: Benchmark Gains and Mixed Practical ResultsMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and other prompts on the small model and finds several failures despite stronger reported benchmarks.
8:53ENMatthew Berman· 2024년 7월 8일RouteLLM: Routing Queries Between Strong and Cheaper ModelsMatthew Berman · Forward FutureMatthew Berman explains a 2024 research framework that uses preference data to choose a model for each query.
10:57ENMatthew Berman· 2024년 6월 24일Testing Claude 3.5 Sonnet: Coding, Reasoning, and VisionMatthew Berman · Forward FutureMatthew Berman puts Anthropic’s June 2024 model through informal coding, math, puzzle, and image-understanding prompts.
12:50ENMatthew Berman· 2024년 5월 22일Testing Smaug: Hosted 70B Versus a Smaller Local ModelMatthew Berman · Forward FutureMatthew Berman compares two Smaug configurations on Snake, math and reasoning puzzles.
13:59ENMatthew Berman· 2024년 4월 5일SWE-agent Tutorial: Navigating Repositories and Attempting GitHub FixesMatthew Berman, Carlos · Forward FutureMatthew Berman sets up a research coding agent, hits an installation problem and a cost limit, then shows an author’s successful SymPy benchmark example.
9:02ENMatthew Berman· 2024년 4월 1일Matthew Berman Tries LLM Colosseum, a Street Fighter Model BenchmarkMatthew Berman · Forward FutureA 2024 tutorial shows language models choosing fighting-game moves, explains the game-state prompt and walks through local setup.
14:23ENMatthew Berman· 2024년 3월 31일Testing DBRX: Coding Strengths and Reasoning GapsMatthew Berman · Forward FutureMatthew Berman examines Databricks’ open-weight model and puts it through coding, arithmetic and reasoning prompts.
12:20ENMatthew Berman· 2023년 7월 10일Testing UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.
10:23ENMatthew Berman· 2023년 6월 15일Testing Hosted Falcon 40B and Document Chat in h2oGPTMatthew Berman · Forward FutureMatthew Berman tries H2O.ai’s 2023 hosted Falcon 40B interface on coding, writing and reasoning prompts, then demonstrates document chat.
11:49ENMatthew Berman· 2023년 6월 1일Testing Wizard-Vicuna 30B: Responses, Reasoning, and CodeMatthew Berman · Forward FutureMatthew Berman examines a model marketed as uncensored, demonstrates a 2023 cloud setup, and runs an informal collection of tests.