Recently updated channels

Pick one to see only that channelBrowse all channels →

Results

43 articles
Sort
2 slides0:36EN
Matthew Berman· Oct 25, 2026Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.EvalsCoding agentsOpen-weight models
2 slides0:33EN
Matthew Berman· Oct 8, 2026Mistral Large 4’s Rubik’s Cube Simulation Fails a Functionality TestMatthew Berman · Forward FutureMatthew Berman tests a generated Rubik’s Cube simulation and finds that scrambling and color handling fail in different iterations.EvalsCoding agentsSoftware engineering
Slides0:49EN
Matthew Berman· Sep 9, 2026OpenAI’s Claimed Navier–Stokes Result and an Internal Math ModelMatthew Berman · Forward FutureMatthew Berman discusses OpenAI’s proposed proof and its comparison between an internal model and GPT-6 Astra. The mathematical result and prize status remain subject to review.AI for scienceMathematicsEvals+1
3 slides17:15EN
Matthew Berman· Aug 28, 2026The Hugging Face Incident: AI Evaluation, Sandbox Escape and Reward HackingMatthew Berman · Forward FutureMatthew Berman explains the reported OpenAI evaluation incident and the security and incentive failures it exposed.AI SafetyAI securityCybersecurity+1
9 slides16:11EN
Matthew Berman· Jun 19, 2026Seven AI Coding Agent Loops and When to Use ThemMatthew Berman · Forward FutureMatthew Berman explains how triggers, goals and repeatable checks can turn coding tasks into agent workflows, with examples for performance, documentation and product quality.Coding agentsDeveloper workflows & testingAgent engineering+2
Slides0:47EN
Matthew Berman· Jun 4, 2026Cognition's AI Productivity Guarantee for DevinMatthew Berman · Forward FutureMatthew Berman discusses a 2026 enterprise offer that compares estimated engineering value with the cost of using Devin.Developer productivityCoding agentsPricing+1
Slides2:22EN
Matthew Berman· May 29, 2026Pioneer Agent and Automated Fine-Tuning of Small ModelsMatthew Berman · Forward FutureIn a Fastino-sponsored video, Matthew Berman describes a system that automates parts of model adaptation and discusses its reported benchmark results.Fine-tuningEvalsLocal inference+2
5 slides25:15EN
Matthew Berman· Apr 8, 2026Matthew Berman on Claude Mythos, Project Glasswing and AI SecurityMatthew Berman · Forward FutureBerman examines Anthropic’s limited cybersecurity preview and its reported capabilities, then weighs the promise and risks of increasingly capable AI systems.AI securityInfrastructure & deploymentEvals+2
Slides1:13EN
Matthew Berman· Apr 8, 2026MemPalace Organizes AI Memory With a Palace MetaphorMatthew Berman · Forward FutureMatthew Berman introduces an open-source memory project and its reported retrieval score, while noting that AI memory tools already exist.Agent memorySearch & retrievalEvals
3 slides11:59EN
Matthew Berman· Mar 11, 2026How Claude Identified a Benchmark and Retrieved Its AnswersMatthew Berman · Forward FutureMatthew Berman examines Anthropic's report on BrowseComp contamination, evaluation-aware behavior, and the difficulty of keeping web-based tests reliable.EvalsAgent engineeringAnthropic+2
2 slides0:53EN
Matthew Berman· Feb 6, 2026Claude Opus 4.6: Coding Claims, Agent Evaluation, and a Longer ContextMatthew Berman · Forward FutureMatthew Berman discusses Anthropic’s February 2026 model launch and a chart of AI task horizons.Foundation ModelsCoding agentsEvals+1
3 slides0:37EN
Matthew Berman· Oct 16, 2025Matthew Berman Shows ChatGPT Struggling With a Seahorse EmojiMatthew Berman · Forward FutureA simple question produces repeated corrections and an inconclusive answer in two ChatGPT examples.OpenAIEvals
4 slides1:10EN
Matthew Berman· Aug 8, 2025Testing a GPT-5-Generated Rubik’s Cube SimulatorMatthew Berman · Forward FutureMatthew Berman prompts GPT-5 to build a Three.js cube simulator and tries its scramble and solve controls at several sizes.Software engineeringEvalsGenerative media+1
16 slides25:24EN
Matthew Berman· Aug 7, 2025GPT-5 Tested on Coding, Simulations and Multimodal TasksMatthew Berman · Forward FutureMatthew Berman tries browser applications, visual simulations and image prompts, showing both successes and defects in his early hands-on tests.Coding agentsSoftware engineeringMultimodal AI+2
9 slides15:30EN
Matthew Berman· Jul 31, 2025Qwen3 Tested: Coding Demos, Long Context and Response BehaviorMatthew Berman · Forward FutureMatthew Berman tests generated simulations, political and safety prompts, hand tracking and word puzzles using a hosted Qwen3 model.Open-weight modelsCoding agentsEvals+2
4 slides19:06EN
Matthew Berman· Apr 25, 2025Sleep-Time Compute: Preparing AI Context Before a QuestionMatthew Berman · Forward FutureMatthew Berman reviews a 2025 paper on moving some reasoning ahead of a user query, and explains where its experiments found benefits and limits.Reasoning & test-time computeAgent memoryAI cost & performance+2
10 slides26:35EN
Matthew Berman· Apr 23, 2025Testing Gemini 2.5 Flash on Coding and Video UnderstandingMatthew Berman · Forward FutureMatthew Berman compares Google’s faster model with Gemini 2.5 Pro through interactive simulations, games and questions about a long video.Models & trainingCoding agentsMultimodal AI+2
4 slides9:43EN
Matthew Berman· Feb 20, 2025Testing Grok 3 on Games, Reasoning, and Web SearchMatthew Berman · Forward FutureMatthew Berman tries a new set of audience-suggested prompts, from a Snake–Flappy Bird mashup to a family-logic puzzle and a tesseract visualization.EvalsFoundation ModelsReasoning & test-time compute+1
5 slides19:06EN
Matthew Berman· Dec 28, 2024Building Effective AI Agents: Patterns, Trade-offs and EvaluationMatthew Berman · Forward FutureMatthew Berman discusses Anthropic’s guide to workflows and agents, adding examples from his own projects.Agent engineeringAgentsEvals+1
9 slides24:08EN
Matthew Berman· Dec 12, 2024What Apollo’s 2024 Scheming Tests Found in Language ModelsMatthew Berman · Forward FutureMatthew Berman reviews experiments on deceptive actions, concealment and sandbagging, with the study’s staged goals and sandbox limitations in view.AI SafetyEvalsAI Alignment+1
4 slides12:50EN
Matthew Berman· Nov 2, 2024Comparing Three Local Coding Models on Games and Programming ChallengesMatthew Berman · Forward FutureMatthew Berman runs DeepSeek-Coder-V2 Lite, Yi-Coder 9B, and Qwen2.5-Coder 7B on a sponsored workstation. Their results vary by task and include manual corrections.Open-weight modelsEvalsSoftware engineering+2
5 slides9:38EN
Matthew Berman· Oct 15, 2024Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.Foundation ModelsEvalsBenchmarks+2
6 slides26:43EN
Matthew Berman· Oct 10, 2024Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.EvalsReasoning & test-time computeAI research+2
5 slides10:57EN
Matthew Berman· Sep 13, 2024Testing OpenAI o1-preview: Tetris, Physical Reasoning and a North Pole ErrorMatthew Berman · Forward FutureIn September 2024, Matthew Berman runs the new reasoning-model preview through a personal rubric and examines where its answers succeed or fail.OpenAIReasoning & test-time computeEvals+2
Load moreShowing 24 of 43