최근 업데이트된 채널

선택하면 해당 채널만 표시모든 채널 보기 →

필터 결과

43개
정렬
슬라이드 2장0:36EN
Matthew Berman· 2026년 10월 25일Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.평가(Evals)코딩 에이전트Open-weight models
슬라이드0:22EN
Matthew Berman· 2026년 10월 21일A Robot Bodyguard Video Shows Dramatic Rescue ScenariosMatthew Berman · Forward FutureMatthew Berman reacts to a short robot demonstration depicting fighting and vehicle-rescue scenarios.Robotics평가(Evals)
슬라이드0:32EN
Matthew Berman· 2026년 9월 12일DeepSeek’s Rubik’s Cube Demo Fails to Scramble and Solve CorrectlyMatthew Berman · Forward FutureMatthew Berman examines a cube simulation generated with DeepSeek V4.1 Flash through the Codex harness.코딩 에이전트평가(Evals)
슬라이드 3장17:15EN
Matthew Berman· 2026년 8월 28일The Hugging Face Incident: AI Evaluation, Sandbox Escape and Reward HackingMatthew Berman · Forward FutureMatthew Berman explains the reported OpenAI evaluation incident and the security and incentive failures it exposed.AI SafetyAI securityCybersecurity+1
슬라이드 9장16:11EN
Matthew Berman· 2026년 6월 19일Seven AI Coding Agent Loops and When to Use ThemMatthew Berman · Forward FutureMatthew Berman explains how triggers, goals and repeatable checks can turn coding tasks into agent workflows, with examples for performance, documentation and product quality.코딩 에이전트개발 워크플로와 테스트에이전트 엔지니어링+2
슬라이드2:22EN
Matthew Berman· 2026년 5월 29일Pioneer Agent and Automated Fine-Tuning of Small ModelsMatthew Berman · Forward FutureIn a Fastino-sponsored video, Matthew Berman describes a system that automates parts of model adaptation and discusses its reported benchmark results.파인튜닝평가(Evals)Local inference+2
슬라이드 6장2:34:17EN
Matthew Berman· 2026년 5월 28일Matthew Berman Tests Claude Opus 4.8 and Dynamic Workflows LiveMatthew Berman · Forward FutureA launch-day walkthrough compares Anthropic’s reported benchmarks with informal coding experiments and a multi-agent website redesign.코딩 에이전트AI cost & performance평가(Evals)+2
슬라이드 5장17:03EN
Matthew Berman· 2026년 5월 27일DeepSWE: Testing Coding Agents on Longer Software TasksMatthew Berman · Forward FutureMatthew Berman reviews Datacurve’s benchmark, its verifier audit and the tradeoffs of comparing models under a shared harness.Benchmarks코딩 에이전트평가(Evals)+2
슬라이드 3장27:15EN
Matthew Berman· 2026년 3월 31일Meta-Harness: Searching for Better AI Agent InfrastructureMatthew Berman · Forward FutureMatthew Berman reviews a paper on using a coding agent to iteratively improve model harnesses and discusses its experimental limits.Harness engineering에이전트 엔지니어링평가(Evals)+1
슬라이드 3장11:59EN
Matthew Berman· 2026년 3월 11일How Claude Identified a Benchmark and Retrieved Its AnswersMatthew Berman · Forward FutureMatthew Berman examines Anthropic's report on BrowseComp contamination, evaluation-aware behavior, and the difficulty of keeping web-based tests reliable.평가(Evals)에이전트 엔지니어링Anthropic+2
슬라이드 3장0:37EN
Matthew Berman· 2025년 10월 16일Matthew Berman Shows ChatGPT Struggling With a Seahorse EmojiMatthew Berman · Forward FutureA simple question produces repeated corrections and an inconclusive answer in two ChatGPT examples.OpenAI평가(Evals)
슬라이드 7장32:22EN
Matthew Berman· 2025년 10월 16일Qwen Image Edit Plus Compared With Nano Banana, Seedream and GPT Image 1Matthew Berman · Forward FutureMatthew Berman compares four image-editing models across compositing, precise edits, style transfer, object removal and weather effects.모델과 학습평가(Evals)
슬라이드 4장1:10EN
Matthew Berman· 2025년 8월 8일Testing a GPT-5-Generated Rubik’s Cube SimulatorMatthew Berman · Forward FutureMatthew Berman prompts GPT-5 to build a Three.js cube simulator and tries its scramble and solve controls at several sizes.Software engineering평가(Evals)Generative media+1
슬라이드 16장25:24EN
Matthew Berman· 2025년 8월 7일GPT-5 Tested on Coding, Simulations and Multimodal TasksMatthew Berman · Forward FutureMatthew Berman tries browser applications, visual simulations and image prompts, showing both successes and defects in his early hands-on tests.코딩 에이전트Software engineeringMultimodal AI+2
슬라이드 3장10:28EN
Matthew Berman· 2025년 8월 5일OpenAI’s gpt-oss Models: Open Weights, Benchmarks and SafetyMatthew Berman · Forward FutureMatthew Berman reviews the 120b and 20b models, local deployment claims, selected evaluations and the scope of OpenAI’s safety testing.모델과 학습AI research평가(Evals)+1
슬라이드3:13EN
Matthew Berman· 2025년 8월 5일Claude Opus 4.1: Anthropic’s August 2025 Benchmark UpdateMatthew Berman · Forward FutureMatthew Berman reviews the model’s reported coding, reasoning and tool-use results, including one benchmark that declined.모델과 학습평가(Evals)코딩 에이전트
슬라이드 9장15:30EN
Matthew Berman· 2025년 7월 31일Qwen3 Tested: Coding Demos, Long Context and Response BehaviorMatthew Berman · Forward FutureMatthew Berman tests generated simulations, political and safety prompts, hand tracking and word puzzles using a hosted Qwen3 model.Open-weight models코딩 에이전트평가(Evals)+2
슬라이드 4장19:06EN
Matthew Berman· 2025년 4월 25일Sleep-Time Compute: Preparing AI Context Before a QuestionMatthew Berman · Forward FutureMatthew Berman reviews a 2025 paper on moving some reasoning ahead of a user query, and explains where its experiments found benefits and limits.Reasoning & test-time computeAgent memoryAI cost & performance+2
슬라이드 10장26:35EN
Matthew Berman· 2025년 4월 23일Testing Gemini 2.5 Flash on Coding and Video UnderstandingMatthew Berman · Forward FutureMatthew Berman compares Google’s faster model with Gemini 2.5 Pro through interactive simulations, games and questions about a long video.모델과 학습코딩 에이전트Multimodal AI+2
슬라이드 5장26:05EN
Matthew Berman· 2025년 3월 31일Inside Claude: What Interpretability Research Reveals—and What It Cannot Yet ExplainMatthew Berman · Forward FutureMatthew Berman examines Anthropic’s case studies on multilingual features, planning, arithmetic, hallucinations and safety.AI research모델과 학습AI Safety+1
슬라이드 3장10:05EN
Matthew Berman· 2025년 1월 9일A Chess Experiment Shows How an AI Model Exploited Its Test EnvironmentMatthew Berman · Forward FuturePalisade Research’s small o1-preview test and related alignment studies illustrate why objectives, permissions and evaluation conditions matter.안전과 거버넌스평가(Evals)AI research
슬라이드 5장19:06EN
Matthew Berman· 2024년 12월 28일Building Effective AI Agents: Patterns, Trade-offs and EvaluationMatthew Berman · Forward FutureMatthew Berman discusses Anthropic’s guide to workflows and agents, adding examples from his own projects.에이전트 엔지니어링에이전트평가(Evals)+1
슬라이드 9장24:08EN
Matthew Berman· 2024년 12월 12일What Apollo’s 2024 Scheming Tests Found in Language ModelsMatthew Berman · Forward FutureMatthew Berman reviews experiments on deceptive actions, concealment and sandbagging, with the study’s staged goals and sandbox limitations in view.AI Safety평가(Evals)AI Alignment+1
슬라이드 3장12:57EN
Matthew Berman· 2024년 12월 3일AWS Automated Reasoning Checks: A Sponsored Policy Verification DemoMatthew Berman · Forward FutureMatthew Berman demonstrates a Bedrock preview that checks generated answers against formalized policy rules.AI Safety엔터프라이즈 AI평가(Evals)+1
더 보기43개 중 24개 표시