Kürzlich aktualisierte Kanäle

Wählen, um nur diesen Kanal zu sehenAlle Kanäle →

Ergebnisse

42 Artikel
Sortieren
Folien0:22EN
Matthew Berman· 21. Okt. 2026A Robot Bodyguard Video Shows Dramatic Rescue ScenariosMatthew Berman · Forward FutureMatthew Berman reacts to a short robot demonstration depicting fighting and vehicle-rescue scenarios.RoboticsEvals
Folien0:32EN
Matthew Berman· 12. Sept. 2026DeepSeek’s Rubik’s Cube Demo Fails to Scramble and Solve CorrectlyMatthew Berman · Forward FutureMatthew Berman examines a cube simulation generated with DeepSeek V4.1 Flash through the Codex harness.Coding-AgentenEvals
3 Folien17:15EN
Matthew Berman· 28. Aug. 2026The Hugging Face Incident: AI Evaluation, Sandbox Escape and Reward HackingMatthew Berman · Forward FutureMatthew Berman explains the reported OpenAI evaluation incident and the security and incentive failures it exposed.AI SafetyAI securityCybersecurity+1
9 Folien16:11EN
Matthew Berman· 19. Juni 2026Seven AI Coding Agent Loops and When to Use ThemMatthew Berman · Forward FutureMatthew Berman explains how triggers, goals and repeatable checks can turn coding tasks into agent workflows, with examples for performance, documentation and product quality.Coding-AgentenEntwicklungs-Workflows & TestsAgent Engineering+2
Folien2:22EN
Matthew Berman· 29. Mai 2026Pioneer Agent and Automated Fine-Tuning of Small ModelsMatthew Berman · Forward FutureIn a Fastino-sponsored video, Matthew Berman describes a system that automates parts of model adaptation and discusses its reported benchmark results.Fine-TuningEvalsLocal inference+2
6 Folien2:34:17EN
Matthew Berman· 28. Mai 2026Matthew Berman Tests Claude Opus 4.8 and Dynamic Workflows LiveMatthew Berman · Forward FutureA launch-day walkthrough compares Anthropic’s reported benchmarks with informal coding experiments and a multi-agent website redesign.Coding-AgentenAI cost & performanceEvals+2
5 Folien17:03EN
Matthew Berman· 27. Mai 2026DeepSWE: Testing Coding Agents on Longer Software TasksMatthew Berman · Forward FutureMatthew Berman reviews Datacurve’s benchmark, its verifier audit and the tradeoffs of comparing models under a shared harness.BenchmarksCoding-AgentenEvals+2
3 Folien27:15EN
Matthew Berman· 31. März 2026Meta-Harness: Searching for Better AI Agent InfrastructureMatthew Berman · Forward FutureMatthew Berman reviews a paper on using a coding agent to iteratively improve model harnesses and discusses its experimental limits.Harness engineeringAgent EngineeringEvals+1
3 Folien11:59EN
Matthew Berman· 11. März 2026How Claude Identified a Benchmark and Retrieved Its AnswersMatthew Berman · Forward FutureMatthew Berman examines Anthropic's report on BrowseComp contamination, evaluation-aware behavior, and the difficulty of keeping web-based tests reliable.EvalsAgent EngineeringAnthropic+2
3 Folien0:37EN
Matthew Berman· 16. Okt. 2025Matthew Berman Shows ChatGPT Struggling With a Seahorse EmojiMatthew Berman · Forward FutureA simple question produces repeated corrections and an inconclusive answer in two ChatGPT examples.OpenAIEvals
7 Folien32:22EN
Matthew Berman· 16. Okt. 2025Qwen Image Edit Plus Compared With Nano Banana, Seedream and GPT Image 1Matthew Berman · Forward FutureMatthew Berman compares four image-editing models across compositing, precise edits, style transfer, object removal and weather effects.Modelle & TrainingEvals
4 Folien1:10EN
Matthew Berman· 8. Aug. 2025Testing a GPT-5-Generated Rubik’s Cube SimulatorMatthew Berman · Forward FutureMatthew Berman prompts GPT-5 to build a Three.js cube simulator and tries its scramble and solve controls at several sizes.Software engineeringEvalsGenerative media+1
16 Folien25:24EN
Matthew Berman· 7. Aug. 2025GPT-5 Tested on Coding, Simulations and Multimodal TasksMatthew Berman · Forward FutureMatthew Berman tries browser applications, visual simulations and image prompts, showing both successes and defects in his early hands-on tests.Coding-AgentenSoftware engineeringMultimodal AI+2
3 Folien10:28EN
Matthew Berman· 5. Aug. 2025OpenAI’s gpt-oss Models: Open Weights, Benchmarks and SafetyMatthew Berman · Forward FutureMatthew Berman reviews the 120b and 20b models, local deployment claims, selected evaluations and the scope of OpenAI’s safety testing.Modelle & TrainingAI researchEvals+1
Folien3:13EN
Matthew Berman· 5. Aug. 2025Claude Opus 4.1: Anthropic’s August 2025 Benchmark UpdateMatthew Berman · Forward FutureMatthew Berman reviews the model’s reported coding, reasoning and tool-use results, including one benchmark that declined.Modelle & TrainingEvalsCoding-Agenten
9 Folien15:30EN
Matthew Berman· 31. Juli 2025Qwen3 Tested: Coding Demos, Long Context and Response BehaviorMatthew Berman · Forward FutureMatthew Berman tests generated simulations, political and safety prompts, hand tracking and word puzzles using a hosted Qwen3 model.Open-weight modelsCoding-AgentenEvals+2
4 Folien19:06EN
Matthew Berman· 25. Apr. 2025Sleep-Time Compute: Preparing AI Context Before a QuestionMatthew Berman · Forward FutureMatthew Berman reviews a 2025 paper on moving some reasoning ahead of a user query, and explains where its experiments found benefits and limits.Reasoning & test-time computeAgent memoryAI cost & performance+2
10 Folien26:35EN
Matthew Berman· 23. Apr. 2025Testing Gemini 2.5 Flash on Coding and Video UnderstandingMatthew Berman · Forward FutureMatthew Berman compares Google’s faster model with Gemini 2.5 Pro through interactive simulations, games and questions about a long video.Modelle & TrainingCoding-AgentenMultimodal AI+2
5 Folien26:05EN
Matthew Berman· 31. März 2025Inside Claude: What Interpretability Research Reveals—and What It Cannot Yet ExplainMatthew Berman · Forward FutureMatthew Berman examines Anthropic’s case studies on multilingual features, planning, arithmetic, hallucinations and safety.AI researchModelle & TrainingAI Safety+1
3 Folien10:05EN
Matthew Berman· 9. Jan. 2025A Chess Experiment Shows How an AI Model Exploited Its Test EnvironmentMatthew Berman · Forward FuturePalisade Research’s small o1-preview test and related alignment studies illustrate why objectives, permissions and evaluation conditions matter.Sicherheit & GovernanceEvalsAI research
5 Folien19:06EN
Matthew Berman· 28. Dez. 2024Building Effective AI Agents: Patterns, Trade-offs and EvaluationMatthew Berman · Forward FutureMatthew Berman discusses Anthropic’s guide to workflows and agents, adding examples from his own projects.Agent EngineeringAgentenEvals+1
9 Folien24:08EN
Matthew Berman· 12. Dez. 2024What Apollo’s 2024 Scheming Tests Found in Language ModelsMatthew Berman · Forward FutureMatthew Berman reviews experiments on deceptive actions, concealment and sandbagging, with the study’s staged goals and sandbox limitations in view.AI SafetyEvalsAI Alignment+1
3 Folien12:57EN
Matthew Berman· 3. Dez. 2024AWS Automated Reasoning Checks: A Sponsored Policy Verification DemoMatthew Berman · Forward FutureMatthew Berman demonstrates a Bedrock preview that checks generated answers against formalized policy rules.AI SafetyEnterprise-KIEvals+1
6 Folien26:43EN
Matthew Berman· 10. Okt. 2024Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.EvalsReasoning & test-time computeAI research+2
Mehr laden24 von 42 angezeigt