Results
180 articlesSort
9:35EN
Matthew Berman· Feb 25, 2025Claude 3.7 Sonnet and Claude Code: An Early Coding TestMatthew Berman · Forward FutureMatthew Berman reviews Anthropic’s 2025 launch benchmarks and builds an AI-controlled Snake game, then tests math and recent information.
17:20ENMatthew Berman· Feb 23, 2025Vibe Coding a Login Page and an AI Tetris PlayerMatthew Berman · Forward FutureMatthew Berman experiments with AI-written code, iterates through failures and trains a basic game-playing agent.
18:05ENMatthew Berman· Feb 16, 2025OpenAI’s Coding-Competition Study: o1-ioi, o3 and the Limits of the ResultsMatthew Berman, Sam Altman · Forward FutureMatthew Berman interprets OpenAI’s 2025 paper on reinforcement learning and programming contests. The results are strong on the studied benchmarks, but do not establish AGI or remove humans from model development.
0:59ENMatthew Berman· Feb 13, 2025What Is Vibe Coding? Matthew Berman Explains His WorkflowMatthew Berman · Forward FutureBerman describes using voice input and an AI coding editor to build software, test it, and feed errors back without reading the code.
21:10ENMatthew Berman· Feb 11, 2025Sam Altman’s 2025 AI Coding Forecast and Three ObservationsMatthew Berman, Sam Altman · Forward FutureMatthew Berman examines predictions about reasoning models, software agents and AI economics, distinguishing competitive-programming results from broader work.
9:58ENMatthew Berman· Feb 1, 2025Matthew Berman Tests o3-mini on Games, Puzzles and Web SearchMatthew Berman · Forward FutureA 2025 hands-on test finds working game prototypes and several successful answers alongside a delayed Tetris row, an ambiguous puzzle and a search configuration mistake.
9:58ENMatthew Berman· Jan 31, 2025OpenAI o3-mini Launch: Reasoning Effort, Benchmarks and a Snake TestMatthew Berman · Forward FutureIn January 2025, Matthew Berman reviews OpenAI’s reported results and tries two coding examples with different reasoning settings.
15:10ENMatthew Berman· Jan 22, 2025DeepSeek R1 Tested on Coding, Reasoning and Sensitive QuestionsMatthew Berman · Forward FutureMatthew Berman runs the full R1 model on cloud GPUs and tries game programming, reasoning puzzles and politically sensitive prompts.
26:23ENMatthew Berman· Dec 20, 2024OpenAI’s o3 Announcement: Benchmark Gains and the Question of AGIMatthew Berman, Sam Altman, Mark Chen, Greg Kamradt, Hongyu Ren · Forward FutureMatthew Berman reviews the December 2024 o3 and o3-mini announcement, including coding, math and ARC-AGI results. He calls the results evidence of AGI, a conclusion the benchmarks alone cannot establish.
52:21ENMatthew Berman· Dec 7, 2024The SWE-bench Team on Coding Agents, Evaluation and the Future of ProgrammingMatthew Berman, Kilian Lieret, Ofir Press, Carlos E. Jimenez · Forward FutureKilian Lieret, Ofir Press and Carlos Jimenez explain how real GitHub issues became a benchmark and how interface design shaped SWE-agent.
1:22:09ENMatthew Berman· Dec 5, 2024Testing ChatGPT o1 Pro Live: Puzzles, Code and the Cost of More ReasoningMatthew Berman · Forward FutureMatthew Berman tries OpenAI’s newly announced $200 monthly plan on audience prompts, encountering slow responses, simple successes and a wrong Sudoku conclusion.
0:28ENMatthew Berman· Nov 6, 2024Comparing Three Local Coding ModelsMatthew Berman · Forward FutureMatthew Berman introduces a sponsored comparison of DeepSeek Coder V2, Yi-Coder and Qwen Coder running on a workstation.
19:03ENMatthew Berman· Oct 30, 2024AI News in October 2024: Apple Intelligence, Coding Assistants, Search, and AgentsMatthew Berman · Forward FutureMatthew Berman reviews the first Apple Intelligence release, new coding tools, AI search disputes, local models, and reports of browser agents.
12:29ENMatthew Berman· Oct 25, 2024Testing the Updated Claude 3.5 Sonnet: Coding, Reasoning and VisionMatthew Berman · Forward FutureMatthew Berman tries the October 2024 model on Python games, logic puzzles and images, with mixed results and some ambiguous grading.
15:00ENMatthew Berman· Oct 4, 2024Matthew Berman Tests the First ChatGPT Canvas BetaMatthew Berman · Forward FutureA 2024 walkthrough explores side-by-side code and writing edits, unexpected shortcut behavior and platform risk for AI developers.
10:57ENMatthew Berman· Sep 13, 2024Testing OpenAI o1-preview: Tetris, Physical Reasoning and a North Pole ErrorMatthew Berman · Forward FutureIn September 2024, Matthew Berman runs the new reasoning-model preview through a personal rubric and examines where its answers succeed or fail.
21:21ENMatthew Berman· Sep 12, 2024OpenAI o1’s 2024 Launch: Reasoning Benchmarks and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews o1-preview and o1-mini, OpenAI’s reported evaluations, and his own early coding experiments.
1:31:56ENMatthew Berman· Sep 12, 2024Testing OpenAI o1 on Puzzles, Code and Reasoning: A Launch-Day LivestreamMatthew Berman · Forward FutureMatthew Berman tries o1-preview and o1-mini on word counts, Tetris, physical reasoning and a word puzzle, with viewers checking the results.
1:30:24ENMatthew Berman· Aug 30, 2024Daniel Miessler and Matthew Berman on AI Privacy, Coding, and Generated WorldsMatthew Berman, Daniel Miessler, Melissa, Alex · Forward FutureA 2024 live conversation explores Recall, open models, AI-assisted programming, a Doom simulator and questions about security, energy and employment.
18:37ENMatthew Berman· Aug 29, 2024GameNGen Simulates Doom as AI Coding, Safety and Inference News AccelerateMatthew Berman · Forward FutureMatthew Berman reviews a 2024 game-simulation paper, Cursor, robotics, AI safety debates and new enterprise tools.
19:46ENMatthew Berman· Aug 28, 2024Linus Torvalds and Dirk Hohndel on AI Coding, Bugs and HypeMatthew Berman, Linus Torvalds, Dirk Hohndel · Forward FutureMatthew Berman reacts to two conversations about AI-assisted programming, code review, automation and open data.
18:39ENMatthew Berman· Aug 17, 2024AI Scientist, Grok-2 and Agent Q: Matthew Berman’s August 2024 AI News RoundupMatthew Berman · Forward FutureA week of model releases, web agents and AI research raises questions about benchmarks, automation and the gap between prototypes and predictions.
13:40ENMatthew Berman· Jul 29, 2024Testing Llama 3.1 8B: Benchmark Gains and Mixed Practical ResultsMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and other prompts on the small model and finds several failures despite stronger reported benchmarks.
10:57ENMatthew Berman· Jun 24, 2024Testing Claude 3.5 Sonnet: Coding, Reasoning, and VisionMatthew Berman · Forward FutureMatthew Berman puts Anthropic’s June 2024 model through informal coding, math, puzzle, and image-understanding prompts.Load moreShowing 24 of 180