Results
10 articlesSort
10:36ENMeta Muse Wonder Tested: Strong Benchmarks, Mixed Demos and Quota FrictionMatthew Berman · Forward FutureMatthew Berman tests Meta’s models on browser demos and reviews their published benchmark scores, availability and cost.
16:57ENGrok 4.7 Compared: Coding, Knowledge Work and Cost per TaskMatthew Berman · Forward FutureMatthew Berman examines reported benchmarks and prices while noting missing competitors and limited hands-on testing.
1:09ENA Discussion of GPT-4.5’s Scaling and TrainingA speaker offers an assessment of GPT-4.5’s cost, speed and alleged training challenges.
30:29ENHow Researchers Think o1-Style Reasoning Models WorkMatthew Berman · Forward FutureMatthew Berman explains a research survey of policy initialization, rewards, search and reinforcement learning, and the open questions behind reasoning models.
0:54ENOpenAI’s o1 Preview: A First Look at Longer ReasoningMatthew Berman · Forward FutureMatthew Berman introduces the o1-preview and o1-mini models and tries a Python game prompt.
12:50ENTesting Smaug: Hosted 70B Versus a Smaller Local ModelMatthew Berman · Forward FutureMatthew Berman compares two Smaug configurations on Snake, math and reasoning puzzles.
16:28ENTesting Reka Core: Multimodal Benchmarks, Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman reviews Reka’s reported model comparisons and tests Core on code, logic and image understanding.
15:01ENTesting Llama 3 at Launch: Code, Reasoning and Image GenerationMatthew Berman · Forward FutureMatthew Berman tries Meta AI’s new interface on a snake game, logic puzzles and rapid image generation.
14:23ENTesting DBRX: Coding Strengths and Reasoning GapsMatthew Berman · Forward FutureMatthew Berman examines Databricks’ open-weight model and puts it through coding, arithmetic and reasoning prompts.
23:00ENTesting Google Gemma 7B at Launch: Setup MattersMatthew Berman · Forward FutureMatthew Berman compares local and hosted tests of Google’s early open-weight model.