Ergebnisse
12 ArtikelSortieren
18:31ENJanie Gu and Suyeol Yun: Why Frontier Models Fail as Buy-Side AnalystsJanie Gu, Suyeol Yun · Google DeepMindJanie Gu explains why benchmark scores can mislead, while Suyeol Yun presents MandateBench, which tests whether a model can turn a fund mandate into a defensible investment memo. The two talks show why real workflows, reproducible grading, and evidence-backed reasoning matter.
25:50ENKimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.
21:29ENMistral Large 4 Preview: European Open Weights, Cyber Benchmarks and Setup FrictionMatthew Berman · Forward FutureMatthew Berman reviews the model’s reported specifications and benchmarks, then tests it in an agent coding workflow.
16:59ENClaude Sonnet 5.5 Tested: Games, 3D Scenes and a Lower-Cost Opus AlternativeMatthew Berman · Forward FutureMatthew Berman demonstrates generated projects and compares Sonnet’s reported benchmark scores and API prices with Opus.
16:57ENGrok 4.7 Compared: Coding, Knowledge Work and Cost per TaskMatthew Berman · Forward FutureMatthew Berman examines reported benchmarks and prices while noting missing competitors and limited hands-on testing.
16:50ENGemini 3.8 Flash: Benchmarks, Cost and Hands-On Coding TestsMatthew Berman · Forward FutureMatthew Berman compares Google's September 2026 model announcement with several practical visual and web-building examples.
17:03ENDeepSWE: Testing Coding Agents on Longer Software TasksMatthew Berman · Forward FutureMatthew Berman reviews Datacurve’s benchmark, its verifier audit and the tradeoffs of comparing models under a shared harness.
26:00ENWhy a Zapier founder thinks AGI research has been stalled for four yearsModeration: Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
17:12ENTesting the Mystery 'gpt2-chatbot' Model in April 2024Matthew Berman · Forward FutureMatthew Berman tries an anonymous model on coding, arithmetic and reasoning tasks while its identity remains uncertain.
16:28ENTesting Reka Core: Multimodal Benchmarks, Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman reviews Reka’s reported model comparisons and tests Core on code, logic and image understanding.
16:03ENQuantum Supremacy Is a Well-Defined Speedup, Not a Useful TaskGast: Scott Aaronson · Moderation: Lex FridmanScott Aaronson explains what Google's 53-qubit experiment actually demonstrated, how it was verified, and why complexity theory can offer evidence but not proof against classical spoofing.
16:41ENAlphaFold 2 and the Protein-Folding Breakthrough: Why Lex Fridman Calls It a Landmark for AI and BiologyModeration: Lex FridmanA quick explainer on DeepMind's CASP14 result, how protein folding works, how AlphaFold 1 and 2 likely differ, and what the advance could unlock.







