Resultados
32 artículosOrdenar
18:31EN
AI Engineer· 25 oct 2026Janie Gu and Suyeol Yun: Why Frontier Models Fail as Buy-Side AnalystsJanie Gu, Suyeol Yun · Google DeepMindJanie Gu explains why benchmark scores can mislead, while Suyeol Yun presents MandateBench, which tests whether a model can turn a fund mandate into a defensible investment memo. The two talks show why real workflows, reproducible grading, and evidence-backed reasoning matter.
25:50EN
Matthew Berman· 24 oct 2026Kimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.
21:29ENMatthew Berman· 7 oct 2026Mistral Large 4 Preview: European Open Weights, Cyber Benchmarks and Setup FrictionMatthew Berman · Forward FutureMatthew Berman reviews the model’s reported specifications and benchmarks, then tests it in an agent coding workflow.
16:59ENMatthew Berman· 29 sept 2026Claude Sonnet 5.5 Tested: Games, 3D Scenes and a Lower-Cost Opus AlternativeMatthew Berman · Forward FutureMatthew Berman demonstrates generated projects and compares Sonnet’s reported benchmark scores and API prices with Opus.
16:57ENMatthew Berman· 22 sept 2026Grok 4.7 Compared: Coding, Knowledge Work and Cost per TaskMatthew Berman · Forward FutureMatthew Berman examines reported benchmarks and prices while noting missing competitors and limited hands-on testing.
16:50ENMatthew Berman· 3 sept 2026Gemini 3.8 Flash: Benchmarks, Cost and Hands-On Coding TestsMatthew Berman · Forward FutureMatthew Berman compares Google's September 2026 model announcement with several practical visual and web-building examples.
15:37ENMatthew Berman· 4 ago 2026Matthew Berman on Qwen3.8-Max, AI Costs and Open-Weight CompetitionMatthew Berman · Forward FutureA 2026 review of reported benchmark results and research demonstrations leads to questions about deployment economics and geopolitical dependence.
17:03ENMatthew Berman· 27 may 2026DeepSWE: Testing Coding Agents on Longer Software TasksMatthew Berman · Forward FutureMatthew Berman reviews Datacurve’s benchmark, its verifier audit and the tradeoffs of comparing models under a shared harness.
18:07ENMatthew Berman· 16 abr 2026Claude Opus 4.7: Benchmarks, Cyber Safeguards and Open QuestionsMatthew Berman · Forward FutureMatthew Berman compares Anthropic’s April 2026 Opus release with the limited Mythos Preview and examines its system card.
15:08ENMatthew Berman· 8 ago 2025GPT-5 at Launch: Routing, Coding, Benchmarks and ReliabilityMatthew Berman · Forward FutureMatthew Berman reviews OpenAI’s 2025 GPT-5 release, its unified ChatGPT experience, benchmark claims and the limitations of model evaluations.
22:05ENMatthew Berman· 9 jun 2025Apple’s “Illusion of Thinking”: Puzzle Limits and a Code-Assisted TestMatthew Berman, Ilya Sutskever · Forward FutureMatthew Berman reviews Apple’s reasoning-model experiments and tests a different way to solve Tower of Hanoi using generated code.
15:13ENMatthew Berman· 10 may 2025Absolute Zero: Training a Reasoner on Self-Generated Coding TasksMatthew Berman · Forward FutureMatthew Berman examines a 2025 paper in which a pretrained language model proposes and solves code tasks using verifiable feedback.
15:15ENMatthew Berman· 19 abr 2025Early Reactions to OpenAI o3 and o4-mini: Tool Use, Math and MistakesMatthew Berman · Forward FutureMatthew Berman reviews 2025 demos and benchmark reports, from location guessing and coding to simple failures that challenge the hype.
15:46ENMatthew Berman· 16 abr 2025OpenAI o3 and o4-mini: Tool Use, Benchmarks and the First Codex CLIMatthew Berman · Forward FutureMatthew Berman reviews OpenAI’s April 2025 reasoning-model release, a scientific image-analysis demonstration and the debut of its terminal coding agent.
19:32ENMatthew Berman· 28 feb 2025GPT-4.5’s Launch: Conversational Style, Benchmarks and CostMatthew Berman · Forward FutureMatthew Berman examines OpenAI’s February 2025 research preview, its selected demonstrations, reported evaluations and high launch pricing.
21:02ENMatthew Berman· 24 dic 2024Reactions to OpenAI’s 2024 o3 Preview: Benchmarks, Cost and LimitsMatthew Berman · Forward FutureMatthew Berman surveys the responses to the o3 preview, from mathematical benchmarks to debates about AGI, compute and reliability.
26:43ENMatthew Berman· 10 oct 2024Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.
18:09ENMatthew Berman· 17 sept 2024AI News in September 2024: Copilot, NotebookLM, o1 and World ModelsMatthew Berman · Forward FutureMatthew Berman reviews a week of AI announcements, from workplace assistants and audio overviews to benchmark results, generative video and spatial AI.
21:21ENMatthew Berman· 12 sept 2024OpenAI o1’s 2024 Launch: Reasoning Benchmarks and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews o1-preview and o1-mini, OpenAI’s reported evaluations, and his own early coding experiments.
19:38ENMatthew Berman· 9 sept 2024Reflection 70B: Conflicting Results and Unanswered QuestionsMatthew Berman · Forward FutureMatthew Berman reviews his early coverage, independent evaluations and competing claims about the September 2024 release.
15:50ENMatthew Berman· 23 jul 2024Llama 3.1: Meta’s 405B Model and the Open-Weight EcosystemMatthew Berman · Forward FutureMatthew Berman reviews Meta’s July 2024 release, the smaller models, reported benchmarks, synthetic data and the proposed Llama Stack.
16:11ENMatthew Berman· 22 jun 2024AI News in June 2024: SSI, Tree Search, Meta, Claude and ARC PrizeMatthew Berman · Forward FutureMatthew Berman reviews new AI research, product launches and a competition, with context on historical benchmarks and uncertain claims.
26:00EN
No Priors: AI, Machine Learning, Tech, & Startups· 11 jun 2024Pódcast · 2 vocesWhy a Zapier founder thinks AGI research has been stalled for four yearsPresenta: Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
17:03ENMatthew Berman· 8 jun 2024Qwen2 0.5B and 72B: A Hands-On ComparisonMatthew Berman · Forward FutureMatthew Berman tests coding, arithmetic and reasoning prompts on the smallest and largest Qwen2 models in a 2024 demonstration.Cargar másMostrando 24 de 32