Ergebnisse
183 ArtikelSortieren
21:02EN
Matthew Berman· 24. Dez. 2024Reactions to OpenAI’s 2024 o3 Preview: Benchmarks, Cost and LimitsMatthew Berman · Forward FutureMatthew Berman surveys the responses to the o3 preview, from mathematical benchmarks to debates about AGI, compute and reliability.
1:46:41EN
Cognitive Revolution "How AI Changes Everything"· 21. Dez. 2024PodcastFrontier Models Hit the 10th–40th Percentile on Real AI R&DModeration: Nathan LabenzNeev Parikh of METR walks Nathan Labenz through REBench, a seven-task test of whether agents can do machine learning research—and what happened when one of them decided not to train.
26:23ENMatthew Berman· 20. Dez. 2024OpenAI’s o3 Announcement: Benchmark Gains and the Question of AGIMatthew Berman, Sam Altman, Mark Chen, Greg Kamradt, Hongyu Ren · Forward FutureMatthew Berman reviews the December 2024 o3 and o3-mini announcement, including coding, math and ARC-AGI results. He calls the results evidence of AGI, a conclusion the benchmarks alone cannot establish.
9:00ENMatthew Berman· 20. Dez. 2024Best-of-N Jailbreaking: What Repeated Prompt Variations Revealed in 2024Matthew Berman · Forward FutureMatthew Berman reviews research on how repeated input variations can expose safety failures in text, vision and audio models.
1:49:41ENCognitive Revolution "How AI Changes Everything"· 21. Nov. 2024PodcastA Team of Fifteen Matched Meta’s Post-Training on Meta’s Own BaseModeration: Nathan LabenzNathan Lambert walks through Tulu 3: the three-stage recipe, the 1 percent versus 14 percent lesson, and why open post-training now lives or dies on data and evals.
14:50ENMatthew Berman· 19. Nov. 2024AI News in November 2024: Mistral, Gemini, Nuclear Safety and Medical AIMatthew Berman · Forward FutureMatthew Berman surveys Le Chat updates, model rankings, nuclear safeguards and a diagnostic reasoning study.
14:05ENMatthew Berman· 15. Nov. 2024Test-Time Training Improves ARC Puzzle Results in an MIT StudyMatthew Berman · Forward FutureMatthew Berman explains a 2024 paper that adapts a language model to each puzzle at inference time and combines its predictions with program synthesis.
11:56ENMatthew Berman· 3. Nov. 2024IBM Granite 3.0 and InstructLab: Small Models for Enterprise AIMatthew Berman · Forward FutureMatthew Berman reviews IBM's 2024 model family and its approach to adding domain knowledge. IBM partnered on the video and invited him to its event.
10:39ENMatthew Berman· 29. Okt. 2024Zamba2-7B: A Hybrid Mamba–Transformer Model Tested on Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman compares Zyphra’s efficiency claims with his own informal tests, including Python games, spatial puzzles and simple word tasks.
1:23:37ENCognitive Revolution "How AI Changes Everything"· 23. Okt. 2024PodcastNine of the top ten research ideas were Claude'sModeration: Nathan LabenzStanford PhD student Chenglei Si ran a blind study pitting Claude 3.5 Sonnet against more than a hundred NLP researchers on novel research ideas.
2:37:47ENCognitive Revolution "How AI Changes Everything"· 19. Okt. 2024PodcastThe intern who wrote GELU now wants humanity's last examModeration: Nathan LabenzDan Hendrycks on activation functions, five-year benchmarks, jailbreaks that do not yield to scale, and stacking defenses because no single layer is trustworthy.
2:25:53ENCognitive Revolution "How AI Changes Everything"· 16. Okt. 2024PodcastWhen GPT-4's Base Model Introduced Itself, 75% of the Answers Were About AIModeration: Nathan LabenzOwain Evans tells Michael Trazzi why situational awareness and out-of-context reasoning are leading indicators of deceptive alignment, and why a pretrained model with almost no self-knowledge still kept talking about being an AI.
9:38ENMatthew Berman· 15. Okt. 2024Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.
26:43ENMatthew Berman· 10. Okt. 2024Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.
1:09:09ENCognitive Revolution "How AI Changes Everything"· 2. Okt. 2024Podcast30 Percent on SWE-bench: Cosine Taught Genie How Engineers Actually ThinkModeration: Nathan LabenzAlistair Pullen tells Latent Space how Cosine reconstructed human problem-solving, fine-tuned on billions of tokens, and took the top score on software engineering’s hardest public test.
11:14ENMatthew Berman· 18. Sept. 2024Pixtral 12B: Testing a 2024 Vision-Language ModelMatthew Berman · Forward FutureMatthew Berman runs informal image, text and interface-generation tests of Mistral’s Pixtral on a sponsor-provided cloud GPU.
18:09ENMatthew Berman· 17. Sept. 2024AI News in September 2024: Copilot, NotebookLM, o1 and World ModelsMatthew Berman · Forward FutureMatthew Berman reviews a week of AI announcements, from workplace assistants and audio overviews to benchmark results, generative video and spatial AI.
10:57ENMatthew Berman· 13. Sept. 2024Testing OpenAI o1-preview: Tetris, Physical Reasoning and a North Pole ErrorMatthew Berman · Forward FutureIn September 2024, Matthew Berman runs the new reasoning-model preview through a personal rubric and examines where its answers succeed or fail.
21:21ENMatthew Berman· 12. Sept. 2024OpenAI o1’s 2024 Launch: Reasoning Benchmarks and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews o1-preview and o1-mini, OpenAI’s reported evaluations, and his own early coding experiments.
19:38ENMatthew Berman· 9. Sept. 2024Reflection 70B: Conflicting Results and Unanswered QuestionsMatthew Berman · Forward FutureMatthew Berman reviews his early coverage, independent evaluations and competing claims about the September 2024 release.
1:54:17ENCognitive Revolution "How AI Changes Everything"· 28. Aug. 2024PodcastMetaculus Flagged Covid in January 2020. Now It Is Putting AI on the Forecasting DeskModeration: Nathan LabenzNathan Labenz talks with Metaculus CEO Deger Turan about epistemic security, a year-long bot tournament, and why a useful forecast is harder than an accurate one.
50:20EN
20VC with Harry Stebbings· 28. Aug. 2024Podcast · 2 StimmenArvind Narayanan on AI Scaling, Real-World Risks and the Limits of Model BenchmarksGast: Arvind Narayanan · Moderation: Harry StebbingsThe Princeton professor challenges simple claims about scaling, AGI timelines and AI adoption while discussing deepfakes, healthcare, education and security.
18:39ENMatthew Berman· 17. Aug. 2024AI Scientist, Grok-2 and Agent Q: Matthew Berman’s August 2024 AI News RoundupMatthew Berman · Forward FutureA week of model releases, web agents and AI research raises questions about benchmarks, automation and the gap between prototypes and predictions.
9:58ENMatthew Berman· 2. Aug. 2024Abstract AI: A Proposed Routing Layer for Language ModelsMatthew Berman · Forward FutureMatthew Berman outlines a startup idea for choosing models and workflows by cost, speed and quality.Mehr laden24 von 183 angezeigt