Resultados
223 artículosOrdenar
26:23EN
Matthew Berman· 20 dic 2024OpenAI’s o3 Announcement: Benchmark Gains and the Question of AGIMatthew Berman, Sam Altman, Mark Chen, Greg Kamradt, Hongyu Ren · Forward FutureMatthew Berman reviews the December 2024 o3 and o3-mini announcement, including coding, math and ARC-AGI results. He calls the results evidence of AGI, a conclusion the benchmarks alone cannot establish.
9:00ENMatthew Berman· 20 dic 2024Best-of-N Jailbreaking: What Repeated Prompt Variations Revealed in 2024Matthew Berman · Forward FutureMatthew Berman reviews research on how repeated input variations can expose safety failures in text, vision and audio models.
52:21ENMatthew Berman· 7 dic 2024The SWE-bench Team on Coding Agents, Evaluation and the Future of ProgrammingMatthew Berman, Kilian Lieret, Ofir Press, Carlos E. Jimenez · Forward FutureKilian Lieret, Ofir Press and Carlos Jimenez explain how real GitHub issues became a benchmark and how interface design shaped SWE-agent.
1:22:09ENMatthew Berman· 5 dic 2024Testing ChatGPT o1 Pro Live: Puzzles, Code and the Cost of More ReasoningMatthew Berman · Forward FutureMatthew Berman tries OpenAI’s newly announced $200 monthly plan on audience prompts, encountering slow responses, simple successes and a wrong Sudoku conclusion.
1:49:41EN
Cognitive Revolution "How AI Changes Everything"· 21 nov 2024PódcastA Team of Fifteen Matched Meta’s Post-Training on Meta’s Own BasePresenta: Nathan LabenzNathan Lambert walks through Tulu 3: the three-stage recipe, the 1 percent versus 14 percent lesson, and why open post-training now lives or dies on data and evals.
14:50ENMatthew Berman· 19 nov 2024AI News in November 2024: Mistral, Gemini, Nuclear Safety and Medical AIMatthew Berman · Forward FutureMatthew Berman surveys Le Chat updates, model rankings, nuclear safeguards and a diagnostic reasoning study.
14:05ENMatthew Berman· 15 nov 2024Test-Time Training Improves ARC Puzzle Results in an MIT StudyMatthew Berman · Forward FutureMatthew Berman explains a 2024 paper that adapts a language model to each puzzle at inference time and combines its predictions with program synthesis.
11:56ENMatthew Berman· 3 nov 2024IBM Granite 3.0 and InstructLab: Small Models for Enterprise AIMatthew Berman · Forward FutureMatthew Berman reviews IBM's 2024 model family and its approach to adding domain knowledge. IBM partnered on the video and invited him to its event.
10:39ENMatthew Berman· 29 oct 2024Zamba2-7B: A Hybrid Mamba–Transformer Model Tested on Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman compares Zyphra’s efficiency claims with his own informal tests, including Python games, spatial puzzles and simple word tasks.
12:29ENMatthew Berman· 25 oct 2024Testing the Updated Claude 3.5 Sonnet: Coding, Reasoning and VisionMatthew Berman · Forward FutureMatthew Berman tries the October 2024 model on Python games, logic puzzles and images, with mixed results and some ambiguous grading.
18:28ENMatthew Berman· 23 oct 2024Claude 3.5 Sonnet’s 2024 Computer-Use Beta: Demos and LimitsMatthew Berman · Forward FutureMatthew Berman reviews Anthropic’s updated models and shows how a beta agent navigated software with screenshots and tool actions.
1:23:37ENCognitive Revolution "How AI Changes Everything"· 23 oct 2024PódcastNine of the top ten research ideas were Claude'sPresenta: Nathan LabenzStanford PhD student Chenglei Si ran a blind study pitting Claude 3.5 Sonnet against more than a hundred NLP researchers on novel research ideas.
2:37:47ENCognitive Revolution "How AI Changes Everything"· 19 oct 2024PódcastThe intern who wrote GELU now wants humanity's last examPresenta: Nathan LabenzDan Hendrycks on activation functions, five-year benchmarks, jailbreaks that do not yield to scale, and stacking defenses because no single layer is trustworthy.
2:25:53ENCognitive Revolution "How AI Changes Everything"· 16 oct 2024PódcastWhen GPT-4's Base Model Introduced Itself, 75% of the Answers Were About AIPresenta: Nathan LabenzOwain Evans tells Michael Trazzi why situational awareness and out-of-context reasoning are leading indicators of deceptive alignment, and why a pretrained model with almost no self-knowledge still kept talking about being an AI.
9:38ENMatthew Berman· 15 oct 2024Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.
26:43ENMatthew Berman· 10 oct 2024Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.
1:09:09ENCognitive Revolution "How AI Changes Everything"· 2 oct 2024Pódcast30 Percent on SWE-bench: Cosine Taught Genie How Engineers Actually ThinkPresenta: Nathan LabenzAlistair Pullen tells Latent Space how Cosine reconstructed human problem-solving, fine-tuned on billions of tokens, and took the top score on software engineering’s hardest public test.
11:14ENMatthew Berman· 18 sept 2024Pixtral 12B: Testing a 2024 Vision-Language ModelMatthew Berman · Forward FutureMatthew Berman runs informal image, text and interface-generation tests of Mistral’s Pixtral on a sponsor-provided cloud GPU.
18:09ENMatthew Berman· 17 sept 2024AI News in September 2024: Copilot, NotebookLM, o1 and World ModelsMatthew Berman · Forward FutureMatthew Berman reviews a week of AI announcements, from workplace assistants and audio overviews to benchmark results, generative video and spatial AI.
10:57ENMatthew Berman· 13 sept 2024Testing OpenAI o1-preview: Tetris, Physical Reasoning and a North Pole ErrorMatthew Berman · Forward FutureIn September 2024, Matthew Berman runs the new reasoning-model preview through a personal rubric and examines where its answers succeed or fail.
21:21ENMatthew Berman· 12 sept 2024OpenAI o1’s 2024 Launch: Reasoning Benchmarks and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews o1-preview and o1-mini, OpenAI’s reported evaluations, and his own early coding experiments.
19:38ENMatthew Berman· 9 sept 2024Reflection 70B: Conflicting Results and Unanswered QuestionsMatthew Berman · Forward FutureMatthew Berman reviews his early coverage, independent evaluations and competing claims about the September 2024 release.
1:54:17ENCognitive Revolution "How AI Changes Everything"· 28 ago 2024PódcastMetaculus Flagged Covid in January 2020. Now It Is Putting AI on the Forecasting DeskPresenta: Nathan LabenzNathan Labenz talks with Metaculus CEO Deger Turan about epistemic security, a year-long bot tournament, and why a useful forecast is harder than an accurate one.
50:20EN
20VC with Harry Stebbings· 28 ago 2024Pódcast · 2 vocesArvind Narayanan on AI Scaling, Real-World Risks and the Limits of Model BenchmarksInvitado: Arvind Narayanan · Presenta: Harry StebbingsThe Princeton professor challenges simple claims about scaling, AGI timelines and AI adoption while discussing deepfakes, healthcare, education and security.Cargar másMostrando 24 de 223