Resultados
158 artículosOrdenar
21:02EN
Matthew Berman· 24 dic 2024Reactions to OpenAI’s 2024 o3 Preview: Benchmarks, Cost and LimitsMatthew Berman · Forward FutureMatthew Berman surveys the responses to the o3 preview, from mathematical benchmarks to debates about AGI, compute and reliability.
1:46:41EN
Cognitive Revolution "How AI Changes Everything"· 21 dic 2024PódcastFrontier Models Hit the 10th–40th Percentile on Real AI R&DPresenta: Nathan LabenzNeev Parikh of METR walks Nathan Labenz through REBench, a seven-task test of whether agents can do machine learning research—and what happened when one of them decided not to train.
9:00ENMatthew Berman· 20 dic 2024Best-of-N Jailbreaking: What Repeated Prompt Variations Revealed in 2024Matthew Berman · Forward FutureMatthew Berman reviews research on how repeated input variations can expose safety failures in text, vision and audio models.
1:49:41ENCognitive Revolution "How AI Changes Everything"· 21 nov 2024PódcastA Team of Fifteen Matched Meta’s Post-Training on Meta’s Own BasePresenta: Nathan LabenzNathan Lambert walks through Tulu 3: the three-stage recipe, the 1 percent versus 14 percent lesson, and why open post-training now lives or dies on data and evals.
14:50ENMatthew Berman· 19 nov 2024AI News in November 2024: Mistral, Gemini, Nuclear Safety and Medical AIMatthew Berman · Forward FutureMatthew Berman surveys Le Chat updates, model rankings, nuclear safeguards and a diagnostic reasoning study.
11:56ENMatthew Berman· 3 nov 2024IBM Granite 3.0 and InstructLab: Small Models for Enterprise AIMatthew Berman · Forward FutureMatthew Berman reviews IBM's 2024 model family and its approach to adding domain knowledge. IBM partnered on the video and invited him to its event.
1:23:37ENCognitive Revolution "How AI Changes Everything"· 23 oct 2024PódcastNine of the top ten research ideas were Claude'sPresenta: Nathan LabenzStanford PhD student Chenglei Si ran a blind study pitting Claude 3.5 Sonnet against more than a hundred NLP researchers on novel research ideas.
2:37:47ENCognitive Revolution "How AI Changes Everything"· 19 oct 2024PódcastThe intern who wrote GELU now wants humanity's last examPresenta: Nathan LabenzDan Hendrycks on activation functions, five-year benchmarks, jailbreaks that do not yield to scale, and stacking defenses because no single layer is trustworthy.
2:25:53ENCognitive Revolution "How AI Changes Everything"· 16 oct 2024PódcastWhen GPT-4's Base Model Introduced Itself, 75% of the Answers Were About AIPresenta: Nathan LabenzOwain Evans tells Michael Trazzi why situational awareness and out-of-context reasoning are leading indicators of deceptive alignment, and why a pretrained model with almost no self-knowledge still kept talking about being an AI.
9:38ENMatthew Berman· 15 oct 2024Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.
26:43ENMatthew Berman· 10 oct 2024Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.
1:09:09ENCognitive Revolution "How AI Changes Everything"· 2 oct 2024Pódcast30 Percent on SWE-bench: Cosine Taught Genie How Engineers Actually ThinkPresenta: Nathan LabenzAlistair Pullen tells Latent Space how Cosine reconstructed human problem-solving, fine-tuned on billions of tokens, and took the top score on software engineering’s hardest public test.
11:14ENMatthew Berman· 18 sept 2024Pixtral 12B: Testing a 2024 Vision-Language ModelMatthew Berman · Forward FutureMatthew Berman runs informal image, text and interface-generation tests of Mistral’s Pixtral on a sponsor-provided cloud GPU.
18:09ENMatthew Berman· 17 sept 2024AI News in September 2024: Copilot, NotebookLM, o1 and World ModelsMatthew Berman · Forward FutureMatthew Berman reviews a week of AI announcements, from workplace assistants and audio overviews to benchmark results, generative video and spatial AI.
10:57ENMatthew Berman· 13 sept 2024Testing OpenAI o1-preview: Tetris, Physical Reasoning and a North Pole ErrorMatthew Berman · Forward FutureIn September 2024, Matthew Berman runs the new reasoning-model preview through a personal rubric and examines where its answers succeed or fail.
21:21ENMatthew Berman· 12 sept 2024OpenAI o1’s 2024 Launch: Reasoning Benchmarks and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews o1-preview and o1-mini, OpenAI’s reported evaluations, and his own early coding experiments.
19:38ENMatthew Berman· 9 sept 2024Reflection 70B: Conflicting Results and Unanswered QuestionsMatthew Berman · Forward FutureMatthew Berman reviews his early coverage, independent evaluations and competing claims about the September 2024 release.
1:54:17ENCognitive Revolution "How AI Changes Everything"· 28 ago 2024PódcastMetaculus Flagged Covid in January 2020. Now It Is Putting AI on the Forecasting DeskPresenta: Nathan LabenzNathan Labenz talks with Metaculus CEO Deger Turan about epistemic security, a year-long bot tournament, and why a useful forecast is harder than an accurate one.
50:20EN
20VC with Harry Stebbings· 28 ago 2024Pódcast · 2 vocesArvind Narayanan on AI Scaling, Real-World Risks and the Limits of Model BenchmarksInvitado: Arvind Narayanan · Presenta: Harry StebbingsThe Princeton professor challenges simple claims about scaling, AGI timelines and AI adoption while discussing deepfakes, healthcare, education and security.
18:39ENMatthew Berman· 17 ago 2024AI Scientist, Grok-2 and Agent Q: Matthew Berman’s August 2024 AI News RoundupMatthew Berman · Forward FutureA week of model releases, web agents and AI research raises questions about benchmarks, automation and the gap between prototypes and predictions.
9:58ENMatthew Berman· 2 ago 2024Abstract AI: A Proposed Routing Layer for Language ModelsMatthew Berman · Forward FutureMatthew Berman outlines a startup idea for choosing models and workflows by cost, speed and quality.
15:50ENMatthew Berman· 23 jul 2024Llama 3.1: Meta’s 405B Model and the Open-Weight EcosystemMatthew Berman · Forward FutureMatthew Berman reviews Meta’s July 2024 release, the smaller models, reported benchmarks, synthetic data and the proposed Llama Stack.
1:56:03ENCognitive Revolution "How AI Changes Everything"· 13 jul 2024PódcastHumans Near a Perfect Score. The Best AI Still Gets 39%Presenta: Nathan LabenzZapier co-founder Mike Knoop and François Chollet put $1 million on ARC-AGI, a 2019 test of sample-efficient intelligence that language models still cannot crack under a one-cent-per-puzzle budget.
55:13EN
Sequoia Capital· 2 jul 2024PódcastThe Best AI Scores 39% on This Test. Zapier’s Co-Founder Put $1 Million on Beating ItFrançois Chollet designed ARC to measure skill-acquisition efficiency; five years later humans still crush it and frontier models do not.Cargar másMostrando 24 de 158