Results
271 articlesSort
24:08EN
Matthew Berman· Dec 12, 2024What Apollo’s 2024 Scheming Tests Found in Language ModelsMatthew Berman · Forward FutureMatthew Berman reviews experiments on deceptive actions, concealment and sandbagging, with the study’s staged goals and sandbox limitations in view.
51:37EN
Sequoia Capital· Dec 10, 2024PodcastForty hours to 28 minutes: the Copilot creator teaching AI to hackOege de Moor tells Sequoia how XBOW’s AI pentest matched a top human on 104 original challenges, and why offensive security is becoming always-on software.
2:05:41EN
Cognitive Revolution "How AI Changes Everything"· Dec 7, 2024Podcasto1 will copy its weights, fake the score data, and keep lying 85% of the timeHost Nathan LabenzForty-eight hours after OpenAI shipped full o1, Apollo Research published a 70-page paper: frontier models are capable of in-context scheming.
1:55:53ENCognitive Revolution "How AI Changes Everything"· Dec 5, 2024PodcastAI Beats Humans at Reading Papers. It Still Cannot Count Atoms.Host Nathan LabenzAndrew White, Head of Science at Future House, maps what language models can already do in chemistry and biology—and the bottlenecks they do not dissolve.
1:22:09ENMatthew Berman· Dec 5, 2024Testing ChatGPT o1 Pro Live: Puzzles, Code and the Cost of More ReasoningMatthew Berman · Forward FutureMatthew Berman tries OpenAI’s newly announced $200 monthly plan on audience prompts, encountering slow responses, simple successes and a wrong Sudoku conclusion.
12:57ENMatthew Berman· Dec 3, 2024AWS Automated Reasoning Checks: A Sponsored Policy Verification DemoMatthew Berman · Forward FutureMatthew Berman demonstrates a Bedrock preview that checks generated answers against formalized policy rules.
1:24:48ENCognitive Revolution "How AI Changes Everything"· Nov 23, 2024PodcastCanva's AI Features Have Been Used 10 Billion Times. The Playbook Is Not a Chat BoxHost Nathan LabenzJohn Milinovich, Canva's generative-AI product lead, walks Nathan Labenz through automation versus augmentation, concept-level interfaces, evals without a design arena, and why application-layer companies still have a decade of room.
1:49:41ENCognitive Revolution "How AI Changes Everything"· Nov 21, 2024PodcastA Team of Fifteen Matched Meta’s Post-Training on Meta’s Own BaseHost Nathan LabenzNathan Lambert walks through Tulu 3: the three-stage recipe, the 1 percent versus 14 percent lesson, and why open post-training now lives or dies on data and evals.
1:04:54EN
Unsupervised Learning: With Jacob Effron· Nov 12, 2024PodcastHe bet company equity that Transformer would last — then drew an AI map for 12,000 companiesHost Jacob EffronDatabricks chief AI scientist Jonathan Frankle tells enterprises when to prompt, fine-tune, or pre-train, and why he still refuses to forecast the next architecture.
12:50ENMatthew Berman· Nov 2, 2024Comparing Three Local Coding Models on Games and Programming ChallengesMatthew Berman · Forward FutureMatthew Berman runs DeepSeek-Coder-V2 Lite, Yi-Coder 9B, and Qwen2.5-Coder 7B on a sponsored workstation. Their results vary by task and include manual corrections.
2:24:18ENCognitive Revolution "How AI Changes Everything"· Oct 30, 2024PodcastMMLU Stays at Chance Until Late Training. Loss Is Only an Alarm.Host Nathan LabenzZyphra’s training lead walks through Zamba 2’s hybrid architecture, the evals that actually matter, and the trade secrets small labs still have to rediscover.
56:10ENUnsupervised Learning: With Jacob Effron· Oct 29, 2024PodcastDeepL Beat Google at Translation by Refusing to Be a General ModelHost Jacob EffronOnly 18 percent of the world speaks English—and a Cologne startup turned that fact into a $2 billion language-AI company.
12:29ENMatthew Berman· Oct 25, 2024Testing the Updated Claude 3.5 Sonnet: Coding, Reasoning and VisionMatthew Berman · Forward FutureMatthew Berman tries the October 2024 model on Python games, logic puzzles and images, with mixed results and some ambiguous grading.
44:30EN
No Priors: AI, Machine Learning, Tech, & Startups· Oct 24, 2024Podcast · 2 speakers100,000 Rides a Week, Six Times Fewer Airbag Crashes: Waymo’s Co-CEO on Eighteen Years of Full AutonomyHost Sarah Guo, Elad GilDmitri Dolgov tells No Priors how a dozen Googlers, ten 100-mile routes, and a 2013 refusal to settle for driver assist became a rider-only service with an insurer-audited safety record.
1:23:37ENCognitive Revolution "How AI Changes Everything"· Oct 23, 2024PodcastNine of the top ten research ideas were Claude'sHost Nathan LabenzStanford PhD student Chenglei Si ran a blind study pitting Claude 3.5 Sonnet against more than a hundred NLP researchers on novel research ideas.
2:37:47ENCognitive Revolution "How AI Changes Everything"· Oct 19, 2024PodcastThe intern who wrote GELU now wants humanity's last examHost Nathan LabenzDan Hendrycks on activation functions, five-year benchmarks, jailbreaks that do not yield to scale, and stacking defenses because no single layer is trustworthy.
2:25:53ENCognitive Revolution "How AI Changes Everything"· Oct 16, 2024PodcastWhen GPT-4's Base Model Introduced Itself, 75% of the Answers Were About AIHost Nathan LabenzOwain Evans tells Michael Trazzi why situational awareness and out-of-context reasoning are leading indicators of deceptive alignment, and why a pretrained model with almost no self-knowledge still kept talking about being an AI.
9:38ENMatthew Berman· Oct 15, 2024Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.
1:02:04ENMatthew Berman· Oct 11, 2024João Moura and Matthew Berman on Tesla’s Robotaxi Vision and Building AI AgentsMatthew Berman, João Moura, Elon Musk · Forward FutureA 2024 livestream examines Tesla’s Cybercab and Optimus announcements, then turns to CrewAI, enterprise agent workflows and a small model comparison.
26:43ENMatthew Berman· Oct 10, 2024Testing OpenAI o1 on Planning, Rules and Spatial ReasoningMatthew Berman · Forward FutureMatthew Berman reviews a 2024 pilot study comparing o1-preview, o1-mini and GPT-4 on six planning domains.
38:28ENNo Priors: AI, Machine Learning, Tech, & Startups· Oct 8, 2024Podcast · 2 speakersHalf of Production AI Is RAG. Fine-Tuning Almost Disappeared.Host Sarah Guo, Elad GilBraintrust CEO Ankur Goyal tells No Priors what Notion, Zapier, and Vercel actually ship — and which hyped techniques they quietly dropped.
1:06:48ENUnsupervised Learning: With Jacob Effron· Oct 3, 2024Podcasto1 Is Slow and Hard to Use. Percy Liang Still Calls It a Turning PointHost Jacob EffronStanford’s Percy Liang splits OpenAI’s o1 into a disappointing product and the most important research signal in years.
45:22ENSequoia Capital· Oct 2, 2024PodcastAlphaGo Thought 30 Seconds a Move. o1 Made “Think Longer” GeneralOpenAI researchers Noam Brown, Ilge Akkaya, and Hunter Lightman on teaching language models to reason, the generator-verifier gap, and a second scaling curve at inference time.
2:38:56ENCognitive Revolution "How AI Changes Everything"· Sep 25, 2024PodcastHow Anthropic Decides a Model Can Ship: Red Lines, Yellow Lines, and 8% of Staff on SecurityHost Nathan LabenzNick Joseph, Anthropic's head of training, walks Rob Wiblin through the company's Responsible Scaling Policy — and the fight over whether a voluntary promise can hold when a launch is on the line.Load moreShowing 24 of 271