Recently updated channels

Pick one to see only that channelBrowse all channels →

Results

269 articles
Sort
1:23:53EN
Cognitive Revolution "How AI Changes Everything"· Mar 17, 2023PodcastGPT-4, 24 Hours Later: No Safety Locks, a Captcha Hire, and a U.S.–China DeadlockHost Nathan LabenzA day after OpenAI shipped GPT-4, ChinaTalk sat a red teamer, a pessimist, and a policy researcher down to argue over capability, safety, and a race nobody can brake.Security & safetyRed TeamingSafety & governance+3
3 slides11:53EN
Matthew Berman· Mar 14, 2023Testing GPT-4 Against GPT-3.5 at LaunchMatthew Berman · Forward FutureMatthew Berman reviews OpenAI's March 2023 GPT-4 announcement and compares the models on scheduling, reasoning, safety and travel prompts.OpenAIFoundation ModelsEvals+1
1:13:06EN
Lex Fridman· Aug 19, 2019Podcast · 2 speakersLockheed Martin's CTO on Autonomy, the Moon, and the Culture of Not Getting It WrongGuest Keoki Jackson · Host Lex FridmanKeoki Jackson tells Lex Fridman why going back to the Moon is the easy part—and why proving a learning system will still do the right thing is not.Security & safetySafety & governanceHuman-in-the-loop validation+3
1:45:49EN
Cognitive Revolution "How AI Changes Everything"PodcastTrust at Scale: Elicit's Founders on Reasoning Languages, World Models and Automating the CompanyHost Nathan LabenzAndreas Stuhlmüller and Jungwon Byun explain how Elicit keeps frontier models checkable for high-stakes science, and where they think AI reasoning is heading.AgentsWorld modelsReasoning & test-time compute+3
1:25:13EN
Lenny's PodcastPodcastCodex Is Not Just a Coding Tool: OpenAI's Plan for an Agent That Behaves Like a TeammateHost Lenny RachitskyCodex product lead Alexander Embiricos explains the 20x growth, why every useful agent may need to write code, and why human review speed is the real bottleneck.Coding agentsCode review & verificationDeveloper productivity+3
1:33:50EN
Lenny's PodcastPodcastEvals Are the New PRDs: Inside Anthropic's Research Product TeamHost Lenny RachitskyDianne Penn, Anthropic's head of product for research and Labs, explains how the company found its identity, how her team turns user feedback into evals, and why human judgment still matters.Product & UXAI Product ManagementProduct Strategy+3
1:31:41EN
Lenny's PodcastPodcast · 2 speakersThe Worst Model You'll Ever Use: Kevin Weil on Building Products at OpenAI's PaceGuest Kevin Weil · Host Lenny RachitskyOpenAI's chief product officer explains how evals, light planning, fine-tuned model ensembles and a small PM team shape the way the company ships.Product & UXProduct LeadershipAI Product Management+3
1:22:36EN
Lenny's PodcastPodcast · 2 speakersStop Chasing AI News: Chip Huyen on What Actually Makes AI Products BetterGuest Chip Huyen · Host Lenny RachitskyAuthor of AI Engineering walks through pre-training, post-training, RL, evals and RAG, then explains what separates companies that get value from AI from those that stall.Product & UXFine-tuningRetrieval-augmented generation+3
1:07:08EN
Lenny's PodcastPodcast · 2 speakersIf the Model Is the Product, the Eval Is the PRD: Inside Mercor's RiseGuest Brendan Foody · Host Lenny RachitskyMercor CEO Brendan Foody explains why AI labs will pay almost anything for expert-written evals, how his company grew from $1 million to a $400 million run rate in 16 months, and what that means for jobs and founders.Evals & observabilityEvalsData quality & curation+3
51:30EN
Unsupervised Learning: With Jacob EffronPodcastLess Email, Better Thinking: Grammarly’s CEO on AI That Augments CommunicationHost Jacob EffronGrammarly CEO Rahul explains how the company is moving from grammar checks to end-to-end communication assistance—and why evals, user data, and measurable outcomes matter.Product & UXProduct StrategyEnterprise AI+3
14:41EN
Lex FridmanPodcast · 2 speakersTalking for 20 Minutes: How the Alexa Prize Turns Real Customers into a Testbed for Conversational AIGuest Rohit Prasad · Host Lex FridmanRohit Prasad, head scientist of Amazon Alexa, explains the Alexa Prize grand challenge, how it is judged and why true conversation still needs reasoning.Product & UXVoice AIAI research+3
1:16:17EN
Lenny's PodcastPodcast · 2 speakersFaster, But for What? Nicole Forsgren on Measuring Developer Productivity in the AI EraGuest Nicole Forsgren · Host Lenny RachitskyThe creator of DORA and SPACE explains why most productivity metrics mislead, how AI changes flow and trust, and how to build a developer experience program that proves its value.Evals & observabilityDeveloper productivityEvals+3
1:36:57EN
Unsupervised Learning: With Jacob EffronPodcastDo the Dumb Thing First: A CTO's Playbook for Building an AI Coding AssistantHost Jacob EffronSourcegraph CTO Beyang Liu on which AI coding features actually earn daily use, how new models get shipped and evaluated, and why retrieval is still a search problem.Coding agentsEvalsRetrieval-augmented generation+3
1:24:01EN
Lenny's PodcastPodcastFrom Sandwich Math to Expert Data: Scale AI's CEO on What Actually Makes Models SmarterHost Lenny RachitskyJason Droege explains what really happened with Meta's investment in Scale AI, how data labeling turned into expert work, and what Uber Eats taught him about building businesses.Models & trainingCompany BuildingData quality & curation+3
57:21EN
Cognitive Revolution "How AI Changes Everything"PodcastGemini 2.0 Flash Goes to Production: Pricing, Model Lineup and What Developers Should Build NextHost Nathan LabenzGoogle DeepMind's Logan Kilpatrick walks through launch-day Gemini 2.0 releases, rate limits, model naming, and where he sees startup opportunities.Models & trainingBenchmarksAI cost & performance+3
1:25:34EN
Lenny's PodcastPodcastShipping in Days: How Claude Code's Head of Product Runs a Team at AI SpeedHost Lenny RachitskyCat Wu, Head of Product for Claude Code and Cowork at Anthropic, explains how the PM role, hiring, tooling and culture change when features go from idea to users in a week or less.Coding agentsProduct ManagementAI Product Management+3
58:57EN
Cognitive Revolution "How AI Changes Everything"PodcastWhen the Model Learns to Look Around: Apollo Research on Testing o1 for SchemingHost Nathan LabenzApollo Research founder Marius Hobbhahn explains how his team probed OpenAI's o1 for deception, what it found, and why the trajectory worries him more than the model itself.Security & safetyAI securitySafety & governance+3
1:46:33EN
Lenny's PodcastPodcast · 3 speakersFrom Chaos to a Failure Map: A Hands-On Primer on AI EvalsGuest Hamel Husain, Shreya Shankar · Host Lenny RachitskyHamel Husain and Shreya Shankar walk Lenny Rachitsky through a real error-analysis workflow, from reading traces to building a trustworthy LLM judge.Evals & observabilityEvalsAI engineering leadership+3