Results
21 articlesSort
36:19ENThe Benchmark Grid Is Broken: Why Test-Time Compute Has Outrun How We Score ModelsHost Sarah Guo, Elad GilOpenAI researcher Noam Brown argues that static leaderboards hide how long a model is allowed to think — and that safety evals, research taste, and the release cycle have not caught up.
42:27ENEvery Company Can Operate at the Frontier — If It Owns the EvalsHost Sarah Guo, Elad GilAt Microsoft Build, Satya Nadella tells No Priors and Latent Space why AI is an ecosystem game, why private evals beat public benchmarks, and why the Azure networking team now asks for tokens instead of headcount.
39:48EN400,000 Customers, 20,000 APIs: SAP's CTO on the Hard Exam of Enterprise AIHost Sarah Guo, Elad GilPhilipp Herzig tells No Priors how SAP is rebuilding the company operating system for AI, and why scale, evals, and pricing will decide who wins.
42:12ENHire the AI First: Andrew Ng on Agentic Workflows and the Scarcity of JudgmentHost Sarah Guo, Elad GilOn No Priors, Andrew Ng argues that agentic AI has made software cheap and fast, which moves the bottleneck to product judgment, error analysis, and the instinct to try an AI before adding headcount.
1:02:54ENEnterprise Coding Tools Flipped the 80/20. Reflection AI Built the Other HalfHost Sarah Guo, Elad GilFormer Gemini reward-model lead Misha Laskin on Asimov, why comprehension beats generation, and why there is no such thing as generalization—only pulling the test distribution into train.
42:09ENAlphaEvolve found algorithms humans missed for 50 years — then sped up Gemini 23%Host Sarah Guo, Elad GilGoogle DeepMind’s Pushmeet Kohli and Matej Balog tell No Priors how an evolutionary coding agent searches algorithm space the way AlphaGo searched Go.
30:46ENDeep Research Turned Web Browsing into a Trainable ProblemHost Sarah Guo, Elad GilOpenAI researcher Isa Fulford explains why a side project on read-only synthesis became an agent, when reinforcement fine-tuning is worth it, and why models will hack the search engine you gave them.
41:52ENMercor Hit $100 Million ARR Teaching Models to Hire. Humans Now Write the Exams.Host Sarah Guo, Elad GilBrendan Foody tells Sarah Guo and Elad Gil how Mercor automated recruiting for frontier labs — and why building evals may become the world's most common knowledge job.
36:24ENThe Man Behind Humanity's Last Exam Says Superintelligence Strategy Should Copy NukesHost Sarah Guo, Elad GilDan Hendrycks tells No Priors that labs can only do basic anti-terror refusals, while the real risk-management problem is a geopolitical deterrent he calls mutually assured AI malfunction.
30:09ENBilt Saved 65 Support Seats. Decagon's Founder Says Most Agent Ideas Still Won't SellHost Sarah Guo, Elad GilJesse Zhang on why customer support is the golden agent use case, why instruction following beats o1-style reasoning, and the two filters that kill most agent startups.
44:30EN100,000 Rides a Week, Six Times Fewer Airbag Crashes: Waymo’s Co-CEO on Eighteen Years of Full AutonomyHost Sarah Guo, Elad GilDmitri Dolgov tells No Priors how a dozen Googlers, ten 100-mile routes, and a 2013 refusal to settle for driver assist became a rider-only service with an insurer-audited safety record.
38:28ENHalf of Production AI Is RAG. Fine-Tuning Almost Disappeared.Host Sarah Guo, Elad GilBraintrust CEO Ankur Goyal tells No Priors what Notion, Zapier, and Vercel actually ship — and which hyped techniques they quietly dropped.
39:00ENJPMorgan Has 150 Petabytes. GPT-4 Trained on Less Than One.Host Sarah Guo, Elad GilScale AI founder Alexandr Wang tells No Priors why easy internet data is exhausted, why expert-plus-model teams still win, and why the path to AGI looks more like curing cancer than inventing a vaccine.
32:48ENFourteen People, $200 Million of Compute, and the Reliability Bottleneck for AgentsHost Sarah Guo, Elad GilImbue co-founders Kanjun Qiu and Josh Albrecht on why agents fail, why language models cannot learn general algorithms, and why they are spending a giant round on GPUs rather than headcount.
39:45ENPalantir's 13th Employee: The Model Is a Stochastic Genie. Ontology Is the Stake That Tethers ItHost Sarah Guo, Elad GilCTO Shyam Sankar on 550 microservices, air-gapped submarines, and why Palantir's ontology is what large language models were waiting for.
42:18ENTen Percent of Search Is Health — and the Doctor Is Googling TooHost Sarah Guo, Elad GilGoogle researcher Karan Singhal on Med-PaLM 2, the real bar for medical language models, and why medicine is a harder alignment lab than chatbots.
1:13:06ENLockheed Martin's CTO on Autonomy, the Moon, and the Culture of Not Getting It WrongGuest Keoki Jackson · Host Lex FridmanKeoki Jackson tells Lex Fridman why going back to the Moon is the easy part—and why proving a learning system will still do the right thing is not.
1:31:41ENThe Worst Model You'll Ever Use: Kevin Weil on Building Products at OpenAI's PaceGuest Kevin Weil · Host Lenny RachitskyOpenAI's chief product officer explains how evals, light planning, fine-tuned model ensembles and a small PM team shape the way the company ships.
1:22:36ENStop Chasing AI News: Chip Huyen on What Actually Makes AI Products BetterGuest Chip Huyen · Host Lenny RachitskyAuthor of AI Engineering walks through pre-training, post-training, RL, evals and RAG, then explains what separates companies that get value from AI from those that stall.
1:07:08ENIf the Model Is the Product, the Eval Is the PRD: Inside Mercor's RiseGuest Brendan Foody · Host Lenny RachitskyMercor CEO Brendan Foody explains why AI labs will pay almost anything for expert-written evals, how his company grew from $1 million to a $400 million run rate in 16 months, and what that means for jobs and founders.
1:16:17ENFaster, But for What? Nicole Forsgren on Measuring Developer Productivity in the AI EraGuest Nicole Forsgren · Host Lenny RachitskyThe creator of DORA and SPACE explains why most productivity metrics mislead, how AI changes flow and trust, and how to build a developer experience program that proves its value.









