Resultados
26 artículosOrdenar
56:01EN
AI Engineer· 26 oct 2026Xander Song on Evaluating Agents with Harbor and PhoenixXander Song · Arize AIArize AI engineer Xander Song explains how Harbor runs realistic agent tasks in isolated sandboxes, and how his team uses Phoenix to compare prompt changes, inspect trajectories, and test a SQL tool.
35:19ENAI Engineer· 25 oct 2026SallyAnn DeLucia: How to Write Your First AI EvalSallyAnn DeLucia · Arize AITurn an agent’s real traces into concrete pass/fail criteria, then build an LLM judge you can test, align with people, and run in production.
2:10:42EN
Cognitive Revolution "How AI Changes Everything"· 28 ago 2026PódcastThe Exam Papers Nobody AuditsPresenta: Nathan LabenzFrontier labs buy reinforcement-learning environments from a cottage industry of small vendors, and almost nobody checks whether those tests match the real work.
36:19EN
No Priors: AI, Machine Learning, Tech, & Startups· 26 jun 2026Pódcast · 2 vocesThe Benchmark Grid Is Broken: Why Test-Time Compute Has Outrun How We Score ModelsPresenta: Sarah Guo, Elad GilOpenAI researcher Noam Brown argues that static leaderboards hide how long a model is allowed to think — and that safety evals, research taste, and the release cycle have not caught up.
48:00EN
Unsupervised Learning: With Jacob Effron· 15 dic 2025PódcastA Two-Second Vote Is Training Models to Be ClickbaitPresenta: Jacob EffronSurge AI CEO Edwin Chen tells Redpoint why LMArena rewards length and emojis, how one lab's models got worse for a year, and why frontier labs are no longer on the same path.
32:59ENNo Priors: AI, Machine Learning, Tech, & Startups· 24 jul 2025Pódcast · 2 vocesA Hundred People, a Billion in Revenue, and Zero Venture MoneyPresenta: Sarah Guo, Elad GilSurge AI founder Edwin Chen on why quality human data is a poetry problem, not a bounding-box problem, and why leaderboards keep training models to write clickbait.
47:07EN
Sequoia Capital· 8 jul 2025PódcastGoodfire’s Eric Ho thinks we will decode neural nets by 2028On Sequoia’s Training Data, the interpretability founder argues that sparse autoencoders, model editing, and a third-party lab are how AI stops being grown from data and starts being designed.
40:33ENSequoia Capital· 24 jun 2025PódcastFifty People in Slack. Four Minutes to the Smoking Gun.Traversal's co-founders on turning DevOps heart attacks into agent-run root cause analysis — and why observability's second-largest software spend still leaves troubleshooting as a whodunit.
54:53ENUnsupervised Learning: With Jacob Effron· 17 jun 2025PódcastA Free Voting Board Burned $2 Million. Then It Raised $100 Million.Presenta: Jacob EffronDatabricks co-founder Ion Stoica explains why LMArena exists, why China is winning open-source models, and why reliability—not another scaling law—is still the thing holding AI back.
44:21ENUnsupervised Learning: With Jacob Effron· 4 jun 2025PódcastMercor's CEO: Knowledge Work's Next Job Is Writing EvalsPresenta: Jacob EffronBrendan Foody tells Redpoint how Mercor turned AI hiring and expert data into a $100 million round — and why he thinks a huge slice of white-collar work will become creating tests for models.
57:11ENUnsupervised Learning: With Jacob Effron· 30 ene 2025PódcastA Million Tokens Cannot Write a Good JokePresenta: Jacob EffronPrinceton's Arvind Narayanan on why agent evals mislead, inference scaling hits a wall, and AI looks more like the internet than an overnight revolution.
1:46:41ENCognitive Revolution "How AI Changes Everything"· 21 dic 2024PódcastFrontier Models Hit the 10th–40th Percentile on Real AI R&DPresenta: Nathan LabenzNeev Parikh of METR walks Nathan Labenz through REBench, a seven-task test of whether agents can do machine learning research—and what happened when one of them decided not to train.
1:23:37ENCognitive Revolution "How AI Changes Everything"· 23 oct 2024PódcastNine of the top ten research ideas were Claude'sPresenta: Nathan LabenzStanford PhD student Chenglei Si ran a blind study pitting Claude 3.5 Sonnet against more than a hundred NLP researchers on novel research ideas.
38:28ENNo Priors: AI, Machine Learning, Tech, & Startups· 8 oct 2024Pódcast · 2 vocesHalf of Production AI Is RAG. Fine-Tuning Almost Disappeared.Presenta: Sarah Guo, Elad GilBraintrust CEO Ankur Goyal tells No Priors what Notion, Zapier, and Vercel actually ship — and which hyped techniques they quietly dropped.
1:54:17ENCognitive Revolution "How AI Changes Everything"· 28 ago 2024PódcastMetaculus Flagged Covid in January 2020. Now It Is Putting AI on the Forecasting DeskPresenta: Nathan LabenzNathan Labenz talks with Metaculus CEO Deger Turan about epistemic security, a year-long bot tournament, and why a useful forecast is harder than an accurate one.
1:56:03ENCognitive Revolution "How AI Changes Everything"· 13 jul 2024PódcastHumans Near a Perfect Score. The Best AI Still Gets 39%Presenta: Nathan LabenzZapier co-founder Mike Knoop and François Chollet put $1 million on ARC-AGI, a 2019 test of sample-efficient intelligence that language models still cannot crack under a one-cent-per-puzzle budget.
55:13ENSequoia Capital· 2 jul 2024PódcastThe Best AI Scores 39% on This Test. Zapier’s Co-Founder Put $1 Million on Beating ItFrançois Chollet designed ARC to measure skill-acquisition efficiency; five years later humans still crush it and frontier models do not.
26:00ENNo Priors: AI, Machine Learning, Tech, & Startups· 11 jun 2024Pódcast · 2 vocesWhy a Zapier founder thinks AGI research has been stalled for four yearsPresenta: Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.
43:45ENNo Priors: AI, Machine Learning, Tech, & Startups· 3 ago 2023Pódcast · 2 vocesEight Years of No Growth, Then OpenAI and NVIDIA Became His CustomersPresenta: Sarah Guo, Elad GilWeights & Biases CEO Lukas Biewald tells No Priors how a labeling company with no chasm to cross funded the ML developer tools that trained most of the large language models.
44:19ENNo Priors: AI, Machine Learning, Tech, & Startups· 15 jun 2023Pódcast · 2 vocesAI Will Write Ten Times More Code. Someone Still Has to Keep It Running.Presenta: Sarah Guo, Elad GilDatadog co-founder Olivier Pomel on why faster generation moves value from writing software to understanding, securing, and operating it.
53:37ENNo Priors: AI, Machine Learning, Tech, & Startups· 9 mar 2023Pódcast · 2 voces30 models, 42 scenarios, 7 metrics: Percy Liang's public checkup for language modelsPresenta: Sarah Guo, Elad GilA PubMed-only model once led the U.S. medical licensing exam — until a system roughly 200 times larger overtook it.
2:34:20EN
Lex Fridman· 30 ago 2020Pódcast · 2 vocesIntelligence Is How Efficiently You Acquire Skills You Were Not Prepared ForInvitado: François Chollet · Presenta: Lex FridmanFrançois Chollet tells Lex Fridman why skill is not intelligence, why GPT-3 is still pattern matching, and why a grid puzzle called ARC still separates children from machines.
1:07:08EN
Lenny's PodcastPódcast · 2 vocesIf the Model Is the Product, the Eval Is the PRD: Inside Mercor's RiseInvitado: Brendan Foody · Presenta: Lenny RachitskyMercor CEO Brendan Foody explains why AI labs will pay almost anything for expert-written evals, how his company grew from $1 million to a $400 million run rate in 16 months, and what that means for jobs and founders.
1:16:17ENLenny's PodcastPódcast · 2 vocesFaster, But for What? Nicole Forsgren on Measuring Developer Productivity in the AI EraInvitado: Nicole Forsgren · Presenta: Lenny RachitskyThe creator of DORA and SPACE explains why most productivity metrics mislead, how AI changes flow and trust, and how to build a developer experience program that proves its value.Cargar másMostrando 24 de 26