Results
55 articlesSort
1:18:32EN
Cognitive Revolution "How AI Changes Everything"· Sep 20, 2024PodcastA DNA Model That Can Tell Which Genes You Cannot TouchHost Nathan LabenzStanford's Brian Hie walks through hybrid architectures, a genome-scale language model trained only on DNA, and an antibody that binds 25 times tighter than nature.
49:14EN
Sequoia Capital· Sep 17, 2024PodcastHumanoid robots fell from $1.5 million to $30,000. The GPT-3 moment is still a verbNvidia’s Jim Fan tells Sequoia how three kinds of data, a humanoid bet, and a System-1 motor-control model could unlock general-purpose robots.
44:16EN
No Priors: AI, Machine Learning, Tech, & Startups· Sep 5, 2024Podcast · 2 speakersA perfect demo is ten years from a product you can pay forHost Sarah Guo, Elad GilAndrej Karpathy uses Waymo's decade-long gap, Tesla's software bet, and a new AI course to argue that autonomous intelligence will stall at product and globalization, not at the first impressive clip.
1:23:57ENCognitive Revolution "How AI Changes Everything"· Sep 4, 2024PodcastA Training Run Is a Particle Collider—and the China Contest Is a Fifty-Year RaceHost Nathan LabenzSamo Burja tells Nathan Labenz why ChatGPT's virality may have slowed AI science, and why Washington should treat Beijing as an economic rival rather than a military one.
42:42ENNo Priors: AI, Machine Learning, Tech, & Startups· Aug 22, 2024Podcast · 2 speakersEthereum Once Held Two Thousand GPT-3 Clusters of GPUsHost Sarah Guo, Elad GilFoundry CEO Jared Quincy Davis on idle H100s, why today's AI cloud is still colocation, and how compound systems move work off giant interconnected clusters.
46:09ENNo Priors: AI, Machine Learning, Tech, & Startups· Aug 1, 2024Podcast · 2 speakersOriol Vinyals: The Days of Burning 90% of Compute on Pretraining Are NumberedHost Sarah Guo, Elad GilGoogle DeepMind’s VP of research on Gemini, long context, the coming shift from pretraining to RL, and why AGI may never have a finish line.
42:08ENSequoia Capital· Jul 30, 2024PodcastMeta Trained a 405B Teacher on 16,000 GPUs — Then Told the World to Distill ItTwo days after Llama 3.1 405B shipped, Meta's generative-AI product lead walks Sequoia through why the most expensive model in the family is free, and why he thinks the frontier itself is heading toward commodity.
1:00:28ENSequoia Capital· Jul 9, 2024PodcastScaling Laws Aren't Done. Don't Lock Yourself Into Yesterday's Architecture.Microsoft CTO Kevin Scott on why the exponential is still compounding, why inference will dwarf training, and why a language model is the world's crappiest database.
55:13ENSequoia Capital· Jul 2, 2024PodcastThe Best AI Scores 39% on This Test. Zapier’s Co-Founder Put $1 Million on Beating ItFrançois Chollet designed ARC to measure skill-acquisition efficiency; five years later humans still crush it and frontier models do not.
1:01:55ENCognitive Revolution "How AI Changes Everything"· Jun 1, 2024PodcastA $9 AI nurse, an 86 on the medical boards, and a 10% extinction lineHost Nathan LabenzNathan Labenz’s solo scouting report walks from medical state of the art through how models actually learn, then to live players, scaling trends, and a control plan that still does not exist.
29:09ENNo Priors: AI, Machine Learning, Tech, & Startups· May 9, 2024Podcast · 2 speakersThe Hyperscalers Are Spending $200 Billion — and the Next Bottleneck Is a Power PlantHost Sarah Guo, Elad GilSarah Guo and Elad Gil walk through music models, on-device LLMs, long context, and why AI capex now sits beside oil and broadband.
31:24ENNo Priors: AI, Machine Learning, Tech, & Startups· Apr 25, 2024Podcast · 2 speakersSora's Leads: A Minute of HD Video Is Just the GPT-1 of Video ModelsHost Sarah Guo, Elad GilAditya Ramesh, Tim Brooks, and Bill Peebles tell No Priors why text-to-video sits on the path to AGI, why they started from scratch instead of extending an image generator, and why they still have no product date.
1:01:39ENCognitive Revolution "How AI Changes Everything"· Apr 13, 2024PodcastGPT-5 Wants 100 Trillion Tokens. Does Earth Have Enough?Host Nathan LabenzTraining GPT-3 took about a trillion tokens; GPT-4 took about ten trillion. The next jump is a data question as much as a compute one.
40:58ENNo Priors: AI, Machine Learning, Tech, & Startups· Jan 25, 2024Podcast · 2 speakers99% of Factory Robots Are Dumb. Covariant Wants the Smart Ones Working in Warehouses FirstHost Sarah Guo, Elad GilFormer OpenAI researcher Peter Chen explains why robot foundation models have to be trained on production floors, not in labs.
32:57ENNo Priors: AI, Machine Learning, Tech, & Startups· Nov 9, 2023Podcast · 2 speakersA 7-billion-parameter model on a MacBook: Mistral's CEO reruns the cost of AIHost Sarah Guo, Elad GilArthur Mensch tells No Priors why Chinchilla made small models valuable, why open-sourcing Mistral 7B is not a bioweapon risk, and why guardrails belong on the application.
41:58ENNo Priors: AI, Machine Learning, Tech, & Startups· Nov 2, 2023Podcast · 2 speakersReliability is the bottleneck. Autonomy is what would make AI feel alive.Host Sarah Guo, Elad GilIlya Sutskever talks with Sarah Guo and Elad Gil about AlexNet, OpenAI’s capped-profit bet, why smaller models mainly lose reliability, and the line he draws for digital life.
1:19:52ENCognitive Revolution "How AI Changes Everything"· Oct 18, 2023Podcast1,000 H100s Take 115 Days; 22,000 Take FiveHost Nathan LabenzNathan Labenz and Trey Kollmer walk through cluster math that turns GPT-4-scale training into a weekly experiment, then four papers on search-augmented models, recursive code improvers, spatial maps inside Llama 2, and what networks do when they have no idea.
30:03ENNo Priors: AI, Machine Learning, Tech, & Startups· Sep 7, 2023Podcast · 2 speakersA Dinner-Plate Chip Cut Training From 60 Days to 3.5Host Sarah Guo, Elad GilCerebras CEO Andrew Feldman tells No Priors why wafer-scale silicon, not another GPU, is the answer to the compute crunch — and why most production models will stay at 13 billion parameters or below.
1:33:56ENCognitive Revolution "How AI Changes Everything"· Jul 6, 2023PodcastThe AI Scouting Report: 90 Minutes From GPT-4's Exam Scores to Whether Models UnderstandHost Nathan LabenzNathan Labenz spends a solo episode walking through what general-purpose models can do, how they are trained, how capabilities unlock, and whether they understand anything at all.
1:32:22ENCognitive Revolution "How AI Changes Everything"· Jun 29, 2023PodcastA Million Bytes and 256 Symbols: Meta's MEGABYTE Wants to Throw the Tokenizer AwayHost Nathan LabenzLili Yu of Meta AI explains a multiscale transformer that predicts million-byte sequences, skips tokenization, and aims to model any file as raw bytes.
40:25ENNo Priors: AI, Machine Learning, Tech, & Startups· Apr 6, 2023Podcast · 2 speakersA 6-Billion-Parameter Clone of ChatGPT’s Core TrickHost Sarah Guo, Elad GilDatabricks CTO Matei Zaharia tells Sarah Guo and Elad Gil how Dolly learned instruction-following on fifty times less data than GPT-3 — and why he would rather look facts up than bake them into a trillion-parameter network.
45:03ENNo Priors: AI, Machine Learning, Tech, & Startups· Feb 16, 2023Podcast · 2 speakersEmad Mostaque’s bet: open small models, not one giant brainHost Sarah Guo, Elad GilStability AI’s founder tells No Priors why foundation models should be public infrastructure, why small models can beat giant ones, and what that means for media, medicine, and AGI.
1:00:36ENNo Priors: AI, Machine Learning, Tech, & Startups· Feb 2, 2023Podcast · 2 speakersForty games of Diplomacy, and nobody spotted the bot: Noam Brown’s 100,000x lessonHost Sarah Guo, Elad GilMeta’s Noam Brown tells Sarah Guo and Elad Gil how Cicero negotiated in English for 40 games on a tiny web community — and why thinking at decision time beat three years of scaling.
1:36:11EN
Lex Fridman· Sep 17, 2022Podcast · 2 speakers2029 Passes the Turing Test. 2045 Is Still the SingularityGuest Ray Kurzweil · Host Lex FridmanRay Kurzweil tells Lex Fridman why his dates have not moved, how to invent in the present tense, and why the replica of his father answered the meaning of life with one word: love.Load moreShowing 24 of 55