Results
195 articlesSort
0:58EN
Matthew Berman· Jul 11, 2024NVIDIA NIM: Containerized AI Inference MicroservicesMatthew Berman · Forward FutureA sponsored overview of NVIDIA’s approach to packaging model inference for local and cloud applications.
0:53ENMatthew Berman· Jun 7, 2024NVIDIA’s Computex Keynote: Digital Humans, Weather and RoboticsMatthew Berman · Forward FutureMatthew Berman briefly reviews Jensen Huang’s announcements on AI-generated characters, weather modeling, Blackwell hardware and factory robots.
0:59ENMatthew Berman· Jun 6, 2024NVIDIA’s Computex 2024 AI AnnouncementsMatthew Berman · Forward FutureMatthew Berman reviews gaming assistants, digital characters, AI laptops and developer tools in an NVIDIA partner video.
1:13:59ENMatthew Berman· Jun 5, 2024Jensen Huang’s Computex 2024 Vision: NIM, Blackwell and Physical AIMatthew Berman, Jensen Huang · Forward FutureMatthew Berman presents NVIDIA’s keynote on AI infrastructure, digital humans, weather simulation and robot factories, with the demonstrations and vendor claims in context.
31:04EN
Cognitive Revolution "How AI Changes Everything"· Jun 4, 2024PodcastThe Risk Is Not China Copying. It Is America Refusing to Use the ToolsHost Nathan LabenzAt the 2024 Hill & Valley Forum, Alex Wang, Jack Clark, and Andrew Ng tell Senator Cory Booker that Chinese labs are inventing, open-source models are already strong, and the Pentagon’s real AI failure is under-adoption.
39:00EN
No Priors: AI, Machine Learning, Tech, & Startups· May 22, 2024Podcast · 2 speakersJPMorgan Has 150 Petabytes. GPT-4 Trained on Less Than One.Host Sarah Guo, Elad GilScale AI founder Alexandr Wang tells No Priors why easy internet data is exhausted, why expert-plus-model teams still win, and why the path to AGI looks more like curing cancer than inventing a vaccine.
29:09ENNo Priors: AI, Machine Learning, Tech, & Startups· May 9, 2024Podcast · 2 speakersThe Hyperscalers Are Spending $200 Billion — and the Next Bottleneck Is a Power PlantHost Sarah Guo, Elad GilSarah Guo and Elad Gil walk through music models, on-device LLMs, long context, and why AI capex now sits beside oil and broadband.
1:52:18ENCognitive Revolution "How AI Changes Everything"· May 6, 2024PodcastTwo Weeks, Thirty Compiles: How Adam Majmudar Wrote a GPU From ScratchHost Nathan LabenzA Cognitive Revolution walkthrough of TinyGPU, from SIMD kernels and memory latency to an open-source chip flow that runs on a laptop.
1:42:17ENCognitive Revolution "How AI Changes Everything"· Apr 20, 2024PodcastThe Cheapest Inference Provider Is the Most DangerousHost Nathan LabenzFireworks AI cofounders Lin Qiao and Dmytro Ivchenko explain why subsidized GPU bills vanish, how LoRA serving can cut cost a hundredfold, and why OpenAI is the rival that actually matters.
12:37ENMatthew Berman· Apr 2, 2024The Reported Stargate Supercomputer and AI’s Compute BottleneckMatthew Berman, Sam Altman, Elon Musk · Forward FutureIn April 2024, Matthew Berman examines a reported Microsoft–OpenAI data-center proposal and argues that chips and electricity could shape the AI industry.
51:11ENMatthew Berman· Mar 22, 2024Inside Groq’s LPU: Compilers, Chip Networks and Fast InferenceMatthew Berman, Andrew Ling, Igor Arsovski · Forward FutureGroq engineers Andrew Ling and Igor Arsovski explain their hardware and software design in a sponsored 2024 interview.
38:33ENNo Priors: AI, Machine Learning, Tech, & Startups· Mar 21, 2024Podcast · 2 speakersSpeed Is the Thing You Can Buy: Baseten’s Bet on InferenceHost Sarah Guo, Elad GilTuhin Srivastava tells Sarah Guo and Elad Gil why a six-person chatbot company running a billion tokens a day should not be building its own serving stack.
42:14ENNo Priors: AI, Machine Learning, Tech, & Startups· Mar 7, 2024Podcast · 2 speakersMeta’s $197 Billion Day Was a Partial Answer to AI’s $200 Billion QuestionHost Sarah Guo, Elad GilSarah Guo and Elad Gil walk through Gemini, Mistral, NVIDIA’s upgrade cycle, Klarna’s support bot, and why the real AI spend still sits with the hyperscalers.
15:58ENMatthew Berman· Mar 2, 2024Elon Musk on Self-Driving, AI Compute and Electricity ConstraintsElon Musk, Matthew Berman · TeslaA 2024 Bosch interview and Matthew Berman’s commentary explore autonomous vehicles, robots and the infrastructure needed for AI.
39:03ENNo Priors: AI, Machine Learning, Tech, & Startups· Feb 29, 2024Podcast · 2 speakersMI300 Leads Inference by 2x: AMD's CTO on Winning Chip Competition Without a Walled GardenHost Sarah Guo, Elad GilWhen Mark Papermaster became AMD's CTO in fall 2011, nearly all of the company's revenue sat on PCs and gaming, Moore's Law was slowing, and everyone knew it needed a turnaround.
13:19ENMatthew Berman· Jan 18, 2024Running a Local Language Model as an Offline BackupMatthew Berman · Forward FutureMatthew Berman demonstrates a 2024 local-model setup, from selecting a quantized model and storing it on an external drive to planning backup power.
3:37ENMatthew Berman· Jan 18, 2024Mark Zuckerberg Announces Llama 3 Training and Meta’s AI PlansMatthew Berman, Mark Zuckerberg · Forward FutureIn January 2024, Matthew Berman reacts to Zuckerberg’s remarks on general intelligence, compute and AI devices.
39:36ENNo Priors: AI, Machine Learning, Tech, & Startups· Dec 14, 2023Podcast · 2 speakersThe Most Underestimated AI Buyer Is the Shop on the CornerHost Sarah Guo, Elad GilFormer Square CEO Alyssa Henry tells No Priors that generative AI is unlocking work small merchants always needed and never paid anyone to do.
55:34EN
Jane Street· Nov 29, 2023Andrew Hunter on Performance Engineering for Low-Latency SystemsYaron Minsky, Andrew Hunter · Jane StreetWhy small optimizations pay at hyperscale, why trading latency is harder to measure, and how profiling, tracing, language design and hardware fit together.
1:19:52ENCognitive Revolution "How AI Changes Everything"· Oct 18, 2023Podcast1,000 H100s Take 115 Days; 22,000 Take FiveHost Nathan LabenzNathan Labenz and Trey Kollmer walk through cluster math that turns GPT-4-scale training into a weekly experiment, then four papers on search-augmented models, recursive code improvers, spatial maps inside Llama 2, and what networks do when they have no idea.
7:02ENMatthew Berman· Oct 18, 2023Connecting AutoGen to a RunPod-Hosted Model with Text Generation WebUIMatthew Berman · Forward FutureIn a 2023 walkthrough, Matthew Berman connects AutoGen to Dolphin 2.1 Mistral 7B through an OpenAI-compatible API and tests a small coding task.
4:42ENMatthew Berman· Oct 17, 2023Connecting AutoGen to a Local Model With LM StudioMatthew Berman · Forward FutureMatthew Berman demonstrates an early local-model setup and explains where agent behavior still needs work.
30:03ENNo Priors: AI, Machine Learning, Tech, & Startups· Sep 7, 2023Podcast · 2 speakersA Dinner-Plate Chip Cut Training From 60 Days to 3.5Host Sarah Guo, Elad GilCerebras CEO Andrew Feldman tells No Priors why wafer-scale silicon, not another GPU, is the answer to the compute crunch — and why most production models will stay at 13 billion parameters or below.
38:13ENNo Priors: AI, Machine Learning, Tech, & Startups· Aug 31, 2023Podcast · 2 speakersChatGPT Runs on His Framework. He Still Doesn't Want You Training a ModelHost Sarah Guo, Elad GilVercel founder Guillermo Rauch tells No Priors why frontend is the last mile of AI, why first-generation AI frameworks will be rewritten, and why bots are already stealing your tokens.Load moreShowing 24 of 195