絞り込み結果
126 件並び順
5:50EN
Matthew Berman· 2024年7月27日A Mixture-of-Agents Demo Using Groq and StreamlitMatthew Berman · Forward FutureMatthew Berman walks through a 2024 Groq-powered multi-agent project, from setup to inspecting its layered responses.
1:00:28EN
Sequoia Capital· 2024年7月9日ポッドキャストScaling Laws Aren't Done. Don't Lock Yourself Into Yesterday's Architecture.Microsoft CTO Kevin Scott on why the exponential is still compounding, why inference will dwarf training, and why a language model is the world's crappiest database.
1:42:16EN
Cognitive Revolution "How AI Changes Everything"· 2024年7月4日ポッドキャスト267 Papers in Seven Months: Albert Gu Explains the State Space Model Revolutionホスト Nathan LabenzThe Mamba co-author walks through five years of recurrent-model work, why selective compression beats a growing KV cache, and what Mamba 2 trades away to train faster.
11:20ENMatthew Berman· 2024年7月1日Matthew Berman Adapts Mixture of Agents to Groq InferenceMatthew Berman · Forward FutureA 2024 tutorial changes an open-source multi-model ensemble to use Groq, then tests its interactive output and fixes a streaming error.
13:18ENMatthew Berman· 2024年6月20日Testing Local AI on a Dual RTX 6000 WorkstationMatthew Berman · Forward FutureMatthew Berman tests language models, concurrent inference, and image generation on a Dell Precision tower supplied by Dell and NVIDIA.
27:37ENMatthew Berman· 2024年6月17日Leo Pekelis on Extending Llama 3 to a Million-Token ContextMatthew Berman, Leo Pekelis · Forward FutureGradient’s chief scientist explains long-context training, coding use cases, inference costs and why retrieval benchmarks tell only part of the story.
12:51ENMatthew Berman· 2024年4月21日Llama 3 70B on Groq: Fast Inference and an Informal Prompt TestMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and repeated prompts on Groq’s April 2024 Llama 3 service, with mixed results and several scoring caveats.
1:42:17ENCognitive Revolution "How AI Changes Everything"· 2024年4月20日ポッドキャストThe Cheapest Inference Provider Is the Most Dangerousホスト Nathan LabenzFireworks AI cofounders Lin Qiao and Dmytro Ivchenko explain why subsidized GPU bills vanish, how LoRA serving can cut cost a hundredfold, and why OpenAI is the rival that actually matters.
24:22ENMatthew Berman· 2024年4月4日Jonathan Ross on Groq's Inference Chips, AI Economics and Human AgencyMatthew Berman, Jonathan Ross · Forward FutureThe Groq founder explains the company's compiler-first approach and argues that inference speed could enable new applications, while discussing risks of handing decisions to AI.
9:02ENMatthew Berman· 2024年4月1日Matthew Berman Tries LLM Colosseum, a Street Fighter Model BenchmarkMatthew Berman · Forward FutureA 2024 tutorial shows language models choosing fighting-game moves, explains the game-state prompt and walks through local setup.
14:11ENMatthew Berman· 2024年3月23日LM Studio in 2024: Local Models, Parallel Inference and a Local APIMatthew Berman · Forward FutureMatthew Berman demonstrates model downloads, hardware settings, JSON output and serving multiple local models.
51:11ENMatthew Berman· 2024年3月22日Inside Groq’s LPU: Compilers, Chip Networks and Fast InferenceMatthew Berman, Andrew Ling, Igor Arsovski · Forward FutureGroq engineers Andrew Ling and Igor Arsovski explain their hardware and software design in a sponsored 2024 interview.
38:33EN
No Priors: AI, Machine Learning, Tech, & Startups· 2024年3月21日ポッドキャスト · 2 人Speed Is the Thing You Can Buy: Baseten’s Bet on Inferenceホスト Sarah Guo, Elad GilTuhin Srivastava tells Sarah Guo and Elad Gil why a six-person chatbot company running a billion tokens a day should not be building its own serving stack.
39:03ENNo Priors: AI, Machine Learning, Tech, & Startups· 2024年2月29日ポッドキャスト · 2 人MI300 Leads Inference by 2x: AMD's CTO on Winning Chip Competition Without a Walled Gardenホスト Sarah Guo, Elad GilWhen Mark Papermaster became AMD's CTO in fall 2011, nearly all of the company's revenue sat on PCs and gaming, Moore's Law was slowing, and everyone knew it needed a turnaround.
30:39ENMatthew Berman· 2024年2月25日NVIDIA’s GEAR Research, Gemini 1.5 and Fast AI InferenceMatthew Berman · Forward FutureMatthew Berman reviews embodied-agent research and a February 2024 set of AI releases and demonstrations.
0:51ENMatthew Berman· 2024年2月21日A Fast Groq Inference Demo Using MixtralMatthew Berman · Forward FutureMatthew Berman demonstrates a Python code request and explains why fast model output could matter for applications.
1:22:43ENCognitive Revolution "How AI Changes Everything"· 2024年1月9日ポッドキャストFive billion minutes of calls: why Dialpad trained its own business LLMホスト Nathan LabenzDan O’Connell on real-time speech, verticalizing the stack, and why he and Nathan Labenz disagree about when AI employees show up.
20:49ENMatthew Berman· 2023年12月12日Mixtral 8x7B: Mixture-of-Experts Architecture, Setup and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews Mistral AI’s December 2023 open-weight model, demonstrates a cloud setup and tests its coding and reasoning responses.
32:57ENNo Priors: AI, Machine Learning, Tech, & Startups· 2023年11月9日ポッドキャスト · 2 人A 7-billion-parameter model on a MacBook: Mistral's CEO reruns the cost of AIホスト Sarah Guo, Elad GilArthur Mensch tells No Priors why Chinchilla made small models valuable, why open-sourcing Mistral 7B is not a bioweapon risk, and why guardrails belong on the application.
12:49ENMatthew Berman· 2023年9月14日Falcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.
30:03ENNo Priors: AI, Machine Learning, Tech, & Startups· 2023年9月7日ポッドキャスト · 2 人A Dinner-Plate Chip Cut Training From 60 Days to 3.5ホスト Sarah Guo, Elad GilCerebras CEO Andrew Feldman tells No Priors why wafer-scale silicon, not another GPU, is the answer to the compute crunch — and why most production models will stay at 13 billion parameters or below.
52:48ENCognitive Revolution "How AI Changes Everything"· 2023年8月25日ポッドキャストOpenAI Cut Fine-Tuning 90 Percent, and Founders Crossed Llama 2 Off the Listホスト Nathan LabenzNathan Labenz and Erik Torenberg walk through GPT-3.5 Turbo fine-tuning, why self-hosting still loses on total cost, and what is actually working in code, school, and medicine.
1:01:26ENCognitive Revolution "How AI Changes Everything"· 2023年7月25日ポッドキャストAlexNet Used Two GPUs. GPT-4 Took Twenty Thousand. The Shortage Will Be Back.ホスト Nathan LabenzRun:ai CTO Ronen Dar on filling idle accelerators, why H100s can be cheaper per experiment, and why Llama 2 undercuts compute governance.
5:53ENMatthew Berman· 2023年7月18日Petals: Distributing Large Language Model Inference Across DevicesMatthew Berman · Forward FutureIn 2023, Matthew Berman explains Petals as a way to use large models through a network of participating computers rather than loading every layer on one device.もっと見る126 件中 24 件を表示