絞り込み結果
12 件並び順
17:42EN
AI Engineer· 2026年10月21日Is a Faster Model Actually Faster? Measure the Finished Job, Not the TokensMorgan Suo · MiniMaxMiniMax's Morgan Suo takes the engineering changes inside M3.1 Flash one by one and asks the question that matters to users: does the job an analyst needs actually get done sooner, cheaper and correctly?
59:06EN
Unsupervised Learning: With Jacob Effron· 2025年9月10日ポッドキャストInference Costs Fell 100x. Tri Dao Says There's Another 10x — and NVIDIA's 90% Won't Holdホスト Jacob EffronThe FlashAttention author and Together AI chief scientist on why hardware portability is a myth, how Claude Code made him 1.5x faster, and why workloads will split the chip market.
5:27EN
Matthew Berman· 2025年1月29日Ways to Try DeepSeek R1: Hosted and Local Distilled ModelsMatthew Berman · Forward FutureMatthew Berman demonstrates DeepSeek chat, Groq’s hosted distill and a local model in LM Studio.
9:53ENMatthew Berman· 2024年5月28日Testing Microsoft Phi-3 Medium Locally: Mixed Coding and Reasoning ResultsMatthew Berman · Forward FutureMatthew Berman runs a quantized Phi-3 Medium on a MacBook and explores coding, arithmetic and reasoning prompts.
13:19ENMatthew Berman· 2024年1月18日Running a Local Language Model as an Offline BackupMatthew Berman · Forward FutureMatthew Berman demonstrates a 2024 local-model setup, from selecting a quantized model and storing it on an external drive to planning backup power.
7:48ENMatthew Berman· 2023年11月26日Testing Dolphin 2.2 Yi 34B on Coding and Reasoning TasksMatthew Berman · Forward FutureMatthew Berman runs a quantized Yi fine-tune through informal coding, writing and logic prompts in November 2023, with uneven results.
6:11ENMatthew Berman· 2023年8月31日Running WizardCoder Locally with Text Generation WebUIMatthew Berman · Forward FutureMatthew Berman walks through a 2023 setup for a quantized Code Llama-based coding model, from the Python environment to a simple test prompt.
7:21ENMatthew Berman· 2023年6月26日Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.
13:50ENMatthew Berman· 2023年6月23日MPT-30B: Running MosaicML’s Model Locally and Testing Its Chat VariantMatthew Berman · Forward FutureMatthew Berman reviews MosaicML’s June 2023 release, demonstrates a local setup, and puts the hosted chat model through an informal prompt rubric.
8:51ENMatthew Berman· 2023年6月2日Falcon 40B: A 2023 Leaderboard Result and a Slow GPU TestMatthew Berman · Forward FutureMatthew Berman tries a quantized Falcon 40B Instruct checkpoint on a hosted GPU and finds useful output but slow generation.
11:42ENMatthew Berman· 2023年5月31日Guanaco and QLoRA: A 2023 Fine-Tuning and Model TestMatthew Berman · Forward FutureMatthew Berman reviews the QLoRA paper, explains the reported memory savings and tries Guanaco 65B on an informal prompt set.
7:51ENMatthew Berman· 2023年5月30日Running Guanaco 65B on a Cloud GPU with Runpod and Text Generation Web UIMatthew Berman · Forward FutureMatthew Berman demonstrates a 2023 workflow for renting a GPU, loading a quantized model and generating text. Model requirements, pricing and interfaces depend on the chosen version.