Recently updated channels

Pick one to see only that channelBrowse all channels →
Matthew Bermanyesterday +478Theo - t3․ggyesterday +33AI Engineeryesterday +6The Buildersyesterday +1a16zyesterday +2硅谷101yesterday +1SemiAnalysisyesterday +1Chris WilliamsonyesterdayCheeky PintyesterdayInvest Like The Bestyesterday

Results

10 articles
Sort
Content typeExplainersTopicQuantizationPersonMatthew Berman
3 slides5:27EN
Matthew Berman· Jan 29, 2025Ways to Try DeepSeek R1: Hosted and Local Distilled ModelsMatthew Berman · Forward FutureMatthew Berman demonstrates DeepSeek chat, Groq’s hosted distill and a local model in LM Studio.Local inferenceOpen-weight modelsQuantization
4 slides9:53EN
Matthew Berman· May 28, 2024Testing Microsoft Phi-3 Medium Locally: Mixed Coding and Reasoning ResultsMatthew Berman · Forward FutureMatthew Berman runs a quantized Phi-3 Medium on a MacBook and explores coding, arithmetic and reasoning prompts.Open-weight modelsLocal inferenceBenchmarks+1
8 slides13:19EN
Matthew Berman· Jan 18, 2024Running a Local Language Model as an Offline BackupMatthew Berman · Forward FutureMatthew Berman demonstrates a 2024 local-model setup, from selecting a quantized model and storing it on an external drive to planning backup power.Local inferenceFoundation ModelsInfrastructure & deployment+1
4 slides7:48EN
Matthew Berman· Nov 26, 2023Testing Dolphin 2.2 Yi 34B on Coding and Reasoning TasksMatthew Berman · Forward FutureMatthew Berman runs a quantized Yi fine-tune through informal coding, writing and logic prompts in November 2023, with uneven results.Open-weight modelsFoundation ModelsBenchmarks+2
3 slides6:11EN
Matthew Berman· Aug 31, 2023Running WizardCoder Locally with Text Generation WebUIMatthew Berman · Forward FutureMatthew Berman walks through a 2023 setup for a quantized Code Llama-based coding model, from the Python environment to a simple test prompt.Local inferenceCoding agentsOpen-weight models+1
4 slides7:21EN
Matthew Berman· Jun 26, 2023Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.Open-weight modelsEvalsDistillation+2
4 slides13:50EN
Matthew Berman· Jun 23, 2023MPT-30B: Running MosaicML’s Model Locally and Testing Its Chat VariantMatthew Berman · Forward FutureMatthew Berman reviews MosaicML’s June 2023 release, demonstrates a local setup, and puts the hosted chat model through an informal prompt rubric.Open-weight modelsLocal inferenceQuantization+2
3 slides8:51EN
Matthew Berman· Jun 2, 2023Falcon 40B: A 2023 Leaderboard Result and a Slow GPU TestMatthew Berman · Forward FutureMatthew Berman tries a quantized Falcon 40B Instruct checkpoint on a hosted GPU and finds useful output but slow generation.Open-weight modelsFoundation ModelsLocal inference+1
4 slides11:42EN
Matthew Berman· May 31, 2023Guanaco and QLoRA: A 2023 Fine-Tuning and Model TestMatthew Berman · Forward FutureMatthew Berman reviews the QLoRA paper, explains the reported memory savings and tries Guanaco 65B on an informal prompt set.Fine-tuningQuantizationOpen-weight models+1
2 slides7:51EN
Matthew Berman· May 30, 2023Running Guanaco 65B on a Cloud GPU with Runpod and Text Generation Web UIMatthew Berman · Forward FutureMatthew Berman demonstrates a 2023 workflow for renting a GPU, loading a quantized model and generating text. Model requirements, pricing and interfaces depend on the chosen version.Local inferenceInfrastructure & deploymentOpen-weight models+2