최근 업데이트된 채널

선택하면 해당 채널만 표시모든 채널 보기 →

필터 결과

8개
정렬
슬라이드 3장5:27EN
Matthew Berman· 2025년 1월 29일Ways to Try DeepSeek R1: Hosted and Local Distilled ModelsMatthew Berman · Forward FutureMatthew Berman demonstrates DeepSeek chat, Groq’s hosted distill and a local model in LM Studio.Local inferenceOpen-weight modelsQuantization
슬라이드 4장9:53EN
Matthew Berman· 2024년 5월 28일Testing Microsoft Phi-3 Medium Locally: Mixed Coding and Reasoning ResultsMatthew Berman · Forward FutureMatthew Berman runs a quantized Phi-3 Medium on a MacBook and explores coding, arithmetic and reasoning prompts.Open-weight modelsLocal inferenceBenchmarks+1
슬라이드 8장13:19EN
Matthew Berman· 2024년 1월 18일Running a Local Language Model as an Offline BackupMatthew Berman · Forward FutureMatthew Berman demonstrates a 2024 local-model setup, from selecting a quantized model and storing it on an external drive to planning backup power.Local inferenceFoundation Models인프라와 배포+1
슬라이드 4장7:48EN
Matthew Berman· 2023년 11월 26일Testing Dolphin 2.2 Yi 34B on Coding and Reasoning TasksMatthew Berman · Forward FutureMatthew Berman runs a quantized Yi fine-tune through informal coding, writing and logic prompts in November 2023, with uneven results.Open-weight modelsFoundation ModelsBenchmarks+2
슬라이드 3장6:11EN
Matthew Berman· 2023년 8월 31일Running WizardCoder Locally with Text Generation WebUIMatthew Berman · Forward FutureMatthew Berman walks through a 2023 setup for a quantized Code Llama-based coding model, from the Python environment to a simple test prompt.Local inference코딩 에이전트Open-weight models+1
슬라이드 4장7:21EN
Matthew Berman· 2023년 6월 26일Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.Open-weight models평가(Evals)Distillation+2
슬라이드 3장8:51EN
Matthew Berman· 2023년 6월 2일Falcon 40B: A 2023 Leaderboard Result and a Slow GPU TestMatthew Berman · Forward FutureMatthew Berman tries a quantized Falcon 40B Instruct checkpoint on a hosted GPU and finds useful output but slow generation.Open-weight modelsFoundation ModelsLocal inference+1
슬라이드 4장11:42EN
Matthew Berman· 2023년 5월 31일Guanaco and QLoRA: A 2023 Fine-Tuning and Model TestMatthew Berman · Forward FutureMatthew Berman reviews the QLoRA paper, explains the reported memory savings and tries Guanaco 65B on an informal prompt set.파인튜닝QuantizationOpen-weight models+1