최근 업데이트된 채널

선택하면 해당 채널만 표시모든 채널 보기 →

필터 결과

5개
정렬
슬라이드 3장5:27EN
Matthew Berman· 2025년 1월 29일Ways to Try DeepSeek R1: Hosted and Local Distilled ModelsMatthew Berman · Forward FutureMatthew Berman demonstrates DeepSeek chat, Groq’s hosted distill and a local model in LM Studio.Local inferenceOpen-weight modelsQuantization
슬라이드 8장13:19EN
Matthew Berman· 2024년 1월 18일Running a Local Language Model as an Offline BackupMatthew Berman · Forward FutureMatthew Berman demonstrates a 2024 local-model setup, from selecting a quantized model and storing it on an external drive to planning backup power.Local inferenceFoundation Models인프라와 배포+1
슬라이드 3장6:11EN
Matthew Berman· 2023년 8월 31일Running WizardCoder Locally with Text Generation WebUIMatthew Berman · Forward FutureMatthew Berman walks through a 2023 setup for a quantized Code Llama-based coding model, from the Python environment to a simple test prompt.Local inference코딩 에이전트Open-weight models+1
슬라이드 4장7:21EN
Matthew Berman· 2023년 6월 26일Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.Open-weight models평가(Evals)Distillation+2
슬라이드 3장8:51EN
Matthew Berman· 2023년 6월 2일Falcon 40B: A 2023 Leaderboard Result and a Slow GPU TestMatthew Berman · Forward FutureMatthew Berman tries a quantized Falcon 40B Instruct checkpoint on a hosted GPU and finds useful output but slow generation.Open-weight modelsFoundation ModelsLocal inference+1