Results
15 articlesSort
32:20ENWho Is Local AI For? The Costs, Trade-offs and a Hybrid FutureMatthew Berman · Forward FutureMatthew Berman weighs data control and independence against hardware cost, setup complexity and inference speed.
9:15ENSix Open-Source Projects for Local AI, Agents, and 3D DesignMatthew Berman · Forward FutureMatthew Berman tours tools for running and training models, giving agents new skills, coordinating work, browsing, and generating 3D meshes.
9:47ENGemma 4: Smaller Open-Weight Models for Local AIMatthew Berman · Forward FutureMatthew Berman reviews Google’s model sizes, multimodal features and reported benchmarks, with an eye toward local agents.
18:09ENTraining a GPT-OSS 2048 Strategy With Verifiable RewardsMatthew Berman · Forward FutureMatthew Berman walks through a local Unsloth notebook, reward checks and one 2048 training run on an RTX 5090.
5:27ENWays to Try DeepSeek R1: Hosted and Local Distilled ModelsMatthew Berman · Forward FutureMatthew Berman demonstrates DeepSeek chat, Groq’s hosted distill and a local model in LM Studio.
0:28ENComparing Three Local Coding ModelsMatthew Berman · Forward FutureMatthew Berman introduces a sponsored comparison of DeepSeek Coder V2, Yi-Coder and Qwen Coder running on a workstation.
19:03ENAI News in October 2024: Apple Intelligence, Coding Assistants, Search, and AgentsMatthew Berman · Forward FutureMatthew Berman reviews the first Apple Intelligence release, new coding tools, AI search disputes, local models, and reports of browser agents.
9:15ENLlama 3.2 Adds Vision and Smaller On-Device ModelsMatthew Berman · Forward FutureIn a Meta-partnered 2024 video, Matthew Berman reviews the model family, its tooling and a brief hosted 1B demonstration.
13:18ENTesting Local AI on a Dual RTX 6000 WorkstationMatthew Berman · Forward FutureMatthew Berman tests language models, concurrent inference, and image generation on a Dell Precision tower supplied by Dell and NVIDIA.
9:53ENTesting Microsoft Phi-3 Medium Locally: Mixed Coding and Reasoning ResultsMatthew Berman · Forward FutureMatthew Berman runs a quantized Phi-3 Medium on a MacBook and explores coding, arithmetic and reasoning prompts.
9:25ENMatthew Berman Tests Meta’s Code Llama 70B on a Snake GameMatthew Berman · Forward FutureA 2024 look at Meta’s coding-model release, a SQL-focused fine-tune and a hands-on test that did not work on the first attempt.
0:42ENLLaVA 1.6 Adds Higher-Resolution Image UnderstandingMatthew Berman · Forward FutureMatthew Berman reviews the January 2024 release of LLaVA 1.6 and its local availability through Ollama.
5:53ENPetals: Distributing Large Language Model Inference Across DevicesMatthew Berman · Forward FutureIn 2023, Matthew Berman explains Petals as a way to use large models through a network of participating computers rather than loading every layer on one device.
4:36ENTesting WizardCoder 15B as a Local Coding AssistantMatthew Berman · Forward FutureMatthew Berman runs the 2023 WizardCoder model locally, testing small Python exercises and a longer Snake game.
10:40ENTesting Nous Hermes 13B Locally: Mixed Reasoning and Unsafe ResponsesMatthew Berman · Forward FutureMatthew Berman compares a 2023 quantized model on hosted and local hardware, with uneven results across coding, logic and safety.