필터 결과
21개정렬
0:22EN
Matthew Berman· 2026년 10월 18일DeepSeek's Memory Use: A Short Claim About KV CacheMatthew Berman · Forward FutureMatthew Berman links lower cache memory use to serving more tokens, but the excerpt does not state the comparison behind its figures.
0:48ENMatthew Berman· 2026년 8월 25일Matthew Berman on Earning From Idle Mac Compute With DarkbloomMatthew Berman · Forward FutureA proposed network of Apple Silicon Macs could serve AI inference, but the earnings shown are projections that depend on hardware, availability and demand.
0:24ENMatthew Berman· 2026년 1월 26일Matthew Berman Checks His Clawdbot Token CostsMatthew Berman · Forward FutureA short usage check reveals unexpectedly high model spending over two days.
1:38ENMatthew Berman· 2025년 12월 29일NVIDIA’s Groq Licensing Deal and the Inference MarketMatthew Berman · Forward FutureMatthew Berman discusses why NVIDIA licensed Groq’s inference technology and hired members of its team.
1:02ENMatthew Berman· 2025년 10월 31일Inside a Cerebras Data Center in Oklahoma CityMatthew Berman · Forward FutureMatthew Berman tours the facility and explains its wafer-scale chips, racks and cooling system.
8:47ENMatthew Berman· 2025년 9월 16일Why Identical LLM Prompts Can Produce Different Answers at Temperature ZeroMatthew Berman · Forward FutureMatthew Berman explains Thinking Machines Lab’s work on batch-invariant inference and what its reproducibility experiment actually showed.
17:51ENMatthew Berman· 2025년 8월 28일AI News in August 2025: Claude for Chrome, New Models and AI InfrastructureMatthew Berman · Forward FutureMatthew Berman reviews a browser-agent preview, model releases, reported Apple discussions and research on inference and weather.
10:01ENMatthew Berman· 2025년 2월 5일DeepSeek R1 Code Optimization and a $3 Visual Counting ExperimentMatthew Berman · Forward FutureMatthew Berman examines a human-guided coding improvement and a small reinforcement-learning experiment, then considers their implications for AI research.
30:29ENMatthew Berman· 2025년 1월 3일How Researchers Think o1-Style Reasoning Models WorkMatthew Berman · Forward FutureMatthew Berman explains a research survey of policy initialization, rewards, search and reinforcement learning, and the open questions behind reasoning models.
9:38ENMatthew Berman· 2024년 10월 15일Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.
0:54ENMatthew Berman· 2024년 9월 16일OpenAI’s o1 Preview: A First Look at Longer ReasoningMatthew Berman · Forward FutureMatthew Berman introduces the o1-preview and o1-mini models and tries a Python game prompt.
0:44ENMatthew Berman· 2024년 8월 29일NVIDIA Adds Multi-LoRA Serving to Its RTX AI ToolkitMatthew Berman · Forward FutureIn an NVIDIA-partnered video, Matthew Berman describes using multiple adapters with one base model and a vendor-reported throughput gain.
5:50ENMatthew Berman· 2024년 7월 27일A Mixture-of-Agents Demo Using Groq and StreamlitMatthew Berman · Forward FutureMatthew Berman walks through a 2024 Groq-powered multi-agent project, from setup to inspecting its layered responses.
11:20ENMatthew Berman· 2024년 7월 1일Matthew Berman Adapts Mixture of Agents to Groq InferenceMatthew Berman · Forward FutureA 2024 tutorial changes an open-source multi-model ensemble to use Groq, then tests its interactive output and fixes a streaming error.
13:18ENMatthew Berman· 2024년 6월 20일Testing Local AI on a Dual RTX 6000 WorkstationMatthew Berman · Forward FutureMatthew Berman tests language models, concurrent inference, and image generation on a Dell Precision tower supplied by Dell and NVIDIA.
9:02ENMatthew Berman· 2024년 4월 1일Matthew Berman Tries LLM Colosseum, a Street Fighter Model BenchmarkMatthew Berman · Forward FutureA 2024 tutorial shows language models choosing fighting-game moves, explains the game-state prompt and walks through local setup.
14:11ENMatthew Berman· 2024년 3월 23일LM Studio in 2024: Local Models, Parallel Inference and a Local APIMatthew Berman · Forward FutureMatthew Berman demonstrates model downloads, hardware settings, JSON output and serving multiple local models.
12:49ENMatthew Berman· 2023년 9월 14일Falcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.
5:53ENMatthew Berman· 2023년 7월 18일Petals: Distributing Large Language Model Inference Across DevicesMatthew Berman · Forward FutureIn 2023, Matthew Berman explains Petals as a way to use large models through a network of participating computers rather than loading every layer on one device.
7:21ENMatthew Berman· 2023년 6월 26일Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.
8:17ENMatthew Berman· 2023년 6월 22일Using OpenLLM to Serve Open Models Through an APIMatthew Berman · Forward FutureMatthew Berman demonstrates a local model server, its interactive API and a Python client in a 2023 walkthrough.