Resultados
22 artículosOrdenar
0:22EN
Matthew Berman· 18 oct 2026DeepSeek's Memory Use: A Short Claim About KV CacheMatthew Berman · Forward FutureMatthew Berman links lower cache memory use to serving more tokens, but the excerpt does not state the comparison behind its figures.
0:50ENMatthew Berman· 2 sept 2026Matthew Berman on Using Idle Computers for AI InferenceMatthew Berman · Forward FutureBerman points to Darkbloom as a way to put spare computing capacity to work on AI models, while raising the question of how far distributed inference can go.
0:48ENMatthew Berman· 25 ago 2026Matthew Berman on Earning From Idle Mac Compute With DarkbloomMatthew Berman · Forward FutureA proposed network of Apple Silicon Macs could serve AI inference, but the earnings shown are projections that depend on hardware, availability and demand.
0:52ENMatthew Berman· 13 feb 2026GPT-5.3-Codex-Spark Brings Faster Coding InferenceMatthew Berman · Forward FutureMatthew Berman highlights OpenAI's smaller coding model and its use of Cerebras hardware for low-latency responses.
0:24ENMatthew Berman· 26 ene 2026Matthew Berman Checks His Clawdbot Token CostsMatthew Berman · Forward FutureA short usage check reveals unexpectedly high model spending over two days.
1:38ENMatthew Berman· 29 dic 2025NVIDIA’s Groq Licensing Deal and the Inference MarketMatthew Berman · Forward FutureMatthew Berman discusses why NVIDIA licensed Groq’s inference technology and hired members of its team.
1:02ENMatthew Berman· 31 oct 2025Inside a Cerebras Data Center in Oklahoma CityMatthew Berman · Forward FutureMatthew Berman tours the facility and explains its wafer-scale chips, racks and cooling system.
8:47ENMatthew Berman· 16 sept 2025Why Identical LLM Prompts Can Produce Different Answers at Temperature ZeroMatthew Berman · Forward FutureMatthew Berman explains Thinking Machines Lab’s work on batch-invariant inference and what its reproducibility experiment actually showed.
10:01ENMatthew Berman· 5 feb 2025DeepSeek R1 Code Optimization and a $3 Visual Counting ExperimentMatthew Berman · Forward FutureMatthew Berman examines a human-guided coding improvement and a small reinforcement-learning experiment, then considers their implications for AI research.
30:29ENMatthew Berman· 3 ene 2025How Researchers Think o1-Style Reasoning Models WorkMatthew Berman · Forward FutureMatthew Berman explains a research survey of policy initialization, rewards, search and reinforcement learning, and the open questions behind reasoning models.
9:38ENMatthew Berman· 15 oct 2024Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.
0:54ENMatthew Berman· 16 sept 2024OpenAI’s o1 Preview: A First Look at Longer ReasoningMatthew Berman · Forward FutureMatthew Berman introduces the o1-preview and o1-mini models and tries a Python game prompt.
0:44ENMatthew Berman· 29 ago 2024NVIDIA Adds Multi-LoRA Serving to Its RTX AI ToolkitMatthew Berman · Forward FutureIn an NVIDIA-partnered video, Matthew Berman describes using multiple adapters with one base model and a vendor-reported throughput gain.
5:50ENMatthew Berman· 27 jul 2024A Mixture-of-Agents Demo Using Groq and StreamlitMatthew Berman · Forward FutureMatthew Berman walks through a 2024 Groq-powered multi-agent project, from setup to inspecting its layered responses.
11:20ENMatthew Berman· 1 jul 2024Matthew Berman Adapts Mixture of Agents to Groq InferenceMatthew Berman · Forward FutureA 2024 tutorial changes an open-source multi-model ensemble to use Groq, then tests its interactive output and fixes a streaming error.
13:18ENMatthew Berman· 20 jun 2024Testing Local AI on a Dual RTX 6000 WorkstationMatthew Berman · Forward FutureMatthew Berman tests language models, concurrent inference, and image generation on a Dell Precision tower supplied by Dell and NVIDIA.
12:51ENMatthew Berman· 21 abr 2024Llama 3 70B on Groq: Fast Inference and an Informal Prompt TestMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and repeated prompts on Groq’s April 2024 Llama 3 service, with mixed results and several scoring caveats.
9:02ENMatthew Berman· 1 abr 2024Matthew Berman Tries LLM Colosseum, a Street Fighter Model BenchmarkMatthew Berman · Forward FutureA 2024 tutorial shows language models choosing fighting-game moves, explains the game-state prompt and walks through local setup.
12:49ENMatthew Berman· 14 sept 2023Falcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.
5:53ENMatthew Berman· 18 jul 2023Petals: Distributing Large Language Model Inference Across DevicesMatthew Berman · Forward FutureIn 2023, Matthew Berman explains Petals as a way to use large models through a network of participating computers rather than loading every layer on one device.
7:21ENMatthew Berman· 26 jun 2023Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.
8:17ENMatthew Berman· 22 jun 2023Using OpenLLM to Serve Open Models Through an APIMatthew Berman · Forward FutureMatthew Berman demonstrates a local model server, its interactive API and a Python client in a 2023 walkthrough.