Recently updated channels

Pick one to see only that channelBrowse all channels →

Results

27 articles
Sort
Slides0:22EN
Matthew Berman· Oct 18, 2026DeepSeek's Memory Use: A Short Claim About KV CacheMatthew Berman · Forward FutureMatthew Berman links lower cache memory use to serving more tokens, but the excerpt does not state the comparison behind its figures.KV caching & prefix reuseInferenceInfrastructure & deployment
Slides0:48EN
Matthew Berman· Aug 25, 2026Matthew Berman on Earning From Idle Mac Compute With DarkbloomMatthew Berman · Forward FutureA proposed network of Apple Silicon Macs could serve AI inference, but the earnings shown are projections that depend on hardware, availability and demand.Distributed training & inferenceInferenceLocal inference+1
9 slides13:09EN
Matthew Berman· Aug 14, 2026AI News: Ultrafast Inference, Claude Watermarks and New ModelsMatthew Berman · Forward FutureMatthew Berman reviews an ultrafast coding preview, text watermarking, Grok Bot, open-weight models and Computer History.InferenceOpen-weight modelsCoding agents+2
2 slides0:24EN
Matthew Berman· Jan 26, 2026Matthew Berman Checks His Clawdbot Token CostsMatthew Berman · Forward FutureA short usage check reveals unexpectedly high model spending over two days.AI cost & performancePersonal agentsInference
Slides1:33EN
Matthew Berman· Jan 15, 2026OpenAI’s Cerebras Deal and the Limits of a 100× Speed ClaimMatthew Berman, Andrew Feldman · Forward FutureMatthew Berman discusses OpenAI’s 2026 agreement for Cerebras inference capacity and a speed chart. The contract and comparison require more context than the video’s headline provides.OpenAIInferenceSemiconductors+1
2 slides1:38EN
Matthew Berman· Dec 29, 2025NVIDIA’s Groq Licensing Deal and the Inference MarketMatthew Berman · Forward FutureMatthew Berman discusses why NVIDIA licensed Groq’s inference technology and hired members of its team.SemiconductorsInferenceAI cost & performance+1
2 slides1:02EN
Matthew Berman· Oct 31, 2025Inside a Cerebras Data Center in Oklahoma CityMatthew Berman · Forward FutureMatthew Berman tours the facility and explains its wafer-scale chips, racks and cooling system.InferenceInfrastructure & deploymentAI cost & performance
3 slides14:07EN
Matthew Berman· Oct 23, 2025Inside Cerebras’s Oklahoma City AI Data CenterMatthew Berman, Andrew Feldman, Billy Wooten · Forward FutureMatthew Berman tours the facility with Cerebras CEO Andrew Feldman and Scale Data Centers COO Billy Wooten, exploring wafer-scale chips, liquid cooling and backup power. Their performance and expansion figures are presented as company claims from 2025.SemiconductorsInfrastructure & deploymentInference+2
4 slides8:47EN
Matthew Berman· Sep 16, 2025Why Identical LLM Prompts Can Produce Different Answers at Temperature ZeroMatthew Berman · Forward FutureMatthew Berman explains Thinking Machines Lab’s work on batch-invariant inference and what its reproducibility experiment actually showed.InferenceAI researchObservability & reliability+1
4 slides17:51EN
Matthew Berman· Aug 28, 2025AI News in August 2025: Claude for Chrome, New Models and AI InfrastructureMatthew Berman · Forward FutureMatthew Berman reviews a browser-agent preview, model releases, reported Apple discussions and research on inference and weather.AI agentsOpen-weight modelsGenerative media+2
5 slides10:01EN
Matthew Berman· Feb 5, 2025DeepSeek R1 Code Optimization and a $3 Visual Counting ExperimentMatthew Berman · Forward FutureMatthew Berman examines a human-guided coding improvement and a small reinforcement-learning experiment, then considers their implications for AI research.Reinforcement LearningGPU programming & kernelsAI research+2
2 slides30:29EN
Matthew Berman· Jan 3, 2025How Researchers Think o1-Style Reasoning Models WorkMatthew Berman · Forward FutureMatthew Berman explains a research survey of policy initialization, rewards, search and reinforcement learning, and the open questions behind reasoning models.Reinforcement LearningModels & trainingAI research+1
5 slides9:38EN
Matthew Berman· Oct 15, 2024Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.Foundation ModelsEvalsBenchmarks+2
Slides0:54EN
Matthew Berman· Sep 16, 2024OpenAI’s o1 Preview: A First Look at Longer ReasoningMatthew Berman · Forward FutureMatthew Berman introduces the o1-preview and o1-mini models and tries a Python game prompt.Models & trainingInference
Slides0:44EN
Matthew Berman· Aug 29, 2024NVIDIA Adds Multi-LoRA Serving to Its RTX AI ToolkitMatthew Berman · Forward FutureIn an NVIDIA-partnered video, Matthew Berman describes using multiple adapters with one base model and a vendor-reported throughput gain.Fine-tuningInferenceInfrastructure & deployment
3 slides5:50EN
Matthew Berman· Jul 27, 2024A Mixture-of-Agents Demo Using Groq and StreamlitMatthew Berman · Forward FutureMatthew Berman walks through a 2024 Groq-powered multi-agent project, from setup to inspecting its layered responses.Multi-agent systemsAgent orchestrationInference+1
6 slides11:20EN
Matthew Berman· Jul 1, 2024Matthew Berman Adapts Mixture of Agents to Groq InferenceMatthew Berman · Forward FutureA 2024 tutorial changes an open-source multi-model ensemble to use Groq, then tests its interactive output and fixes a streaming error.Multi-agent systemsAgent orchestrationInference+1
5 slides13:18EN
Matthew Berman· Jun 20, 2024Testing Local AI on a Dual RTX 6000 WorkstationMatthew Berman · Forward FutureMatthew Berman tests language models, concurrent inference, and image generation on a Dell Precision tower supplied by Dell and NVIDIA.Local inferenceInferenceModels & training+2
27:37EN
Matthew Berman· Jun 17, 2024Leo Pekelis on Extending Llama 3 to a Million-Token ContextMatthew Berman, Leo Pekelis · Forward FutureGradient’s chief scientist explains long-context training, coding use cases, inference costs and why retrieval benchmarks tell only part of the story.Context engineeringModels & trainingInference+2
6 slides9:02EN
Matthew Berman· Apr 1, 2024Matthew Berman Tries LLM Colosseum, a Street Fighter Model BenchmarkMatthew Berman · Forward FutureA 2024 tutorial shows language models choosing fighting-game moves, explains the game-state prompt and walks through local setup.EvalsMulti-agent systemsExperimentation+1
4 slides14:11EN
Matthew Berman· Mar 23, 2024LM Studio in 2024: Local Models, Parallel Inference and a Local APIMatthew Berman · Forward FutureMatthew Berman demonstrates model downloads, hardware settings, JSON output and serving multiple local models.Open-weight modelsInference
3 slides51:11EN
Matthew Berman· Mar 22, 2024Inside Groq’s LPU: Compilers, Chip Networks and Fast InferenceMatthew Berman, Andrew Ling, Igor Arsovski · Forward FutureGroq engineers Andrew Ling and Igor Arsovski explain their hardware and software design in a sponsored 2024 interview.Infrastructure & deploymentInferenceAI cost & performance
10 slides30:39EN
Matthew Berman· Feb 25, 2024NVIDIA’s GEAR Research, Gemini 1.5 and Fast AI InferenceMatthew Berman · Forward FutureMatthew Berman reviews embodied-agent research and a February 2024 set of AI releases and demonstrations.RoboticsAI researchBenchmarks+2
6 slides12:49EN
Matthew Berman· Sep 14, 2023Falcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.Open-weight modelsBenchmarksModels & training+1
Load moreShowing 24 of 27