Kürzlich aktualisierte Kanäle

Wählen, um nur diesen Kanal zu sehenAlle Kanäle →

Ergebnisse

22 Artikel
Sortieren
Folien0:22EN
Matthew Berman· 18. Okt. 2026DeepSeek's Memory Use: A Short Claim About KV CacheMatthew Berman · Forward FutureMatthew Berman links lower cache memory use to serving more tokens, but the excerpt does not state the comparison behind its figures.KV caching & prefix reuseInferenceInfrastruktur & Deployment
Folien0:48EN
Matthew Berman· 25. Aug. 2026Matthew Berman on Earning From Idle Mac Compute With DarkbloomMatthew Berman · Forward FutureA proposed network of Apple Silicon Macs could serve AI inference, but the earnings shown are projections that depend on hardware, availability and demand.Distributed training & inferenceInferenceLocal inference+1
9 Folien13:09EN
Matthew Berman· 14. Aug. 2026AI News: Ultrafast Inference, Claude Watermarks and New ModelsMatthew Berman · Forward FutureMatthew Berman reviews an ultrafast coding preview, text watermarking, Grok Bot, open-weight models and Computer History.InferenceOpen-weight modelsCoding-Agenten+2
2 Folien0:24EN
Matthew Berman· 26. Jan. 2026Matthew Berman Checks His Clawdbot Token CostsMatthew Berman · Forward FutureA short usage check reveals unexpectedly high model spending over two days.AI cost & performancePersonal agentsInference
Folien1:33EN
Matthew Berman· 15. Jan. 2026OpenAI’s Cerebras Deal and the Limits of a 100× Speed ClaimMatthew Berman, Andrew Feldman · Forward FutureMatthew Berman discusses OpenAI’s 2026 agreement for Cerebras inference capacity and a speed chart. The contract and comparison require more context than the video’s headline provides.OpenAIInferenceSemiconductors+1
2 Folien1:38EN
Matthew Berman· 29. Dez. 2025NVIDIA’s Groq Licensing Deal and the Inference MarketMatthew Berman · Forward FutureMatthew Berman discusses why NVIDIA licensed Groq’s inference technology and hired members of its team.SemiconductorsInferenceAI cost & performance+1
2 Folien1:02EN
Matthew Berman· 31. Okt. 2025Inside a Cerebras Data Center in Oklahoma CityMatthew Berman · Forward FutureMatthew Berman tours the facility and explains its wafer-scale chips, racks and cooling system.InferenceInfrastruktur & DeploymentAI cost & performance
3 Folien14:07EN
Matthew Berman· 23. Okt. 2025Inside Cerebras’s Oklahoma City AI Data CenterMatthew Berman, Andrew Feldman, Billy Wooten · Forward FutureMatthew Berman tours the facility with Cerebras CEO Andrew Feldman and Scale Data Centers COO Billy Wooten, exploring wafer-scale chips, liquid cooling and backup power. Their performance and expansion figures are presented as company claims from 2025.SemiconductorsInfrastruktur & DeploymentInference+2
4 Folien8:47EN
Matthew Berman· 16. Sept. 2025Why Identical LLM Prompts Can Produce Different Answers at Temperature ZeroMatthew Berman · Forward FutureMatthew Berman explains Thinking Machines Lab’s work on batch-invariant inference and what its reproducibility experiment actually showed.InferenceAI researchObservability & Zuverlässigkeit+1
5 Folien10:01EN
Matthew Berman· 5. Feb. 2025DeepSeek R1 Code Optimization and a $3 Visual Counting ExperimentMatthew Berman · Forward FutureMatthew Berman examines a human-guided coding improvement and a small reinforcement-learning experiment, then considers their implications for AI research.Reinforcement LearningGPU programming & kernelsAI research+2
5 Folien9:38EN
Matthew Berman· 15. Okt. 2024Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.Foundation ModelsEvalsBenchmarks+2
Folien0:54EN
Matthew Berman· 16. Sept. 2024OpenAI’s o1 Preview: A First Look at Longer ReasoningMatthew Berman · Forward FutureMatthew Berman introduces the o1-preview and o1-mini models and tries a Python game prompt.Modelle & TrainingInference
Folien0:44EN
Matthew Berman· 29. Aug. 2024NVIDIA Adds Multi-LoRA Serving to Its RTX AI ToolkitMatthew Berman · Forward FutureIn an NVIDIA-partnered video, Matthew Berman describes using multiple adapters with one base model and a vendor-reported throughput gain.Fine-TuningInferenceInfrastruktur & Deployment
3 Folien5:50EN
Matthew Berman· 27. Juli 2024A Mixture-of-Agents Demo Using Groq and StreamlitMatthew Berman · Forward FutureMatthew Berman walks through a 2024 Groq-powered multi-agent project, from setup to inspecting its layered responses.Multi-agent systemsAgent orchestrationInference+1
6 Folien11:20EN
Matthew Berman· 1. Juli 2024Matthew Berman Adapts Mixture of Agents to Groq InferenceMatthew Berman · Forward FutureA 2024 tutorial changes an open-source multi-model ensemble to use Groq, then tests its interactive output and fixes a streaming error.Multi-agent systemsAgent orchestrationInference+1
5 Folien13:18EN
Matthew Berman· 20. Juni 2024Testing Local AI on a Dual RTX 6000 WorkstationMatthew Berman · Forward FutureMatthew Berman tests language models, concurrent inference, and image generation on a Dell Precision tower supplied by Dell and NVIDIA.Local inferenceInferenceModelle & Training+2
6 Folien9:02EN
Matthew Berman· 1. Apr. 2024Matthew Berman Tries LLM Colosseum, a Street Fighter Model BenchmarkMatthew Berman · Forward FutureA 2024 tutorial shows language models choosing fighting-game moves, explains the game-state prompt and walks through local setup.EvalsMulti-agent systemsExperimentation+1
4 Folien14:11EN
Matthew Berman· 23. März 2024LM Studio in 2024: Local Models, Parallel Inference and a Local APIMatthew Berman · Forward FutureMatthew Berman demonstrates model downloads, hardware settings, JSON output and serving multiple local models.Open-weight modelsInference
6 Folien12:49EN
Matthew Berman· 14. Sept. 2023Falcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.Open-weight modelsBenchmarksModelle & Training+1
2 Folien5:53EN
Matthew Berman· 18. Juli 2023Petals: Distributing Large Language Model Inference Across DevicesMatthew Berman · Forward FutureIn 2023, Matthew Berman explains Petals as a way to use large models through a network of participating computers rather than loading every layer on one device.Distributed training & inferenceLocal inferenceInference+2
4 Folien7:21EN
Matthew Berman· 26. Juni 2023Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.Open-weight modelsEvalsDistillation+2
3 Folien8:17EN
Matthew Berman· 22. Juni 2023Using OpenLLM to Serve Open Models Through an APIMatthew Berman · Forward FutureMatthew Berman demonstrates a local model server, its interactive API and a Python client in a 2023 walkthrough.Open-weight modelsInferenceInfrastruktur & Deployment+1