Kürzlich aktualisierte Kanäle

Wählen, um nur diesen Kanal zu sehenAlle Kanäle →

Ergebnisse

31 Artikel
Sortieren
Folien0:22EN
Matthew Berman· 18. Okt. 2026DeepSeek's Memory Use: A Short Claim About KV CacheMatthew Berman · Forward FutureMatthew Berman links lower cache memory use to serving more tokens, but the excerpt does not state the comparison behind its figures.KV caching & prefix reuseInferenceInfrastruktur & Deployment
0:50EN
Matthew Berman· 2. Sept. 2026Matthew Berman on Using Idle Computers for AI InferenceMatthew Berman · Forward FutureBerman points to Darkbloom as a way to put spare computing capacity to work on AI models, while raising the question of how far distributed inference can go.Distributed training & inferenceInfrastruktur & DeploymentInference+2
0:41EN
Matthew Berman· 28. Aug. 2026Could Faster AI Agents Shift More Work to the Cloud?Matthew Berman · Forward FutureMatthew Berman reflects on a conversation about faster inference and local-computer limits. Whether the CPU is a bottleneck depends on the particular agent workload and execution environment.InferenceInfrastruktur & DeploymentAI agents
Folien0:48EN
Matthew Berman· 25. Aug. 2026Matthew Berman on Earning From Idle Mac Compute With DarkbloomMatthew Berman · Forward FutureA proposed network of Apple Silicon Macs could serve AI inference, but the earnings shown are projections that depend on hardware, availability and demand.Distributed training & inferenceInferenceLocal inference+1
9 Folien13:09EN
Matthew Berman· 14. Aug. 2026AI News: Ultrafast Inference, Claude Watermarks and New ModelsMatthew Berman · Forward FutureMatthew Berman reviews an ultrafast coding preview, text watermarking, Grok Bot, open-weight models and Computer History.InferenceOpen-weight modelsCoding-Agenten+2
0:52EN
Matthew Berman· 13. Feb. 2026GPT-5.3-Codex-Spark Brings Faster Coding InferenceMatthew Berman · Forward FutureMatthew Berman highlights OpenAI's smaller coding model and its use of Cerebras hardware for low-latency responses.Coding-AgentenInferenceSemiconductors
2 Folien0:24EN
Matthew Berman· 26. Jan. 2026Matthew Berman Checks His Clawdbot Token CostsMatthew Berman · Forward FutureA short usage check reveals unexpectedly high model spending over two days.AI cost & performancePersonal agentsInference
Folien1:33EN
Matthew Berman· 15. Jan. 2026OpenAI’s Cerebras Deal and the Limits of a 100× Speed ClaimMatthew Berman, Andrew Feldman · Forward FutureMatthew Berman discusses OpenAI’s 2026 agreement for Cerebras inference capacity and a speed chart. The contract and comparison require more context than the video’s headline provides.OpenAIInferenceSemiconductors+1
2 Folien1:38EN
Matthew Berman· 29. Dez. 2025NVIDIA’s Groq Licensing Deal and the Inference MarketMatthew Berman · Forward FutureMatthew Berman discusses why NVIDIA licensed Groq’s inference technology and hired members of its team.SemiconductorsInferenceAI cost & performance+1
2 Folien1:02EN
Matthew Berman· 31. Okt. 2025Inside a Cerebras Data Center in Oklahoma CityMatthew Berman · Forward FutureMatthew Berman tours the facility and explains its wafer-scale chips, racks and cooling system.InferenceInfrastruktur & DeploymentAI cost & performance
3 Folien14:07EN
Matthew Berman· 23. Okt. 2025Inside Cerebras’s Oklahoma City AI Data CenterMatthew Berman, Andrew Feldman, Billy Wooten · Forward FutureMatthew Berman tours the facility with Cerebras CEO Andrew Feldman and Scale Data Centers COO Billy Wooten, exploring wafer-scale chips, liquid cooling and backup power. Their performance and expansion figures are presented as company claims from 2025.SemiconductorsInfrastruktur & DeploymentInference+2
4 Folien8:47EN
Matthew Berman· 16. Sept. 2025Why Identical LLM Prompts Can Produce Different Answers at Temperature ZeroMatthew Berman · Forward FutureMatthew Berman explains Thinking Machines Lab’s work on batch-invariant inference and what its reproducibility experiment actually showed.InferenceAI researchObservability & Zuverlässigkeit+1
4 Folien17:51EN
Matthew Berman· 28. Aug. 2025AI News in August 2025: Claude for Chrome, New Models and AI InfrastructureMatthew Berman · Forward FutureMatthew Berman reviews a browser-agent preview, model releases, reported Apple discussions and research on inference and weather.AI agentsOpen-weight modelsGenerative media+2
5 Folien10:01EN
Matthew Berman· 5. Feb. 2025DeepSeek R1 Code Optimization and a $3 Visual Counting ExperimentMatthew Berman · Forward FutureMatthew Berman examines a human-guided coding improvement and a small reinforcement-learning experiment, then considers their implications for AI research.Reinforcement LearningGPU programming & kernelsAI research+2
2 Folien30:29EN
Matthew Berman· 3. Jan. 2025How Researchers Think o1-Style Reasoning Models WorkMatthew Berman · Forward FutureMatthew Berman explains a research survey of policy initialization, rewards, search and reinforcement learning, and the open questions behind reasoning models.Reinforcement LearningModelle & TrainingAI research+1
5 Folien9:38EN
Matthew Berman· 15. Okt. 2024Liquid Foundation Models: Company Benchmarks and a Hands-On TestMatthew Berman · Forward FutureMatthew Berman reviews Liquid AI’s 2024 model and memory claims, then tries the 40B preview on coding, logic, and instruction-following prompts.Foundation ModelsEvalsBenchmarks+2
Folien0:54EN
Matthew Berman· 16. Sept. 2024OpenAI’s o1 Preview: A First Look at Longer ReasoningMatthew Berman · Forward FutureMatthew Berman introduces the o1-preview and o1-mini models and tries a Python game prompt.Modelle & TrainingInference
Folien0:44EN
Matthew Berman· 29. Aug. 2024NVIDIA Adds Multi-LoRA Serving to Its RTX AI ToolkitMatthew Berman · Forward FutureIn an NVIDIA-partnered video, Matthew Berman describes using multiple adapters with one base model and a vendor-reported throughput gain.Fine-TuningInferenceInfrastruktur & Deployment
3 Folien5:50EN
Matthew Berman· 27. Juli 2024A Mixture-of-Agents Demo Using Groq and StreamlitMatthew Berman · Forward FutureMatthew Berman walks through a 2024 Groq-powered multi-agent project, from setup to inspecting its layered responses.Multi-agent systemsAgent orchestrationInference+1
6 Folien11:20EN
Matthew Berman· 1. Juli 2024Matthew Berman Adapts Mixture of Agents to Groq InferenceMatthew Berman · Forward FutureA 2024 tutorial changes an open-source multi-model ensemble to use Groq, then tests its interactive output and fixes a streaming error.Multi-agent systemsAgent orchestrationInference+1
5 Folien13:18EN
Matthew Berman· 20. Juni 2024Testing Local AI on a Dual RTX 6000 WorkstationMatthew Berman · Forward FutureMatthew Berman tests language models, concurrent inference, and image generation on a Dell Precision tower supplied by Dell and NVIDIA.Local inferenceInferenceModelle & Training+2
27:37EN
Matthew Berman· 17. Juni 2024Leo Pekelis on Extending Llama 3 to a Million-Token ContextMatthew Berman, Leo Pekelis · Forward FutureGradient’s chief scientist explains long-context training, coding use cases, inference costs and why retrieval benchmarks tell only part of the story.Context EngineeringModelle & TrainingInference+2
5 Folien12:51EN
Matthew Berman· 21. Apr. 2024Llama 3 70B on Groq: Fast Inference and an Informal Prompt TestMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and repeated prompts on Groq’s April 2024 Llama 3 service, with mixed results and several scoring caveats.Open-weight modelsInferenceEvals+2
6 Folien9:02EN
Matthew Berman· 1. Apr. 2024Matthew Berman Tries LLM Colosseum, a Street Fighter Model BenchmarkMatthew Berman · Forward FutureA 2024 tutorial shows language models choosing fighting-game moves, explains the game-state prompt and walks through local setup.EvalsMulti-agent systemsExperimentation+1
Mehr laden24 von 31 angezeigt