Running AI Agents Locally with AnythingLLM and NVIDIA

A sponsored short introduces local agents, RTX PCs and a community hub for sharing workflows.

MBMatthew BermanPonente · Forward Future
Canal
Matthew Berman
Publicado
6 dic 2024
Vídeo
0:58
Lectura
1 min
Original
inglés
Abrir en YouTube
Al desplazarte, el vídeo se reduce a la esquina inferior derecha y sigue reproduciéndose. Los subtítulos siguen tu idioma de lectura.
Idioma de lecturaDisponible en 2 idiomas
Este artículo aún no está en español, así que se muestra el original en inglés.
RESUMEN

En 30 segundos

In an NVIDIA partner promotion, Matthew Berman recommends running agents locally and describes AnythingLLM's collaboration with NVIDIA. He highlights local models and a community hub for sharing agent workflows, including drafting emails.

  1. 1Local agentsBerman recommends running agents locally when giving them access to personal information.
  2. 2Local models on RTX PCsHe describes an NVIDIA and AnythingLLM collaboration focused on locally powered models and RTX AI PCs.
  3. 3Community workflowsThe AnythingLLM community hub lets users share and discover agent behaviors, including draft email workflows.

Conclusiones

  1. Berman recommends local agents as a way to keep personal information on a local system.
  2. He says AnythingLLM and NVIDIA are sharing how to run agents with local models on RTX AI PCs.
  3. AnythingLLM's community hub lets people share and find agent workflows, including email drafting.
TEXTO COMPLETO

Lee el texto editado por capítulos

Solo la transcripción
01

Local agents and community workflows

Berman recommends local agents and discusses an AnythingLLM collaboration with NVIDIA. He describes a hub for sharing workflows such as creating email drafts.

I strongly recommend running your agents locally. It lets you give them access to personal information while feeling more secure about it. NVIDIA is partnering with AnythingLLM to show how to build agents locally and run them with local models.

AnythingLLM is built on llama.cpp to work faster and better on NVIDIA RTX AI PCs. I think AnythingLLM is making a major push into agents.

The community hub lets people build and share agent behaviors and discover workflows created by others, including agents that generate and open drafts for Gmail or Outlook.

Those workflows can run at speed on NVIDIA RTX PCs. Check out AnythingLLM and NVIDIA’s information about how GeForce RTX GPUs power AI; thanks to NVIDIA for supporting the segment.

Más de este canal

5 diapositivas14:45EN
Matthew Berman· 29 oct 2026Matthew Berman Examines Google’s Gemini 4 Carbon AnnouncementMatthew Berman · Forward FutureMatthew Berman reviews Google’s reported benchmark results, staged rollout and pricing for Gemini 4 Carbon, while noting he has not yet used the model.Foundation ModelsBenchmarksAI cost & performance+2
7 diapositivas21:11EN
Matthew Berman· 28 oct 2026Matthew Berman tests DeepSeek V4.1 Flash: coding, vision and local appsMatthew Berman · Forward FutureA hands-on tour of visual coding, image reasoning, local applications and provider economics reveals both impressive results and visible flaws.Agentes de programaciónMultimodal AILocal inference+2
12 diapositivas34:21EN
Matthew Berman· 27 oct 2026Matthew Berman Examines Anthropic’s IPO Filing, AI Growth and GovernanceMatthew Berman, Sam Altman · Forward FutureThe presenter reviews the S-1’s financial metrics, compute strategy and voting structure while questioning the tension between rapid AI development and safety.AnthropicAI SafetyIA empresarial+2
0:26EN
Matthew Berman· 25 oct 2026Sam Altman on Human Values and Problem-Solving in an AI WorldSam Altman · OpenAIIn a short interview excerpt, Altman considers the enjoyment of solving hard problems and the human role in interpreting results.Human-AI CollaborationFuture of WorkAI Strategy
2 diapositivas0:36EN
Matthew Berman· 25 oct 2026Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.EvaluacionesAgentes de programaciónOpen-weight models
2 diapositivas0:21EN
Matthew Berman· 24 oct 2026An AI-Generated Kimi Benchmark Chart Used Invented ScoresMatthew Berman · Forward FutureMatthew Berman asks for a graph of Kimi K3.1 Pro benchmarks, then discovers that the displayed figures are illustrative placeholders.BenchmarksEvaluacionesGenerative media