En 30 secondes
Matthew Berman presents NVIDIA NIM microservices for RTX PCs and workstations, discussing local models, ChatRTX and partner applications. He also highlights an upcoming local PDF-to-podcast blueprint. The March 2025 video is sponsored by NVIDIA. Availability and hardware requirements depend on the particular model and workflow.
- 1Packaged modelsNIM microservices package AI models for deployment on supported RTX hardware and other NVIDIA platforms.
- 2Applications and partnersBerman mentions ChatRTX, AnythingLLM, ComfyUI, Flowise and Microsoft AI Toolkit.
- 3PDF to podcastHe highlights an upcoming local blueprint for turning documents into audio.
À retenir
- NVIDIA announced ten NIM microservices for RTX in March 2025, spanning language, image, vision and speech use cases.
- NIM packages optimized models for deployment on supported NVIDIA systems, including local PCs and workstations.
- ChatRTX and partner applications were among the integrations highlighted in the video.
- NVIDIA described local RTX AI Blueprints as upcoming in April 2025, including PDF to podcast.
- NVIDIA sponsored the video; ease of use and performance are promotional claims rather than independent test results.
Lire le texte remanié, chapitre par chapitre
NIM microservices on RTX
Berman introduces packaged models and their potential use on local NVIDIA GPUs. He describes use cases such as assistants and digital humans.
NVIDIA NIM microservices for RTX are available following their announcement at CES. They package optimized AI models for uses including language, image generation, speech and vision. NVIDIA sponsored this video, and its [March 2025 announcement](https://blogs.nvidia.com/blog/rtx-ai-garage-nim-blueprints-g-assist/) reported ten NIM microservices for RTX; support depends on the specific hardware and model.
I see applications ranging from AI assistants to digital humans. NIM is not limited to cloud systems: compatible services can also run on supported GeForce RTX PCs and workstations. My description of downloading and starting immediately is a promotional assessment, not a guarantee that every GPU or workflow needs no setup.
Applications and blueprints
Berman lists ChatRTX and partner tools, then highlights the planned PDF-to-podcast blueprint. NVIDIA sponsored the short.
At build.nvidia.com, developers can explore ChatRTX, a local chat and retrieval-augmented generation application, and partner tools including AnythingLLM, ComfyUI, Flowise and Microsoft AI Toolkit. These integrations offer ways to build applications using locally run AI; their requirements and capabilities vary.
I am especially interested in RTX AI Blueprints, customizable reference workflows that developers can build on. NVIDIA said in March 2025 that the local RTX blueprints were coming in April. Its PDF to podcast example extracts information from documents and generates audio; I compare the concept to NotebookLM, while NVIDIA describes this workflow as running locally on supported hardware.
The PDF-to-podcast idea is particularly exciting to me. Thanks to NVIDIA for sponsoring the video; the company provides more information at [build.nvidia.com](https://build.nvidia.com/).
Sur la même chaîne
14:45EN
Matthew Berman· 29 oct. 2026Matthew Berman Examines Google’s Gemini 4 Carbon AnnouncementMatthew Berman · Forward FutureMatthew Berman reviews Google’s reported benchmark results, staged rollout and pricing for Gemini 4 Carbon, while noting he has not yet used the model.
21:11ENMatthew Berman· 28 oct. 2026Matthew Berman tests DeepSeek V4.1 Flash: coding, vision and local appsMatthew Berman · Forward FutureA hands-on tour of visual coding, image reasoning, local applications and provider economics reveals both impressive results and visible flaws.
34:21ENMatthew Berman· 27 oct. 2026Matthew Berman Examines Anthropic’s IPO Filing, AI Growth and GovernanceMatthew Berman, Sam Altman · Forward FutureThe presenter reviews the S-1’s financial metrics, compute strategy and voting structure while questioning the tension between rapid AI development and safety.
0:26ENMatthew Berman· 25 oct. 2026Sam Altman on Human Values and Problem-Solving in an AI WorldSam Altman · OpenAIIn a short interview excerpt, Altman considers the enjoyment of solving hard problems and the human role in interpreting results.
0:36ENMatthew Berman· 25 oct. 2026Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.
0:21ENMatthew Berman· 24 oct. 2026An AI-Generated Kimi Benchmark Chart Used Invented ScoresMatthew Berman · Forward FutureMatthew Berman asks for a graph of Kimi K3.1 Pro benchmarks, then discovers that the displayed figures are illustrative placeholders.