A Quick RTX 5090 Local AI Test

Matthew Berman runs an 8B DeepSeek R1 distillation locally and reports the speed of one generation.

MBMatthew Berman연사 · Forward Future
채널
Matthew Berman
게시일
2025년 1월 23일
영상
0:55
읽기
1분
슬라이드
1
원문
영어
YouTube에서 열기
스크롤하면 영상이 오른쪽 아래로 작아져 계속 재생됩니다. 자막은 읽기 언어를 따릅니다.
읽기 언어2개 언어로 읽을 수 있음
이 글은 아직 한국어 번역이 없어 영어 원문으로 표시합니다.
요약

30초 요약

In an NVIDIA-partnered 2025 short, Matthew Berman describes gaming on an RTX 5090 and tests an 8-billion-parameter DeepSeek R1 distilled model in LM Studio. He reports 78 tokens per second for one run; the short does not establish performance across models or workloads. Berman also discloses a small investment in LM Studio.

  1. 1Partnered hardwareBerman says NVIDIA provided the RTX 5090, invited him to CES and partnered on the video.
  2. 2Gaming firstHe says he tried Cyberpunk at maximum settings and enjoyed how Path of Exile 2 looked.
  3. 3Local AI generationAn 8B distilled DeepSeek R1 model generates Python Snake code in LM Studio, with a reported 78 tokens per second on that run.

핵심 정리

  1. NVIDIA supplied the RTX 5090 and partnered with Berman on the video.
  2. Berman runs an 8B DeepSeek R1 distilled model locally in LM Studio.
  3. He asks for a Python Snake game and reports 78 tokens per second for that run.
  4. The short does not provide a controlled benchmark across hardware, models or configurations.
전문

챕터별로 다듬은 전문 읽기

원본 자막만 보기
01

Games and a local model test

Berman introduces the RTX 5090 and his NVIDIA partnership. He reports impressions from games and the speed of a single local AI generation.

NVIDIA sent me an RTX 5090, its high-end next-generation GPU, and invited me to CES, where Jensen Huang introduced it. NVIDIA also partnered with me on this video. My first test was gaming: I say Cyberpunk ran at maximum settings without a problem, and Path of Exile 2 looked gorgeous.

For AI, I load the 8-billion-parameter DeepSeek R1 distilled model locally in LM Studio and ask it to write Snake in Python. It shows its reasoning and produces code; I report 78 tokens per second for this run. This single example does not establish a general hardware ranking or show whether the game was tested. I disclose a small investment in LM Studio in the video description.

Generated Snake code
슬라이드 1 / 1Generated Snake codeThe local model outputs a Python implementation after its reasoning text.

같은 채널의 다른 글

슬라이드 12장34:21EN
Matthew Berman· 2026년 10월 27일Matthew Berman Examines Anthropic’s IPO Filing, AI Growth and GovernanceMatthew Berman, Sam Altman · Forward FutureThe presenter reviews the S-1’s financial metrics, compute strategy and voting structure while questioning the tension between rapid AI development and safety.AnthropicAI Safety엔터프라이즈 AI+2
슬라이드 2장0:36EN
Matthew Berman· 2026년 10월 25일Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.평가(Evals)코딩 에이전트Open-weight models
슬라이드 6장25:50EN
Matthew Berman· 2026년 10월 24일Kimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.Open-weight modelsBenchmarksAI cost & performance+1
슬라이드 2장32:20EN
Matthew Berman· 2026년 10월 23일Who Is Local AI For? The Costs, Trade-offs and a Hybrid FutureMatthew Berman · Forward FutureMatthew Berman weighs data control and independence against hardware cost, setup complexity and inference speed.Local inferenceOpen-weight modelsAI cost & performance+1
슬라이드 6장1:03:37EN
Matthew Berman· 2026년 10월 23일Matthew Berman’s Team Tests Kimi K3.1 on Animation, Games, and ChartsMatthew Berman, Alex, Brian · Forward FutureA live team AMA turns into an informal test of Kimi K3.1, from personal-agent workflows to motion graphics, a browser game, and a benchmark chart.코딩 에이전트Generative media평가(Evals)+2
0:53EN
Matthew Berman· 2026년 10월 22일Sam Altman on AI and the Discovery of New KnowledgeSam Altman · OpenAIAltman expects progress in mathematical discovery to extend to biology, materials and energy.AI for scienceMathematicsComputational Biology+1