Testing DeepSeek Janus-Pro for Image Understanding and Generation

Matthew Berman tries the 7B multimodal model on diagrams, memes and image prompts using a sponsored cloud GPU demonstration.

MBMatthew BermanPonente · Forward Future
Canal
Matthew Berman
Publicado
1 feb 2025
Vídeo
6:44
Lectura
3 min
Diapositivas
3
Original
inglés
Abrir en YouTube
Al desplazarte, el vídeo se reduce a la esquina inferior derecha y sigue reproduciéndose. Los subtítulos siguen tu idioma de lectura.
Idioma de lecturaDisponible en 2 idiomas
Este artículo aún no está en español, así que se muestra el original en inglés.
RESUMEN

En 30 segundos

In February 2025, Matthew Berman tests DeepSeek Janus-Pro-7B, which supports image understanding and text-to-image generation. He demonstrates a diagram-to-code task, a spreadsheet transcription, meme interpretation and two generated images, with one meme interpretation failing. Vultr partnered on the video and supplied the cloud-compute context; the results are examples rather than a controlled benchmark.

  1. 1Unified multimodal modelJanus-Pro-7B can interpret image inputs and generate images. It is not the first research system to combine these modalities.
  2. 2Benchmark scopeDeepSeek’s reported GenEval and DPG-Bench results compare specific models and settings, not every measure of visual quality.
  3. 3Sponsored cloud demonstrationVultr partnered on the video; Berman runs a Gradio interface on AMD MI300X cloud hardware.
  4. 4Vision tasksThe model generates Python from a flowchart and transcribes a spreadsheet, but misreads a workplace meme.
  5. 5Image generationBerman produces astronaut and wine-glass examples and considers them good but not exceptional.

Conclusiones

  1. Janus-Pro combines multimodal understanding and image generation in one model family; earlier research had already explored unified models.
  2. DeepSeek reported higher GenEval scores than specific DALL-E 3 and Stable Diffusion 3 Medium versions, which does not prove superiority on every image task.
  3. Berman’s diagram-to-code and spreadsheet examples appeared successful, while a second meme was misinterpreted.
  4. The demonstration ran on a Vultr-hosted AMD Instinct MI300X, so its apparent speed does not establish local performance on every computer.
  5. The Janus repository and model have separate license terms; review the model license before deployment or commercial use.
  6. The cloud promotion and pricing described in the video were historical and subject to their original terms.
TEXTO COMPLETO

Lee el texto editado por capítulos

Solo la transcripción
01

Janus-Pro and the cloud setup

Berman introduces the model and reviews DeepSeek’s reported image benchmarks. He discloses the Vultr partnership and uses an AMD cloud GPU.

DeepSeek has released Janus-Pro, a multimodal model that can both answer questions about images and generate images. I test the 7-billion-parameter version in February 2025. Its weights are available, but whether it runs conveniently on a particular local computer depends on memory, software and hardware.

DeepSeek’s Janus-Pro benchmark chart
DIAPOSITIVA 1 / 3DeepSeek’s Janus-Pro benchmark chartThe report compares selected image understanding and generation benchmarks with specific prior models.

DeepSeek reports that Janus-Pro-7B scored 80% on GenEval, compared with 67% for DALL-E 3 and 74% for Stable Diffusion 3 Medium in its reported evaluation. That is a result on one benchmark under the paper’s conditions, not proof that Janus-Pro creates better images in every setting ([technical report](https://arxiv.org/abs/2501.17811)). Its authors also report a DPG-Bench result.

I am excited to see understanding and generation in a single model, but this was not the first research system to attempt both: prior unified systems included Chameleon and Emu3, as discussed in the [Janus paper](https://arxiv.org/abs/2410.13848). The [Janus repository](https://github.com/deepseek-ai/Janus) makes code available, while use of the model is subject to the separate DeepSeek model license; inspect the applicable terms.

Vultr is a partner on this video. I run Janus-Pro in a Gradio interface on a Vultr-hosted AMD Instinct MI300X and point out that the server can also expose an API. This is a cloud demonstration rather than a local-computer speed test, and it does not isolate how much the model or the hardware contributes to performance.

02

Testing image understanding

The model interprets memes, converts a flowchart to Python and transcribes a spreadsheet. One meme explanation fails.

First I upload a meme depicting competition between DeepSeek and OpenAI and ask for an explanation. The model recognizes the visual joke as a competitive interaction, though parts of its description are imperfect. There is no web search enabled in the setup I show.

Next I ask the model to convert a number-guessing flowchart into runnable Python. I paste and run its generated code, then make several guesses until it reports a win. That is a successful demonstration for this simple example, not proof that generated programs will always match arbitrary diagrams.

Number-guessing flowchart
DIAPOSITIVA 2 / 3Number-guessing flowchartBerman asks the model to turn this simple diagram into executable Python.

I then provide a spreadsheet screenshot and ask for CSV. The output looks correct to me on a visual inspection, but I do not show a cell-by-cell independent audit. On a second meme contrasting startups and large companies, the model misses the joke and describes the large-company side in terms of efficiency and coordination rather than the intended criticism.

03

Generating images

Berman generates two images in the same interface and discusses his impression. He closes with a historical Vultr promotion.

Without loading a different model in the displayed interface, I switch to image generation and request an astronaut in a jungle with muted colors, then a glass of red wine on a reflective surface. I find the pictures reasonably good rather than extraordinary. These two examples are subjective demonstrations, not a full image-quality evaluation.

Generated wine-glass image
DIAPOSITIVA 3 / 3Generated wine-glass imageAn example produced by the model in the cloud demonstration.

I conclude that the small model is promising and again promote Vultr’s hosted AMD hardware. I mention a $300 promotional credit for the first 30 days; that offer was part of the 2025 partnership and its current availability and conditions should be checked with the provider.

Más de este canal

12 diapositivas34:21EN
Matthew Berman· 27 oct 2026Matthew Berman Examines Anthropic’s IPO Filing, AI Growth and GovernanceMatthew Berman, Sam Altman · Forward FutureThe presenter reviews the S-1’s financial metrics, compute strategy and voting structure while questioning the tension between rapid AI development and safety.AnthropicAI SafetyIA empresarial+2
0:26EN
Matthew Berman· 25 oct 2026Sam Altman on Human Values and Problem-Solving in an AI WorldSam Altman · OpenAIIn a short interview excerpt, Altman considers the enjoyment of solving hard problems and the human role in interpreting results.Human-AI CollaborationFuture of WorkAI Strategy
2 diapositivas0:36EN
Matthew Berman· 25 oct 2026Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.EvaluacionesAgentes de programaciónOpen-weight models
2 diapositivas0:21EN
Matthew Berman· 24 oct 2026An AI-Generated Kimi Benchmark Chart Used Invented ScoresMatthew Berman · Forward FutureMatthew Berman asks for a graph of Kimi K3.1 Pro benchmarks, then discovers that the displayed figures are illustrative placeholders.BenchmarksEvaluacionesGenerative media
6 diapositivas25:50EN
Matthew Berman· 24 oct 2026Kimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.Open-weight modelsBenchmarksAI cost & performance+1
2 diapositivas32:20EN
Matthew Berman· 23 oct 2026Who Is Local AI For? The Costs, Trade-offs and a Hybrid FutureMatthew Berman · Forward FutureMatthew Berman weighs data control and independence against hardware cost, setup complexity and inference speed.Local inferenceOpen-weight modelsAI cost & performance+1