Grok Vision Preview: Reading a Diagram and Explaining a Meme

Matthew Berman reviews two early examples of visual understanding, from a handwritten workflow to a workplace joke.

MBMatthew Bermanホスト · Forward Future
チャンネル
Matthew Berman
公開日
2024年4月26日
動画
0:57
読了時間
1 分
スライド
2
原文
英語
YouTube で開く
スクロールすると動画は右下に小さくなって再生を続けます。字幕は閲覧言語に合わせて切り替わります。
閲覧言語2 言語で読めます
この記事はまだ日本語に翻訳されていないため、英語の原文を表示しています。
要約

30 秒でわかる

In this April 2024 short, Matthew Berman describes a preview of Grok’s visual capabilities. The video shows a handwritten flowchart translated into Python and an explanation of a meme comparing startups with large companies; these are selected examples, not a broad evaluation.

  1. 1A vision previewBerman introduces early examples of Grok processing images.
  2. 2Diagram to codeA handwritten guessing-game flowchart is used to generate Python code.
  3. 3Explaining a memeThe model describes a joke contrasting how startups and large companies are depicted at work.

ポイント

  1. The preview shows a handwritten flowchart used as input for Python code generation.
  2. A second example describes and interprets a workplace meme.
  3. Two demonstrations cannot establish reliability across all images or programming tasks.
全文

チャプターごとに整えた全文を読む

文字起こしのみ
01

Two visual examples

Berman shows a diagram-to-code example and a meme explanation. The examples illustrate potential uses without establishing general performance.

A handwritten guessing-game flowchart
スライド 1 / 2A handwritten guessing-game flowchartThe diagram is the visual input for a request to produce Python code.

Grok has previewed visual capabilities, and I review two examples in this short. The first asks the model to translate a handwritten whiteboard workflow into Python code.

The flowchart describes a guessing game: choose a target, read a guess, check whether it matches, and either announce a win or ask the user to try again. The preview shows a Python response to the diagram; it is a demonstration, not a verified test of every generated program.

Explaining a workplace meme
スライド 2 / 2Explaining a workplace memeThe displayed response describes the two images and their exaggerated contrast.

The second example asks Grok to explain a meme. It describes a group labeled startups working together to dig and a group labeled big companies mostly watching one worker, then explains the humor as an exaggerated contrast between the two. I find this example especially impressive, although a single selected image cannot establish general reliability.

同じチャンネルの記事

スライド 6 枚25:50EN
MBMatthew Berman· 2026年10月24日Kimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.Open-weight modelsBenchmarksAI cost & performance+1
スライド 2 枚32:20EN
MBMatthew Berman· 2026年10月23日Who Is Local AI For? The Costs, Trade-offs and a Hybrid FutureMatthew Berman · Forward FutureMatthew Berman weighs data control and independence against hardware cost, setup complexity and inference speed.Local inferenceOpen-weight modelsAI cost & performance+1
スライド0:22EN
MBMatthew Berman· 2026年10月21日A Robot Bodyguard Video Shows Dramatic Rescue ScenariosMatthew Berman · Forward FutureMatthew Berman reacts to a short robot demonstration depicting fighting and vehicle-rescue scenarios.Robotics評価(Evals)
45:08EN
MBMatthew Berman· 2026年10月21日Sam Altman on AI Discovery, Consciousness, Compute and a Human-Centered FutureMatthew Berman, Sam Altman · Forward FutureIn a conversation with Matthew Berman, Altman discusses scientific progress, personal assistants, recursive self-improvement and the importance of human agency.AI for sciencePersonal agentsConsciousness+2
0:32EN
MBMatthew Berman· 2026年10月21日Sam Altman on the Continuing Demand for Software WorkSam Altman, Matthew Berman · OpenAIIn a short interview excerpt, Altman says demand for software may be larger than expected even as AI changes how it is made.Future of WorkSoftware engineeringコーディングエージェント
スライド 5 枚12:14EN
MBMatthew Berman· 2026年10月14日Gemini 4 Argon Tested: 3D Demos, a Spreadsheet Prototype and Benchmark ResultsMatthew Berman · Forward FutureMatthew Berman tests Google’s model on games and visual projects, then compares reported coding and agent benchmarks.GeminiBenchmarksコーディングエージェント+1