Grok Vision Preview: Reading a Diagram and Explaining a Meme

Matthew Berman reviews two early examples of visual understanding, from a handwritten workflow to a workplace joke.

MBMatthew BermanAnime · Forward Future
Chaîne
Matthew Berman
Publié
26 avr. 2024
Vidéo
0:57
Lecture
1 min
Diapositives
2
Original
anglais
Ouvrir sur YouTube
En faisant défiler, la vidéo se réduit en bas à droite et continue. Les sous-titres suivent votre langue de lecture.
Langue de lectureDisponible en 2 langues
Cet article n’est pas encore disponible en français ; il s’affiche dans l’original en anglais.
RÉSUMÉ

En 30 secondes

In this April 2024 short, Matthew Berman describes a preview of Grok’s visual capabilities. The video shows a handwritten flowchart translated into Python and an explanation of a meme comparing startups with large companies; these are selected examples, not a broad evaluation.

  1. 1A vision previewBerman introduces early examples of Grok processing images.
  2. 2Diagram to codeA handwritten guessing-game flowchart is used to generate Python code.
  3. 3Explaining a memeThe model describes a joke contrasting how startups and large companies are depicted at work.

À retenir

  1. The preview shows a handwritten flowchart used as input for Python code generation.
  2. A second example describes and interprets a workplace meme.
  3. Two demonstrations cannot establish reliability across all images or programming tasks.
TEXTE INTÉGRAL

Lire le texte remanié, chapitre par chapitre

Transcription seule
01

Two visual examples

Berman shows a diagram-to-code example and a meme explanation. The examples illustrate potential uses without establishing general performance.

A handwritten guessing-game flowchart
DIAPOSITIVE 1 / 2A handwritten guessing-game flowchartThe diagram is the visual input for a request to produce Python code.

Grok has previewed visual capabilities, and I review two examples in this short. The first asks the model to translate a handwritten whiteboard workflow into Python code.

The flowchart describes a guessing game: choose a target, read a guess, check whether it matches, and either announce a win or ask the user to try again. The preview shows a Python response to the diagram; it is a demonstration, not a verified test of every generated program.

Explaining a workplace meme
DIAPOSITIVE 2 / 2Explaining a workplace memeThe displayed response describes the two images and their exaggerated contrast.

The second example asks Grok to explain a meme. It describes a group labeled startups working together to dig and a group labeled big companies mostly watching one worker, then explains the humor as an exaggerated contrast between the two. I find this example especially impressive, although a single selected image cannot establish general reliability.

Sur la même chaîne

12 diapositives34:21EN
Matthew Berman· 27 oct. 2026Matthew Berman Examines Anthropic’s IPO Filing, AI Growth and GovernanceMatthew Berman, Sam Altman · Forward FutureThe presenter reviews the S-1’s financial metrics, compute strategy and voting structure while questioning the tension between rapid AI development and safety.AnthropicAI SafetyIA en entreprise+2
2 diapositives0:36EN
Matthew Berman· 25 oct. 2026Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.ÉvaluationsAgents de codeOpen-weight models
6 diapositives25:50EN
Matthew Berman· 24 oct. 2026Kimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.Open-weight modelsBenchmarksAI cost & performance+1
2 diapositives32:20EN
Matthew Berman· 23 oct. 2026Who Is Local AI For? The Costs, Trade-offs and a Hybrid FutureMatthew Berman · Forward FutureMatthew Berman weighs data control and independence against hardware cost, setup complexity and inference speed.Local inferenceOpen-weight modelsAI cost & performance+1
6 diapositives1:03:37EN
Matthew Berman· 23 oct. 2026Matthew Berman’s Team Tests Kimi K3.1 on Animation, Games, and ChartsMatthew Berman, Alex, Brian · Forward FutureA live team AMA turns into an informal test of Kimi K3.1, from personal-agent workflows to motion graphics, a browser game, and a benchmark chart.Agents de codeGenerative mediaÉvaluations+2
0:53EN
Matthew Berman· 22 oct. 2026Sam Altman on AI and the Discovery of New KnowledgeSam Altman · OpenAIAltman expects progress in mathematical discovery to extend to biology, materials and energy.AI for scienceMathematicsComputational Biology+1