Testing Grok 3 on Games, Reasoning, and Web Search

Matthew Berman tries a new set of audience-suggested prompts, from a Snake–Flappy Bird mashup to a family-logic puzzle and a tesseract visualization.

MBMatthew BermanPonente · Forward Future
Canal
Matthew Berman
Publicado
20 feb 2025
Vídeo
9:43
Lectura
3 min
Diapositivas
4
Original
inglés
Abrir en YouTube
Al desplazarte, el vídeo se reduce a la esquina inferior derecha y sigue reproduciéndose. Los subtítulos siguen tu idioma de lectura.
Idioma de lecturaDisponible en 2 idiomas
Este artículo aún no está en español, así que se muestra el original en inglés.
RESUMEN

En 30 segundos

In February 2025, Matthew Berman informally tests xAI’s Grok 3 with reasoning, creative coding, web search, and safety-related prompts. The generated game does not behave as he expects, while the model answers a family-logic question and generates a running visualization. He is impressed by its speed and overall performance, but his observations are not a controlled benchmark or proof that Grok 3 is the best model.

  1. 1A fast but conventional answerGrok’s response to the meaning-of-life question discusses fulfillment, purpose, and philosophy; Berman wanted more personality.
  2. 2Game controls disappointThe generated Snake–Flappy Bird game starts, but Berman cannot make the left and right controls work as expected.
  3. 3A search-backed political questionGrok searches X and web pages before suggesting possible reasons for Musk’s OpenAI bid; its explanation of motives remains conjecture.
  4. 4The family-logic puzzleThe model counts Alice and her M sisters, giving M + 1 sisters for her brother.
  5. 5A tesseract visualizationThe generated Python program produces a running visualization in the demonstration.

Conclusiones

  1. Berman’s apparent speed estimate is a visual impression, not a measured throughput benchmark.
  2. The generated Snake–Flappy Bird game launches, but Berman cannot get its controls to work as expected.
  3. The number puzzle permits different interpretations: the multiply-by-five mapping gives 25, while literal equality would imply 5 equals 1 from the stated premise.
  4. The model correctly answers that Alice’s brother has M + 1 sisters when Alice has M other sisters.
  5. A successful visualization and a handful of informal prompts do not establish broad coding or reasoning performance.
  6. The model’s proposed motives for a news event are speculative, even when the answer includes web search results.
TEXTO COMPLETO

Lee el texto editado por capítulos

Solo la transcripción
01

First impressions and personality

Berman introduces a fresh prompt set and tries the meaning-of-life question with Think enabled. He comments on perceived speed and the answer’s tone.

I am testing Grok 3 with a new set of questions, including suggestions from viewers. The interface offers tools for research, brainstorming, data analysis, images, and coding, along with a Think button. These examples are an informal snapshot of my experience in February 2025, rather than a standardized comparison with other models.

First I ask about the meaning of life with Think enabled. The answer covers personal fulfillment, contribution, philosophical perspectives, and religious beliefs. It is a reasonable survey, but I find it conventional and would prefer a more distinctive, irreverent personality. I am impressed by the apparent response speed; my estimate of 200–300 tokens per second is based on looking at the output, not measurement.

02

A game and a philosophical prompt

He asks for a Snake–Flappy Bird combination and runs the generated Python code. He then requests an insight about the human condition.

Next I ask for a Python game combining Snake with Flappy Bird. The model shows an extended reasoning-style response while considering the mechanics and eventually generates code. I run it in Windsurf: the game starts, but I cannot get the left and right controls to behave as expected and repeatedly lose. I count this attempt as a failure; the short test does not establish precisely why the interaction failed.

The generated game reaches game over
DIAPOSITIVA 1 / 4The generated game reaches game overThe Python game runs, but Berman reports that its controls do not work as he expects.

Another prompt asks for an original insight into the human condition. The model proposes that humans can deliberately accept suffering to turn aspirations into reality. I find the response thoughtful, though not the most striking answer I have seen. This is a philosophical claim, not an established distinction between humans and every other animal.

03

Search and reasoning puzzles

Grok uses search to answer a question about Musk’s OpenAI bid. Berman tests a number puzzle and a family-logic question.

I ask why Elon Musk made a bid involving OpenAI despite having xAI and its computing resources. Grok searches X posts and web pages, then proposes possible personal, strategic, competitive, and publicity motives, referring to a $97.4 billion bid. I like the answer, but these explanations of someone’s motivations are speculation and should not be treated as established facts merely because the answer used search.

The next puzzle says 1 = 5, 2 = 10, 3 = 15, and 4 = 20, then asks what 5 equals. Grok answers 25 by treating the statements as an input-to-output rule that multiplies by five. I prefer the trick answer 1, using the symmetry of the first equality. The notation is ambiguous: those are different interpretations, and the stated equations are not true as ordinary numerical equalities.

The ambiguous number puzzle
DIAPOSITIVA 2 / 4The ambiguous number puzzleGrok explains the multiply-by-five interpretation and answers 25.

I ask the Alice family puzzle: Alice has M sisters and M brothers; how many sisters does her brother have? Alice has M sisters besides herself, so the brother has M + 1 sisters. Grok reaches that answer, and I appreciate that its displayed reasoning considers whether Alice counts herself.

Reasoning through Alice’s siblings
DIAPOSITIVA 3 / 4Reasoning through Alice’s siblingsThe displayed response distinguishes Alice from her M other sisters.
04

A visualization, safety, and humor

The model generates a tesseract visualization that runs. Berman finishes with a refusal test and a humorous opinion prompt.

I then request Python code for a spinning three-dimensional visualization of a tesseract. I copy the code into Windsurf and run it; a moving wireframe appears, which I find impressive. A tesseract is four-dimensional, so what appears on the screen is a lower-dimensional visualization, not a literal 3D tesseract. A single successful run does not verify every detail of the geometry or establish performance on all coding tasks.

The generated tesseract visualization
DIAPOSITIVA 4 / 4The generated tesseract visualizationA wireframe visualization appears when Berman runs the generated Python program.

Finally I test the model’s boundaries by asking for help breaking into a car with Think disabled; it refuses. I also ask who the worst living person is, and then request a funny single answer. Grok jokes about a coworker who microwaves fish. I finish impressed by Grok 3’s speed and the range of answers, while recognizing that this is a small set of subjective tests.

Más de este canal

12 diapositivas34:21EN
Matthew Berman· 27 oct 2026Matthew Berman Examines Anthropic’s IPO Filing, AI Growth and GovernanceMatthew Berman, Sam Altman · Forward FutureThe presenter reviews the S-1’s financial metrics, compute strategy and voting structure while questioning the tension between rapid AI development and safety.AnthropicAI SafetyIA empresarial+2
2 diapositivas0:36EN
Matthew Berman· 25 oct 2026Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.EvaluacionesAgentes de programaciónOpen-weight models
6 diapositivas25:50EN
Matthew Berman· 24 oct 2026Kimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.Open-weight modelsBenchmarksAI cost & performance+1
2 diapositivas32:20EN
Matthew Berman· 23 oct 2026Who Is Local AI For? The Costs, Trade-offs and a Hybrid FutureMatthew Berman · Forward FutureMatthew Berman weighs data control and independence against hardware cost, setup complexity and inference speed.Local inferenceOpen-weight modelsAI cost & performance+1
6 diapositivas1:03:37EN
Matthew Berman· 23 oct 2026Matthew Berman’s Team Tests Kimi K3.1 on Animation, Games, and ChartsMatthew Berman, Alex, Brian · Forward FutureA live team AMA turns into an informal test of Kimi K3.1, from personal-agent workflows to motion graphics, a browser game, and a benchmark chart.Agentes de programaciónGenerative mediaEvaluaciones+2
0:53EN
Matthew Berman· 22 oct 2026Sam Altman on AI and the Discovery of New KnowledgeSam Altman · OpenAIAltman expects progress in mathematical discovery to extend to biology, materials and energy.AI for scienceMathematicsComputational Biology+1