Does ChatGPT Affect Learning? What One Essay Study Can and Cannot Show

Matthew Berman discusses an early study of AI-assisted writing.

MBMatthew BermanVortrag · Forward Future
Kanal
Matthew Berman
Veröffentlicht
20. Juni 2025
Video
25:35
Lesezeit
3 Min.
Original
Englisch
Auf YouTube öffnen
Beim Scrollen schrumpft das Video in die rechte untere Ecke und läuft weiter. Untertitel folgen Ihrer Lesesprache.
LesespracheIn 2 Sprachen verfügbar
Diesen Artikel gibt es noch nicht auf Deutsch, daher wird das Original (Englisch) angezeigt.
ZUSAMMENFASSUNG

In 30 Sekunden

Matthew Berman examines a 2025 study comparing essay writing with AI, search and no tool. The small preliminary study raises questions about effort and recall but does not establish permanent brain damage or a general decline in intelligence.

  1. 1Separate outcomesMemory, ownership and EEG patterns are different measures.
  2. 2Check citationsCitations need checking against original sources.
  3. 3Effort and learningConvenience and active practice can trade off depending on the task.
  4. 4Study designThe preprint reports 54 participants in the first three sessions.
  5. 5Small sampleOnly 18 completed the crossover session.
  6. 6EEG limitsEEG connectivity is not a percentage of brain use or a measure of intelligence.
  7. 7Memory and crossoverThe study does not prove lasting cognitive damage.

Das Wichtigste

  1. Memory, ownership and EEG patterns are different measures.
  2. Citations need checking against original sources.
  3. Convenience and active practice can trade off depending on the task.
  4. The preprint reports 54 participants in the first three sessions.
  5. Only 18 completed the crossover session.
  6. EEG connectivity is not a percentage of brain use or a measure of intelligence.
  7. The study does not prove lasting cognitive damage.
VOLLTEXT

Den bearbeiteten Text nach Kapiteln lesen

Nur das Transkript
01

The question

Learning, memory and an exaggerated headline.

Matthew Berman discusses a 2025 MIT-affiliated study of AI-assisted essay writing and asks whether using ChatGPT can impair learning. His opening claim of lasting “damage” is stronger than the study supports: it examined a particular writing task, not permanent brain injury or general intelligence.

He outlines questions about mental effort, memory and ownership when people write with a language model, a search engine or no external tool. These are distinct outcomes and should not be collapsed into a single measure of intelligence.

Berman says the paper makes him reconsider how he uses language models for learning. He remains interested in their value but wants to be more deliberate about when they generate answers versus when he works through a problem himself.

02

Tools and cognitive effort

Citations, search and reasoning.

He notes that a generated citation can be fabricated or fail to support the associated claim. Checking the actual source remains necessary even when an answer contains links.

The discussion considers social learning and the opportunity to reason with teachers and peers. Berman worries that delegating too much work to a model could reduce those opportunities, though the essay study does not directly measure every form of social learning.

He compares web search with model-generated synthesis. Search can require evaluating multiple sources and navigating clutter; a concise answer can reduce some effort while also changing what the learner chooses to inspect.

Berman argues that lower task effort can be a tradeoff: it may speed up an output while providing less practice in assembling and testing one’s own ideas. The balance depends on how the tool is used and the task being performed.

He describes a shift from actively reasoning to supervising an AI-generated response. This is a hypothesis about a possible workflow, not a result that applies automatically to every user or interaction.

03

The experiment

Groups, sample and ownership.

The experiment compares essay writing with an LLM, search and no tool. According to the [researchers’ preprint](https://arxiv.org/abs/2506.08872), 54 people participated in the first three sessions and 18 completed a fourth crossover session; Berman’s cited counts differ.

The video also discusses other research about short-term task performance and knowledge transfer. Findings from different studies should not be combined as though they came from the same experiment.

Berman acknowledges the small sample and describes the groups’ tools and later switching of conditions. The [MIT Media Lab project page](https://www.media.mit.edu/projects/your-brain-on-chatgpt/overview/) identifies the June 2025 report as a preliminary preprint at that time.

He asks whether readers can identify AI-written text and offers his own impressions about style and originality. Feeling that prose is generic is subjective and does not provide a reliable authorship test.

The study reports differences in participants’ perceived ownership of their essays. Berman notes that the responses within the AI group were not uniform, so a single average cannot describe every participant.

04

Interpreting results

EEG, memory and crossover limits.

He discusses the authors’ interpretation of differences in EEG connectivity patterns. EEG connectivity is a specific measurement and analysis, not a direct percentage of the brain being used, a measure of intelligence or proof of injury.

The video highlights differences in participants’ ability to quote their essays and in the small group that switched tools. Those findings are limited to the tested tasks and sample; they do not demonstrate lasting cognitive damage from ordinary ChatGPT use.

Berman interprets the crossover results as a reason to think independently before seeking AI assistance. That can be a useful learning strategy to test personally, but the small crossover sample cannot establish a universal sequence or long-term effect.

Mehr aus diesem Kanal

5 Folien14:45EN
Matthew Berman· 29. Okt. 2026Matthew Berman Examines Google’s Gemini 4 Carbon AnnouncementMatthew Berman · Forward FutureMatthew Berman reviews Google’s reported benchmark results, staged rollout and pricing for Gemini 4 Carbon, while noting he has not yet used the model.Foundation ModelsBenchmarksAI cost & performance+2
7 Folien21:11EN
Matthew Berman· 28. Okt. 2026Matthew Berman tests DeepSeek V4.1 Flash: coding, vision and local appsMatthew Berman · Forward FutureA hands-on tour of visual coding, image reasoning, local applications and provider economics reveals both impressive results and visible flaws.Coding-AgentenMultimodal AILocal inference+2
0:37EN
Matthew Berman· 28. Okt. 2026Google Announces Gemini 4 CarbonMatthew Berman · Forward FutureMatthew Berman briefly discusses the model announcement and phased access.Modelle & Training
12 Folien34:21EN
Matthew Berman· 27. Okt. 2026Matthew Berman Examines Anthropic’s IPO Filing, AI Growth and GovernanceMatthew Berman, Sam Altman · Forward FutureThe presenter reviews the S-1’s financial metrics, compute strategy and voting structure while questioning the tension between rapid AI development and safety.AnthropicAI SafetyEnterprise-KI+2
0:26EN
Matthew Berman· 25. Okt. 2026Sam Altman on Human Values and Problem-Solving in an AI WorldSam Altman · OpenAIIn a short interview excerpt, Altman considers the enjoyment of solving hard problems and the human role in interpreting results.Human-AI CollaborationFuture of WorkAI Strategy
2 Folien0:36EN
Matthew Berman· 25. Okt. 2026Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.EvalsCoding-AgentenOpen-weight models