Does ChatGPT Affect Learning? What One Essay Study Can and Cannot Show

Matthew Berman discusses an early study of AI-assisted writing.

MBMatthew BermanIntervenant · Forward Future
Chaîne
Matthew Berman
Publié
20 juin 2025
Vidéo
25:35
Lecture
3 min
Original
anglais
Ouvrir sur YouTube
En faisant défiler, la vidéo se réduit en bas à droite et continue. Les sous-titres suivent votre langue de lecture.
Langue de lectureDisponible en 2 langues
Cet article n’est pas encore disponible en français ; il s’affiche dans l’original en anglais.
RÉSUMÉ

En 30 secondes

Matthew Berman examines a 2025 study comparing essay writing with AI, search and no tool. The small preliminary study raises questions about effort and recall but does not establish permanent brain damage or a general decline in intelligence.

  1. 1Separate outcomesMemory, ownership and EEG patterns are different measures.
  2. 2Check citationsCitations need checking against original sources.
  3. 3Effort and learningConvenience and active practice can trade off depending on the task.
  4. 4Study designThe preprint reports 54 participants in the first three sessions.
  5. 5Small sampleOnly 18 completed the crossover session.
  6. 6EEG limitsEEG connectivity is not a percentage of brain use or a measure of intelligence.
  7. 7Memory and crossoverThe study does not prove lasting cognitive damage.

À retenir

  1. Memory, ownership and EEG patterns are different measures.
  2. Citations need checking against original sources.
  3. Convenience and active practice can trade off depending on the task.
  4. The preprint reports 54 participants in the first three sessions.
  5. Only 18 completed the crossover session.
  6. EEG connectivity is not a percentage of brain use or a measure of intelligence.
  7. The study does not prove lasting cognitive damage.
TEXTE INTÉGRAL

Lire le texte remanié, chapitre par chapitre

Transcription seule
01

The question

Learning, memory and an exaggerated headline.

Matthew Berman discusses a 2025 MIT-affiliated study of AI-assisted essay writing and asks whether using ChatGPT can impair learning. His opening claim of lasting “damage” is stronger than the study supports: it examined a particular writing task, not permanent brain injury or general intelligence.

He outlines questions about mental effort, memory and ownership when people write with a language model, a search engine or no external tool. These are distinct outcomes and should not be collapsed into a single measure of intelligence.

Berman says the paper makes him reconsider how he uses language models for learning. He remains interested in their value but wants to be more deliberate about when they generate answers versus when he works through a problem himself.

02

Tools and cognitive effort

Citations, search and reasoning.

He notes that a generated citation can be fabricated or fail to support the associated claim. Checking the actual source remains necessary even when an answer contains links.

The discussion considers social learning and the opportunity to reason with teachers and peers. Berman worries that delegating too much work to a model could reduce those opportunities, though the essay study does not directly measure every form of social learning.

He compares web search with model-generated synthesis. Search can require evaluating multiple sources and navigating clutter; a concise answer can reduce some effort while also changing what the learner chooses to inspect.

Berman argues that lower task effort can be a tradeoff: it may speed up an output while providing less practice in assembling and testing one’s own ideas. The balance depends on how the tool is used and the task being performed.

He describes a shift from actively reasoning to supervising an AI-generated response. This is a hypothesis about a possible workflow, not a result that applies automatically to every user or interaction.

03

The experiment

Groups, sample and ownership.

The experiment compares essay writing with an LLM, search and no tool. According to the [researchers’ preprint](https://arxiv.org/abs/2506.08872), 54 people participated in the first three sessions and 18 completed a fourth crossover session; Berman’s cited counts differ.

The video also discusses other research about short-term task performance and knowledge transfer. Findings from different studies should not be combined as though they came from the same experiment.

Berman acknowledges the small sample and describes the groups’ tools and later switching of conditions. The [MIT Media Lab project page](https://www.media.mit.edu/projects/your-brain-on-chatgpt/overview/) identifies the June 2025 report as a preliminary preprint at that time.

He asks whether readers can identify AI-written text and offers his own impressions about style and originality. Feeling that prose is generic is subjective and does not provide a reliable authorship test.

The study reports differences in participants’ perceived ownership of their essays. Berman notes that the responses within the AI group were not uniform, so a single average cannot describe every participant.

04

Interpreting results

EEG, memory and crossover limits.

He discusses the authors’ interpretation of differences in EEG connectivity patterns. EEG connectivity is a specific measurement and analysis, not a direct percentage of the brain being used, a measure of intelligence or proof of injury.

The video highlights differences in participants’ ability to quote their essays and in the small group that switched tools. Those findings are limited to the tested tasks and sample; they do not demonstrate lasting cognitive damage from ordinary ChatGPT use.

Berman interprets the crossover results as a reason to think independently before seeking AI assistance. That can be a useful learning strategy to test personally, but the small crossover sample cannot establish a universal sequence or long-term effect.

Sur la même chaîne

5 diapositives14:45EN
Matthew Berman· 29 oct. 2026Matthew Berman Examines Google’s Gemini 4 Carbon AnnouncementMatthew Berman · Forward FutureMatthew Berman reviews Google’s reported benchmark results, staged rollout and pricing for Gemini 4 Carbon, while noting he has not yet used the model.Foundation ModelsBenchmarksAI cost & performance+2
7 diapositives21:11EN
Matthew Berman· 28 oct. 2026Matthew Berman tests DeepSeek V4.1 Flash: coding, vision and local appsMatthew Berman · Forward FutureA hands-on tour of visual coding, image reasoning, local applications and provider economics reveals both impressive results and visible flaws.Agents de codeMultimodal AILocal inference+2
0:37EN
Matthew Berman· 28 oct. 2026Google Announces Gemini 4 CarbonMatthew Berman · Forward FutureMatthew Berman briefly discusses the model announcement and phased access.Modèles et entraînement
12 diapositives34:21EN
Matthew Berman· 27 oct. 2026Matthew Berman Examines Anthropic’s IPO Filing, AI Growth and GovernanceMatthew Berman, Sam Altman · Forward FutureThe presenter reviews the S-1’s financial metrics, compute strategy and voting structure while questioning the tension between rapid AI development and safety.AnthropicAI SafetyIA en entreprise+2
0:26EN
Matthew Berman· 25 oct. 2026Sam Altman on Human Values and Problem-Solving in an AI WorldSam Altman · OpenAIIn a short interview excerpt, Altman considers the enjoyment of solving hard problems and the human role in interpreting results.Human-AI CollaborationFuture of WorkAI Strategy
2 diapositives0:36EN
Matthew Berman· 25 oct. 2026Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.ÉvaluationsAgents de codeOpen-weight models