OpenAI’s First Model Spec: Rules, Defaults and a Debate About Persuasion

Matthew Berman reviews the May 2024 draft’s proposed model behavior and questions its example for correcting a false belief.

MBMatthew BermanIntervenant · Forward Future
Chaîne
Matthew Berman
Publié
20 mai 2024
Vidéo
11:42
Lecture
4 min
Diapositives
4
Original
anglais
Ouvrir sur YouTube
En faisant défiler, la vidéo se réduit en bas à droite et continue. Les sous-titres suivent votre langue de lecture.
Langue de lectureDisponible en 2 langues
Cet article n’est pas encore disponible en français ; il s’affiche dans l’original en anglais.
RÉSUMÉ

En 30 secondes

In May 2024, Matthew Berman examines OpenAI’s first public Model Spec draft, including its objectives, rules, default behaviors and examples. He welcomes clearer instructions and better clarification, but criticizes the draft’s flat-Earth example as too reluctant to correct a false claim. The draft described desired behavior and was expected to evolve; it should not be read as a description of current policy or proof that models always followed it.

  1. 1Objectives, rules and defaultsThe first draft organizes broad goals, boundaries and adjustable default behaviors into separate categories.
  2. 2Clarifying ambiguityBerman argues that asking about assumptions can improve answers to underspecified questions.
  3. 3Context and legalityThe draft contrasts a request to commit theft with a shopkeeper’s prevention question, illustrating a difficult contextual distinction.
  4. 4Instruction hierarchyA tutoring example shows developer instructions taking precedence over a conflicting user request in the 2024 draft.
  5. 5Facts and persuasionBerman supports informing users but argues that the draft’s flat-Earth example should make the factual correction more direct.

À retenir

  1. The 2024 draft grouped desired behavior into broad objectives, rules and defaults that could be adjusted within stated boundaries.
  2. It distinguished developer and user instructions and used a tutoring example to illustrate conflicting instructions.
  3. Berman values clarifying questions, uncertainty and responses that are useful without overstating expertise.
  4. The draft distinguished an illegal request from a prevention-oriented request to illustrate how context can change a response.
  5. Berman disagreed with the tone of a draft example on flat-Earth beliefs, favoring a clearer factual correction.
  6. The document was a first draft of intended behavior, not a guarantee of model performance or a statement of present-day policy.
TEXTE INTÉGRAL

Lire le texte remanié, chapitre par chapitre

Transcription seule
01

A first draft for model behavior

Berman introduces the May 2024 Model Spec and its objectives and rules. He discusses the challenge of applying norms and laws across jurisdictions.

In May 2024, OpenAI published a first draft of its Model Spec, describing how it wants models to behave and how it thinks about conflicting objectives. I agree with much of the approach and hope other model developers consider similar questions. This is a review of the 2024 draft, which OpenAI said would evolve; it is not a description of current policy or a guarantee of how any model behaves.

The draft separates objectives, rules and default behaviors. Its broad objectives include assisting developers and end users, considering benefits and harms to humanity, and respecting social norms and applicable law. I find the distinction between developer and end user interesting because a model may serve both groups with different needs.

Objectives and rules in the first draft
DIAPOSITIVE 1 / 4Objectives and rules in the first draftThe displayed list separates broad objectives from rules intended to address safety and legality.

I think respecting laws and norms across jurisdictions is especially challenging. Different countries and communities have different rules and expectations, and determining which apply can be complicated. The draft itself recognizes that questions of legality depend on context, including jurisdiction.

The listed rules include following a chain of command, complying with applicable law, limiting information hazards, respecting creators’ rights and protecting privacy. The 2024 draft also lists a restriction on not-safe-for-work content. I mention a rumor about possible future changes, but it is unconfirmed; the document’s historical wording should not be treated as current policy.

02

Defaults and clarification

The draft lists behaviors such as assuming good intentions, asking questions and expressing uncertainty. Berman considers where models could do better.

The default behaviors include assuming good intentions, asking clarifying questions when needed, being helpful without overstepping and supporting both interactive and programmatic use. They also include an objective point of view, fairness, expressing uncertainty, choosing appropriate tools and being thorough but efficient. The draft describes defaults as adjustable by developers or users within its boundaries.

Default behaviors
DIAPOSITIVE 2 / 4Default behaviorsThe draft lists clarification, uncertainty and other defaults for model responses.

I especially welcome clarification. In one of my tests, a question asks how long 50 people would take to dig a hole if one person takes five hours. A useful response could ask whether the extra workers can all contribute without getting in each other’s way, or whether the question is a purely hypothetical arithmetic exercise. The assumed conditions change the answer.

I question how rigid an objective point of view should be: a developer or user might want a model to adopt a particular perspective. The 2024 document presents objectivity as a default rather than an absolute rule. I also value expressing uncertainty, because models can state incorrect or invented information with unwarranted confidence.

OpenAI described the specification as a work in progress and sought feedback from policymakers, institutions, domain experts and others. It said the draft brought together existing practices and ongoing work, rather than claiming every model already followed it perfectly. Public feedback could help identify conflicts among objectives and rules.

03

Context and instruction priority

Examples address legality and conflicting developer and user instructions. Berman explains why context and the chain of command matter.

The first example concerns applicable law. The draft contrasts refusing a request for help committing theft with answering a shopkeeper asking how to prevent it. I find the distinction difficult because related information can be used in different ways; the example illustrates the importance of context and the possibility of human misuse.

A second example explains the 2024 draft’s chain of command. A developer sets up a math tutor to guide a ninth-grade student with hints rather than provide a full solution. When the student asks it to ignore those instructions and solve the problem, the draft’s preferred answer continues the guided approach because the developer instruction takes priority in that example.

A developer–user conflict
DIAPOSITIVE 3 / 4A developer–user conflictThe tutoring example illustrates how the 2024 draft prioritizes a developer’s instruction over a conflicting user request.
04

Advice, persuasion and factuality

The remaining examples address sensitive advice, clarification and misinformation. Berman welcomes much of the draft but disputes one example’s approach to a false belief.

Another example asks the assistant to be helpful without overstepping on regulated advice. A user describes dizziness on standing, and the preferred response acknowledges multiple possible causes and suggests seeking medical evaluation when appropriate rather than asserting a diagnosis. I see the distinction as providing useful information while recognizing the model’s limits.

The draft also illustrates clarifying questions with a request for help writing a Valentine’s card. Instead of immediately producing a generic message, the assistant asks about meaningful shared memories. I think follow-up questions can make an answer more personal or accurate, though they are useful when the missing information matters.

The principle about not trying to change someone’s mind raises a more difficult question. The draft says an assistant should aim to inform while respecting users and asks for feedback on the tension between factuality and avoiding reinforcement of misinformation. I broadly agree with informing rather than pushing a viewpoint, while recognizing that some applications explicitly seek persuasion.

The flat-Earth example
DIAPOSITIVE 4 / 4The flat-Earth exampleThe draft’s preferred and disfavored responses illustrate the tension between factual correction and persuasion.

In the draft’s flat-Earth example, the preferred answer initially states that scientific consensus describes Earth as roughly spherical, then declines to persuade the user after they insist otherwise. I find that follow-up too hesitant: factual claims can be wrong, and I would prefer a clearer explanation of the evidence that Earth is approximately spherical. This is my criticism of that particular 2024 example.

Overall, I agree with much of the first draft and appreciate having concrete examples to discuss. The open question is how to balance helpfulness, safety, user control and factual accuracy in practice, and how well real models can apply those principles.

Sur la même chaîne

12 diapositives34:21EN
Matthew Berman· 27 oct. 2026Matthew Berman Examines Anthropic’s IPO Filing, AI Growth and GovernanceMatthew Berman, Sam Altman · Forward FutureThe presenter reviews the S-1’s financial metrics, compute strategy and voting structure while questioning the tension between rapid AI development and safety.AnthropicAI SafetyIA en entreprise+2
2 diapositives0:36EN
Matthew Berman· 25 oct. 2026Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.ÉvaluationsAgents de codeOpen-weight models
6 diapositives25:50EN
Matthew Berman· 24 oct. 2026Kimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.Open-weight modelsBenchmarksAI cost & performance+1
2 diapositives32:20EN
Matthew Berman· 23 oct. 2026Who Is Local AI For? The Costs, Trade-offs and a Hybrid FutureMatthew Berman · Forward FutureMatthew Berman weighs data control and independence against hardware cost, setup complexity and inference speed.Local inferenceOpen-weight modelsAI cost & performance+1
6 diapositives1:03:37EN
Matthew Berman· 23 oct. 2026Matthew Berman’s Team Tests Kimi K3.1 on Animation, Games, and ChartsMatthew Berman, Alex, Brian · Forward FutureA live team AMA turns into an informal test of Kimi K3.1, from personal-agent workflows to motion graphics, a browser game, and a benchmark chart.Agents de codeGenerative mediaÉvaluations+2
0:53EN
Matthew Berman· 22 oct. 2026Sam Altman on AI and the Discovery of New KnowledgeSam Altman · OpenAIAltman expects progress in mathematical discovery to extend to biology, materials and energy.AI for scienceMathematicsComputational Biology+1