30초 요약
A speaker describes research that uses formats found in language-model training data to improve prompt accuracy. He offers a tentative explanation and an example of an unfamiliar separator.
- 1Use familiar formatsThe speaker cites prompt-mining work that found accuracy improvements from formats common in training data.
- 2A possible explanationHe speculates that familiar formats may make the task easier for the model.
- 3Avoid unusual separatorsAn unusual question-and-answer layout may be unfamiliar to the model.
핵심 정리
- The speaker cites prompt-mining work that found accuracy improvements from formats common in training data.
- He speculates that familiar formats may make the task easier for the model.
- An unusual question-and-answer layout may be unfamiliar to the model.
챕터별로 다듬은 전문 읽기
Mining common formats
The speaker cites prompt-mining work that found accuracy improvements from formats common in training data.
When choosing an exemplar format for a prompt, I suggest using a common format. I describe a prompt-mining paper in which researchers looked through a language model’s training corpus for common ways of asking and answering questions, then used those formats in prompts and improved accuracy.
A possible explanation
He speculates that familiar formats may make the task easier for the model. An unusual question-and-answer layout may be unfamiliar to the model.
I suspect the explanation may resemble the benefit of a smoother loss function during optimization: the space of questions may be smoother when the model has encountered the format before. That is my interpretation, not a proven mechanism in this clip.
For example, if I separate a question and answer with an unusual run of equal signs, the model probably has not seen that exact format often and may be more confused about what to do.
같은 채널의 다른 글
1:49:40EN
Cognitive Revolution "How AI Changes Everything"· 2026년 10월 28일팟캐스트 · 4명A Strategy for Preserving Options on the Path to Advanced AI게스트 Joel Predd, Ben Boudreaux, Matt Chessen · 진행자 Nathan LabenzRAND researchers discuss uncertainty, security architecture and human agency with Nathan Labenz.
1:28:36ENCognitive Revolution "How AI Changes Everything"· 2026년 10월 24일팟캐스트 · 5명AI’s Pace: Interpretability, GPU Credit and the Physical Supply Chain게스트 Zvi Mowshowitz, Evan Conrad, Lonis Hamaili · 진행자 Nathan Labenz, Prakash NarayananA weekly highlights episode weighs uncertain AI research trajectories against finance, infrastructure, security and regulation.
3:13:44ENCognitive Revolution "How AI Changes Everything"· 2026년 10월 22일팟캐스트 · 4명AI’s Physical Bottlenecks: Compute Markets, Chip Investments and Agent Trust게스트 Evan Conrad, Lonis Hamaili · 진행자 Nathan Labenz, Prakash NarayananA full AI:AM discussion of security incidents, GPU financing, semiconductor supply and an agent-to-agent network.
2:40:58ENCognitive Revolution "How AI Changes Everything"· 2026년 10월 21일팟캐스트 · 3명Frontier AI, Interpretability and the Fight Over Its Pace게스트 Zvi Mowshowitz · 진행자 Nathan Labenz, Prakash NarayananZvi Mowshowitz joins AI:AM to discuss neural networks, policy and the institutions facing rapid change.
1:25:56ENCognitive Revolution "How AI Changes Everything"· 2026년 10월 17일팟캐스트Claude Changed the Password. The Steering Wheel Was Already Optional진행자 Nathan LabenzNathan Labenz and Prakash Narayanan spend a week on agents that can lock you out, models that dodge a feeling they deny having, and formal proofs that found Linux bugs.
2:51:22ENCognitive Revolution "How AI Changes Everything"· 2026년 10월 14일팟캐스트 · 4명AI Minds and 8 mm Memories: Research, Archives and Simulation게스트 Cameron Berg, Phil Maher · 진행자 Nathan Labenz, Prakash NarayananCameron Berg discusses hidden model states; Phil Maher explains preserving home movies and a fly-brain demo.