In 30 seconds
A speaker describes how his team uses Anthropic caching for long agent histories and claims substantial cost savings. The comparison ends mid-sentence; the original video has embedding disabled and the figures are not current price guidance.
- 1Repeated contextThe agent repeatedly sends long histories with new content appended.
- 2Keep the prefix stableThe speaker says the team designed its workflow to keep earlier content unchanged.
- 3A workload-specific savingHe reports up to 90% cost savings for his use case, not a universal guarantee.
Takeaways
- The agent repeatedly sends long histories with new content appended.
- The speaker says the team designed its workflow to keep earlier content unchanged.
- He reports up to 90% cost savings for his use case, not a universal guarantee.
Read the edited text by chapter
Long repeated histories
The agent repeatedly sends long histories with new content appended. The speaker says the team designed its workflow to keep earlier content unchanged.
The speaker says Anthropic’s caching is important to his agent workflow. The same long conversation history is sent repeatedly as new material is appended, and a call can contain hundreds of thousands of tokens.
He says the team had to design the agent carefully so earlier portions of the history remain unchanged. In his account, making caching work required substantial engineering effort.
Reported cost impact
He reports up to 90% cost savings for his use case, not a universal guarantee.
For this workload, he claims caching can save 90% of cost and says the service would otherwise be uneconomical for the team. This is a reported experience, not a guaranteed saving for every application or a statement of current pricing.
He says caching economics contributed to the team’s decision to use Claude and begins comparing another provider’s savings. The short ends during that comparison, and the original video has embedding disabled. The remarks date from March 2025.
More from this channel
1:49:40EN
Cognitive Revolution "How AI Changes Everything"· Oct 28, 2026Podcast · 4 speakersA Strategy for Preserving Options on the Path to Advanced AIGuest Joel Predd, Ben Boudreaux, Matt Chessen · Host Nathan LabenzRAND researchers discuss uncertainty, security architecture and human agency with Nathan Labenz.
1:28:36ENCognitive Revolution "How AI Changes Everything"· Oct 24, 2026Podcast · 5 speakersAI’s Pace: Interpretability, GPU Credit and the Physical Supply ChainGuest Zvi Mowshowitz, Evan Conrad, Lonis Hamaili · Host Nathan Labenz, Prakash NarayananA weekly highlights episode weighs uncertain AI research trajectories against finance, infrastructure, security and regulation.
3:13:44ENCognitive Revolution "How AI Changes Everything"· Oct 22, 2026Podcast · 4 speakersAI’s Physical Bottlenecks: Compute Markets, Chip Investments and Agent TrustGuest Evan Conrad, Lonis Hamaili · Host Nathan Labenz, Prakash NarayananA full AI:AM discussion of security incidents, GPU financing, semiconductor supply and an agent-to-agent network.
2:40:58ENCognitive Revolution "How AI Changes Everything"· Oct 21, 2026Podcast · 3 speakersFrontier AI, Interpretability and the Fight Over Its PaceGuest Zvi Mowshowitz · Host Nathan Labenz, Prakash NarayananZvi Mowshowitz joins AI:AM to discuss neural networks, policy and the institutions facing rapid change.
1:25:56ENCognitive Revolution "How AI Changes Everything"· Oct 17, 2026PodcastClaude Changed the Password. The Steering Wheel Was Already OptionalHost Nathan LabenzNathan Labenz and Prakash Narayanan spend a week on agents that can lock you out, models that dodge a feeling they deny having, and formal proofs that found Linux bugs.
2:51:22ENCognitive Revolution "How AI Changes Everything"· Oct 14, 2026Podcast · 4 speakersAI Minds and 8 mm Memories: Research, Archives and SimulationGuest Cameron Berg, Phil Maher · Host Nathan Labenz, Prakash NarayananCameron Berg discusses hidden model states; Phil Maher explains preserving home movies and a fly-brain demo.