Opus 5.5: Theo’s First Day with a New Coding Model

Theo compares price, benchmarks, coding work and game demos while cautioning that his assessment rests on a single day of use.

TBTheo Browne연사 · T3
채널
Theo - t3․gg
게시일
2026년 9월 23일
영상
40:14
읽기
8분
슬라이드
8
원문
영어
YouTube에서 열기
스크롤하면 영상이 오른쪽 아래로 작아져 계속 재생됩니다. 자막은 읽기 언어를 따릅니다.
읽기 언어2개 언어로 읽을 수 있음
이 글은 아직 한국어 번역이 없어 영어 원문으로 표시합니다.
요약

30초 요약

Theo Browne shares an early evaluation of Claude Opus 5.5 after one day of use. He likes its clearer communication, coding and apparent subscription value, but discusses token-heavy reasoning, uneven code review, visual design tradeoffs and occasional failures. The benchmark and usage figures are snapshots of particular configurations, while business retention terms and subscription limits depend on the applicable agreement and current product settings.

  1. 1Launch pricingTheo cites $4 per million input tokens, $20 per million output tokens and $0.20 per million cache reads at launch.
  2. 2Token usageThe displayed max-effort index comparison shows Opus 5.5 generating substantially more tokens per task than several other models.
  3. 3Reasoning effortHis unfinished Skate Bench run showed a large increase in tokens at max for a small score difference.
  4. 4A code-review tradeoffHis own codebase investigation favored other models for thorough review, even though he preferred Opus for many daily tasks.
  5. 5A 3D demoHe demonstrates a fish game, then shows an improved version after a further high-effort prompt.

핵심 정리

  1. Lower token prices do not necessarily mean lower total task cost when a model uses more tokens.
  2. Theo’s early coding results are promising but come from only a small number of pull requests.
  3. His benchmark comparisons vary substantially by reasoning setting and task.
  4. The model impressed him in an interactive 3D game, though the demo is not a comprehensive evaluation.
  5. Check the applicable data-retention agreement and current subscription terms instead of assuming all plans have the same protections or limits.
전문

챕터별로 다듬은 전문 읽기

원본 자막만 보기
01

A new Opus after earlier disappointments

Theo contrasts his first day with Opus 5.5 with his experience of earlier models. His conclusions remain preliminary.

Opus 4.5 changed how I worked with coding agents, but subsequent releases did not all live up to that experience. I initially liked Opus 5, then found its writing and coding mistakes made it hard to rely on. After a single day with Opus 5.5, I am excited again, though it is too early for a final verdict.

So far it feels cheaper, clearer in conversation and much better at following instructions and writing code. Whether it can replace Fable for my work is still unknown. I want to show the evidence and examples behind my enthusiasm, including the weaknesses.

02

Pricing, benchmarks and communication

He reviews Anthropic’s claims, token prices, benchmark charts and writing examples. He also discusses business data-retention options.

Anthropic says Opus 5.5 performs near Fable 5.1 on much work and costs 40% less to run than Opus 5 on typical workloads at default settings. It also cites a tester’s 680,000-line migration. Those are company claims and examples; actual performance and cost depend on the task.

Launch cost and speed claims
슬라이드 1 / 8Launch cost and speed claimsThe announcement shows the token prices and Anthropic’s workload-level cost and speed claims.

The launch prices shown are $4 per million input tokens, $20 per million output tokens and $0.20 per million cached input tokens. Anthropic describes the cached-read rate as 60% lower than before and says output generation is over 30% faster. Faster output does not alone determine the time or price of a complete task.

My favorite change is the communication style. Anthropic says it worked on clearer, more natural explanations, and I have already noticed the difference. Putting the important information first makes long agent sessions easier to follow, although clear writing is not proof that the underlying work is correct.

The company’s selected coding benchmarks show strong results. On its Terminal-Bench chart, Opus 5.5 at medium scores above Fable 5.1 at max at a much lower reported cost. Individual benchmarks, effort levels and test conditions matter; those charts do not settle every real-world comparison.

Terminal-Bench score and cost
슬라이드 2 / 8Terminal-Bench score and costThe displayed chart compares selected models and effort levels on one benchmark.

Other charts, including FrontierCode and CursorBench, show that increasing reasoning effort does not always improve a score. I made a separate visualization using Artificial Analysis data so I could compare cost and score more easily. In the displayed index, Opus high scores higher than Astra high but costs more.

In my early use, medium, high and x-high have been useful, while low and max have caused concerns. This is a preference based on limited testing. A different task or budget may make another setting worthwhile.

Anthropic’s writing example illustrates a billing bug. The newer response leads with the finding and clearly separates the effect of the free tier from a regression that omitted the last day of the month. I find the explanation much easier to read than the older example.

A writing comparison
슬라이드 3 / 8A writing comparisonAnthropic’s example contrasts how two model versions explain a billing issue.

I also discuss zero-data-retention options as a reason businesses might choose one model over another. Availability is governed by the specific product, account and contract; a claim about one model’s eligibility does not mean every subscriber automatically has zero retention. Organizations should verify their own terms.

A public comment acknowledging problems with the previous model strikes me as a welcome change in communication. I infer a more open culture from the posts around the release, but that is my impression from outside the company, not a verified change in internal policy.

Before returning to benchmarks I show a third-party action-game demo and mention a practical cache improvement reported by another developer: changing reasoning effort during a session no longer necessarily invalidates the cached prompt. The actual behavior depends on the relevant implementation and version.

03

Token efficiency and effort levels

He compares costs across reasoning settings and presents his own Skate Bench run. The numbers depend on workload and configuration.

On the Artificial Analysis index, Opus 5.5 leads the displayed chart, but I also question what a gap of a few points means in practice. A benchmark summarizes selected tasks and can obscure the qualities that matter in daily coding.

The output-token chart shows another tradeoff. At max effort, Opus 5.5 uses nearly 120,000 output tokens per index task in the comparison, versus about 73,000 for Opus 5 and 27,000 for Astra. A faster token rate can still mean a longer task if many more tokens are generated.

Lower prices help offset the increased token use. At max, the displayed cost per task is close to the earlier Opus model; at medium or high it is much lower. These are index-specific costs, not a guarantee for every workload or subscription.

I plot the cost and score combinations as a frontier and point out another model, MiMo V2.6, that appears competitive at a lower price. The visualization is based on a snapshot of one data source; it should help compare settings rather than serve as a timeless ranking.

Intelligence Index cost curves
슬라이드 4 / 8Intelligence Index cost curvesTheo’s chart visualizes Artificial Analysis scores and cost per task at selected settings.

Artificial Analysis attributes much of the cost moderation to lower input, output and cache-read pricing. Another observer describes medium Opus as reaching Fable-level intelligence at a lower cost; I think that conclusion is stronger than the evidence warrants, even if the measured price gap is interesting.

My frustration with max effort also comes from an actual run: a planning task spent six and a half hours looping and was only partly complete when I stopped it. I switched settings and asked for an update. One failure does not establish that max is always inappropriate, but it shows why I prefer to monitor long runs.

In my Skate Bench experiment, x-high used about 330 tokens per question, while the max run was approaching 5,000 and was still unfinished when I showed it. The preliminary score improved by only about one percentage point. On this particular test, the extra cost did not look worthwhile to me.

Skate Bench in progress
슬라이드 5 / 8Skate Bench in progressThe max run was not complete when shown; the table compares token use, timing and preliminary scores.
04

Usage, code review and design

He describes subscription use, a codebase investigation test and mixed reactions to web designs. These are individual examples and opinions.

I show my subscription dashboard after a day of heavy use across multiple accounts. I estimate that roughly 20% of one account’s weekly limit was attributable to Opus, after accounting for earlier Fable use. This is a personal estimate, not a guaranteed allowance; limits, eligibility and terms can change.

The work included making the benchmark visualizer, adapting it for different hosts and using a browser to verify it. When I noticed a bug in another project, the agent found the repository, updated a stale checkout, made an isolated worktree and prepared a fix. I say these tasks used only a small portion of my weekly quota.

For my own subscription usage, I find the value attractive compared with the alternatives I was using that day. That comparison depends on my workloads and plans; it should not be taken as a general price or value guarantee.

I also tried a personal test asking models to investigate a large codebase and suggest improvements. Grok 4.7 and OpenAI models were more thorough in that setting, while Opus 5.5 improved substantially over Opus 5 according to my judging setup. I speculate about the training data behind Grok’s performance, but do not know the cause.

A deep codebase audit is useful, but I do not do that task every day. It reveals one weakness I perceive in Anthropic models compared with some alternatives, rather than defining the best model for all coding. Findings still require independent validation.

Front-end design gives a mixed picture. In examples using and not using a design skill, many Opus results look merely adequate to me. I prefer Fable’s subtle layout and animation choices in the examples I inspect, although those judgments are subjective and based on a limited sample.

A generated front-end example
슬라이드 6 / 8A generated front-end exampleTheo compares examples of visual design and gives his subjective assessment.

Other people see it differently. Mia generated 100 HTML examples and called Opus 5.5 the best model she had tested; I look at paper-like layouts, a neon design and a chess game. The varied reactions show how prompting, examples and taste can affect a design comparison.

05

Game demos and the model’s quirks

Theo shows third-party examples and his own 3D game. He closes with concerns about compaction, variable results and the limits of one day of testing.

I show other people’s demos, including an integration that brings T3 Code into Minecraft and a series of game experiments. A Dark Souls-inspired demo, a flight simulator and an animated sequence are impressive prototypes, even though they are not equivalent to finished commercial games.

Another developer made a skateboarding game in C++ and a browser-based first-person demo. I observe that the web example looks stronger in some respects and that model-assisted computer use can sometimes identify rendering problems. These examples show possibilities, not a systematic comparison of engines or languages.

My own Fish Slop game initially ran smoothly on my machine, with attractive models and controls. I realized I had used medium reasoning, then asked the model at x-high to refine its visual presentation. The later result builds on the earlier version rather than being an independent one-shot generation.

The 3D fish game
슬라이드 7 / 8The 3D fish gameThe demonstration shows the game after an additional refinement prompt.

The improved demo includes a stingray, animated fish, lighting and a camera mode. I am especially impressed that the gameplay loop made me want to keep playing, although I can still see lighting artifacts. The video conveys my reaction to this particular prototype, not a measured product-quality result.

The model still has quirks. In a long-running performance task, one agent reported that another was close to context compaction and warned that uncommitted work could be lost if it crashed. I thought parts of that warning were confused given the machine and workflow, though uncommitted work can carry risks depending on the failure.

I speculate that earlier training and context limits may explain why the model worries about compaction. That mechanism is not established by this example. Long-running tasks and recovery behavior are also difficult to judge from short benchmarks, so I want more evidence before drawing broad conclusions.

A question about unfinished work
슬라이드 8 / 8A question about unfinished workA status report raises concerns about uncommitted changes and approaching context compaction.

The performance-improved game ran smoothly in my demonstration, but I noticed a transparency problem near the water surface. I like the result while recognizing that a polished demo can still contain visual or functional bugs.

On day one I had only about five medium-sized pull requests to inspect. My rough impression is that severe issues were similar to or less frequent than in my Fable examples, with a similar or slightly higher number of minor issues. The sample is far too small to establish reliable error rates.

I expect occasional bad spikes: on longer work, even a relatively reliable model can get stuck fixing something unnecessary or misunderstand its context. I am not ready to discard Fable based on one day. Both outputs and the systems that verify them still need scrutiny.

My early verdict is that Opus 5.5 is a valuable daily coding option for my subscription usage, though API costs and limits differ. I also want to test GPT-6 Sol more. The competitive picture is moving quickly, and the choice should be revisited as evidence accumulates.

같은 채널의 다른 글

슬라이드 5장36:07EN
Theo - t3․gg· 2026년 10월 27일Theo on Token Costs, Coding Agents, and the Price of AI CapabilityTheo Browne · Ping LabsA viral estimate of Lauren's AI spending prompts a closer look at cache pricing, benchmarks, and the changing work of coding agents.AI cost & performance코딩 에이전트Inference+1
슬라이드 5장30:37EN
Theo - t3․gg· 2026년 10월 26일Theo’s Three Skills for Reviewing and Shipping with Coding AgentsTheo Browne · Ping LabsHow sol-loop, full-send and full-stop encode review, verification and different levels of merge authority.Agent skills코딩 에이전트Code review & verification+2
슬라이드 2장0:43EN
Theo - t3․gg· 2026년 10월 23일Theo Distinguishes Security Vulnerabilities from Active AttacksTheo Browne · Ping LabsA short explanation of why disclosed software flaws and reported attacks are different kinds of security news.CybersecuritySoftware engineering
슬라이드 6장29:22EN
Theo - t3․gg· 2026년 10월 22일Theo on Security Vulnerabilities, Stolen API Keys and AITheo Browne · Ping LabsA look at the gap between vulnerability disclosure and patching, and a speculative account of why stolen inference keys may be valuable.CybersecurityAI securitySoftware engineering+1
슬라이드 4장31:13EN
Theo - t3․gg· 2026년 10월 20일Theo on Why Smarter Models Help More Than DevelopersTheo Browne · Ping LabsFrom game modifications to compiler experiments, Theo revisits his assumptions about who benefits from more capable AI.코딩 에이전트Developer productivityHuman-AI Collaboration+1
슬라이드 4장31:47EN
Theo - t3․gg· 2026년 10월 18일Theo on Asking Agents for Outcomes and Building the Tools They NeedTheo Browne · Ping LabsA tool-call report, a troubleshooting playbook and connected data show how prompting can reshape product engineering.Prompting & in-context learning코딩 에이전트에이전트 엔지니어링+2