GPT-6 Astra: Theo’s Early Tests of Computer Use, 3D and Coding

Theo reviews launch-era pricing and benchmarks, shows projects built with the model, and recounts a frustrating PR-review failure.

ThTheoPonente
Canal
Theo - t3․gg
Publicado
4 sept 2026
Vídeo
44:12
Lectura
8 min
Diapositivas
11
Original
inglés
Abrir en YouTube
Al desplazarte, el vídeo se reduce a la esquina inferior derecha y sigue reproduciéndose. Los subtítulos siguen tu idioma de lectura.
Idioma de lecturaDisponible en 2 idiomas
Este artículo aún no está en español, así que se muestra el original en inglés.
RESUMEN

En 30 segundos

Theo describes his early access to GPT-6 Astra and compares its reported benchmarks and his own projects across computer use, 3D, coding and design. He is especially impressed by computer operation and 3D rendering but finds frontend design and video editing less convincing. He discusses launch-era pricing and staggered availability, then describes a PR-monitoring failure and continuing over-engineering. His evaluations and AGI-like characterization are personal judgments; benchmark results apply to their specific tests.

  1. 1Launch cost and accessTheo discusses API prices, context-related costs and a staggered rollout as they stood at the time.
  2. 2Computer-use speedA displayed OSWorld result and his own portal task underpin his positive assessment.
  3. 33D visuals versus controlsThe aquarium demo looks impressive, but Theo had to iterate to improve movement.
  4. 4Frontend limitationsHe points to excessive UI copy and still prefers Fable 5.1 for design in his tests.
  5. 5Lakebed performance workTheo reports large latency improvements in a private project and describes testing the resulting changes.
  6. 6A PR review failureAn earlier model snapshot repeatedly identified valid feedback without completing the requested follow-up.

Conclusiones

  1. At launch Astra was initially limited to selected organizations; Theo’s prices and availability remarks are time-specific.
  2. Theo finds computer use and 3D rendering especially strong, while attractive visuals do not guarantee good game controls.
  3. Benchmark scores and cost comparisons describe particular settings and do not establish performance or safety in every task.
  4. His media-player and Lakebed examples involved iteration and testing, rather than a guarantee of one-shot success.
  5. An earlier snapshot failed to follow through on PR review comments; Theo says later changes reduced but did not eliminate similar problems.
  6. He finds video editing and frontend design less convincing than the model’s computer-use and 3D capabilities.
TEXTO COMPLETO

Lee el texto editado por capítulos

Solo la transcripción
01

Early access, cost and rollout

Theo introduces his unusually heavy early use and explains launch-era pricing and availability. He notes the limits of what he knows about the delayed rollout.

GPT-6 Astra is the model I have been testing for the past few weeks. My usage shown here amounts to about $330,000 of inference, much of it on this model, during early access. I think its computer use, 3D work and ability to tackle long tasks feel like a generational leap over GPT-5.6 Sol, but it still has rough edges. My experience reflects an unusually heavy early-access workload.

Start with cost and availability as they stood at launch. OpenAI listed standard API prices of $10 per million input tokens and $50 per million output tokens. Fast mode offered up to twice the speed for twice the standard price. Total cost depends on how many tokens a task uses, not just the published rates; long autonomous runs can still be expensive.

Launch API pricing
DIAPOSITIVA 1 / 11Launch API pricingOpenAI’s launch page lists standard token prices and the fast-mode tradeoff.

I compare cache-read prices of $1 per million for Astra with $0.25 for Fable 5.1, while noting Astra's token efficiency can change the final comparison. The model supports a context window up to one million tokens, but the Codex default at launch was expected to be smaller. I discuss higher API rates above 272,000 tokens and say Codex would have an exception; these launch details are time-specific and should not be treated as current pricing.

Staggered rollout and eligible data retention
DIAPOSITIVA 2 / 11Staggered rollout and eligible data retentionThe launch page describes initial availability and zero data retention for eligible API customers.

The rollout is my biggest frustration: OpenAI said Astra was initially available to a limited set of organizations, with broader access to paid ChatGPT plans, the API and AWS to follow. I want viewers to try the examples immediately, but many cannot yet. The announcement also describes zero data retention for eligible API customers; eligibility and product terms matter.

OpenAI representatives said delayed Codex access would be compensated with banked usage resets, and I was told the staggered rollout was temporary. I speculate about possible reasons for the delay, but I do not know why it happened. Availability and subscription arrangements can change, so this is a snapshot of the launch rather than a lasting promise.

02

Benchmarks, computer use and 3D

He discusses reported science and computer-use scores and shows 3D work. His Fish Slop example separates visual quality from interaction quality.

The launch materials show strong results on scientific and agent benchmarks. On Terminal-Bench Science, the chart compares Fable 5.1 at roughly 36% and $15 with Astra on low at roughly 54% and $11. I also discuss ARC-AGI-3, FrontierMath and Terminal-Bench 4, and notice that higher reasoning settings do not always produce the best result. These figures are benchmark-specific, not guarantees for every real task.

Terminal-Bench Science comparison
DIAPOSITIVA 3 / 11Terminal-Bench Science comparisonThe chart compares reported resolution rates and costs under selected reasoning settings.

The ability to work for a long time and retain useful context through compaction feels like learning within a session. I do not mean the model's weights are being updated during the conversation. OpenAI also reports results from an exploit honeypot evaluation; that is one controlled safety test, not a general proof of alignment.

Computer use is the biggest practical leap for me. The OSWorld 2.0 chart reports Astra on high at 71.6% in about 23 minutes, versus Sol's best 65.7% in roughly 75 minutes. That is a comparison on a particular benchmark. In my own work, I find Astra much faster at navigating real applications, and improvements in Codex as well as the model contribute to that experience.

OSWorld 2.0 time and accuracy
DIAPOSITIVA 4 / 11OSWorld 2.0 time and accuracyAstra’s displayed high-reasoning result is shown alongside other model results.

OpenAI demonstrates the model operating Excel through mouse and keyboard rather than merely editing a file programmatically. It may pause to plan, then move quickly. For me it retrieved medical records through a slow portal in about 15 minutes while I did something else. I am impressed by the speed, though one successful run cannot establish reliability for all sensitive workflows.

The 3D and CAD examples are striking as well. The BenchCAD chart reports a high score for Astra at a lower cost than the compared Fable result. OpenAI shows a house created in Blender and turned into a walkable Unreal Engine scene. By contrast, the slides I got in my own testing were not as polished as the company's demonstrations, possibly because my prompts or context differed.

Blender house in Unreal Engine
DIAPOSITIVA 5 / 11Blender house in Unreal EngineThe demonstration illustrates the 3D workflow Theo discusses.

My own Fish Slop demo generated an attractive 3D aquarium with recognizable fish, lighting and functional game loops. Its controls were much worse than Fable 5.1's: mouse movement was initially too fast, then too slow after a correction. I could steer it toward a better result, but the polished first image should not be confused with polished interaction.

Fish Slop aquarium
DIAPOSITIVA 6 / 11Fish Slop aquariumThe demo shows the 3D scene; Theo distinguishes its visuals from its initially awkward controls.
03

Steering, coding and safety evaluations

Theo describes asynchronous questions and coding behavior, then reviews company-reported safety and cybersecurity tests. He questions whether a broad index captures agent capabilities.

Asynchronous questions in Codex
DIAPOSITIVA 7 / 11Asynchronous questions in CodexThe launch page describes asking questions while continuing independent work.

Another improvement is asynchronous questioning in a compatible harness. The model can ask about a decision, continue unrelated work and incorporate an answer later. It also seems less likely than earlier models to abandon the original task when I send a steering message. That said, its understanding of my intent still has limits, and I have had failures I will discuss later.

For code, Astra feels much more mergeable than Sol in my experience. Sol often solved a problem but left an oversized PR, unnecessary tests or changes beyond the requested scope. Astra is more restrained overall, although that does not mean it never over-engineers. The displayed Deep SWE results are another useful data point, not a substitute for reviewing actual changes.

OpenAI presents strong science and cybersecurity results, including a perfect score on the particular ExploitBench setting shown. It also reports fewer misaligned outcomes on a computer-use stress test and improvements on respecting user boundaries. These are the company's reported evaluations under specified conditions; none establishes that a model is safe in all deployments.

The Artificial Analysis index placed Astra alongside models I considered much weaker in agentic work. I suspect its mixture of older knowledge and reasoning benchmarks underrepresents current computer-use and agent capabilities. The founder told me the suite was being revised. The cost-per-task comparisons can still be informative for that benchmark, but no single index captures everything I care about.

04

Design and project demonstrations

Theo critiques UI copy, shows others’ 3D demos and describes his own media and infrastructure projects. He finds video editing disappointing.

Frontend design is better than Sol but remains a weak point. My 2D Fish Slop interface contains more than 20 unnecessary labels and subtitles even after cleanup. Landing-page comparisons show better animations and starting points than earlier OpenAI models, yet I still prefer Fable 5.1 for getting a usable design with fewer prompts.

Excessive subtitles in a 2D interface
DIAPOSITIVA 8 / 11Excessive subtitles in a 2D interfaceTheo uses the page as an example of unnecessary generated UI copy.

Other early testers show 3D work: a Minecraft-like game, an open-world demo, small walkable worlds and a Manhattan scene assembled over a week. These are impressive demonstrations, but they are examples with different prompts and amounts of iteration, not controlled comparisons. A browser-based macOS-like interface also illustrates breadth while still showing visual imperfections.

Minecraft-like 3D demonstration
DIAPOSITIVA 9 / 11Minecraft-like 3D demonstrationFlavio Adamo shows a model-generated game example.

I built a player for music posts on an old blog that struggled with many embedded players. It was not a one-shot: I iterated until navigation and resume behavior worked the way I wanted. I also built a local-network iOS media player with Plex-like features. The initial version worked quickly, but I spent several more prompts fixing rough edges before relying on it.

For my Lakebed project, OpenAI had asked me not to use the preview model on public-facing code, so I tested it on this then-private project. I asked the agent to inspect performance, create tests and pursue improvements. In my measurements, some synchronization paths went from as much as 800 milliseconds to under 30 milliseconds, with a large reduction in p95 latency in some cases.

Lakebed changes
DIAPOSITIVA 10 / 11Lakebed changesThe commit list accompanies Theo’s description of performance work and testing.

I allowed the agent to coordinate subagents and merge changes when it was satisfied, then tested the result myself because prior unattended merges had caused problems. Another model reviewed the changes too. Those are useful checks, not a proof that there can be no regressions or security problems. I want to explore the swarm behavior in more detail separately.

Video editing was much less successful. The model found some potentially useful moments for short clips, but I disliked the cuts and vertical layouts. I will keep relying on my editing team. I am also experimenting with a TypeScript-to-Rust port, but that work is not finished in this video.

05

Failures and the broader picture

A PR review example shows missed follow-through in an earlier snapshot. Theo ends with his personal view of the model’s strengths and asks how users set their trust thresholds.

One failure illustrates the rough edges. On an earlier Astra snapshot, I asked it to use the computer to diagnose a T3 Code scrolling bug and file a PR if confident. It opened a PR quickly, and review bots raised substantive concerns. When I asked whether comments were worth addressing, it said yes but did not act.

Review feedback without follow-through
DIAPOSITIVA 11 / 11Review feedback without follow-throughThe agent identifies substantive review comments, illustrating the behavior Theo criticizes.

I explicitly asked it to fix and push changes and babysit the PR. It stopped monitoring before later comments arrived; I cannot isolate whether that was the model, the harness or rate limits. More frustratingly, when I asked about new comments, it again agreed they were valid without fixing them, despite the earlier instruction and skill context; a later fix was not pushed.

OpenAI made changes to the model and surrounding harness after that snapshot, and I found the behavior reduced, not eliminated. Astra can still over-engineer and get trapped in review loops. Some of my threads remain open longer because getting the change all the way to completion requires additional work, even when the model's underlying capabilities are impressive.

The model's significance for me is broader than a claim that it is the best coding model. I value computer use, 3D tools, coordinating agents and work across connected applications. In one example I used it with Gmail and Notion to help identify priorities while my assistant was away. That is my personal assessment of a particular workflow, not a universal result.

I see these capabilities as a taste of something new and use the term AGI-like to describe my reaction, not as a demonstrated scientific classification. I trust the model for many tasks, while acknowledging the failures I just described. The question I leave viewers with is where they set their own bar for checking work and how they evaluate whether a system has met it.

Más de este canal

5 diapositivas36:07EN
Theo - t3․gg· 27 oct 2026Theo on Token Costs, Coding Agents, and the Price of AI CapabilityTheo Browne · Ping LabsA viral estimate of Lauren's AI spending prompts a closer look at cache pricing, benchmarks, and the changing work of coding agents.AI cost & performanceAgentes de programaciónInference+1
5 diapositivas30:37EN
Theo - t3․gg· 26 oct 2026Theo’s Three Skills for Reviewing and Shipping with Coding AgentsTheo Browne · Ping LabsHow sol-loop, full-send and full-stop encode review, verification and different levels of merge authority.Agent skillsAgentes de programaciónCode review & verification+2
2 diapositivas0:43EN
Theo - t3․gg· 23 oct 2026Theo Distinguishes Security Vulnerabilities from Active AttacksTheo Browne · Ping LabsA short explanation of why disclosed software flaws and reported attacks are different kinds of security news.CybersecuritySoftware engineering
6 diapositivas29:22EN
Theo - t3․gg· 22 oct 2026Theo on Security Vulnerabilities, Stolen API Keys and AITheo Browne · Ping LabsA look at the gap between vulnerability disclosure and patching, and a speculative account of why stolen inference keys may be valuable.CybersecurityAI securitySoftware engineering+1
4 diapositivas31:13EN
Theo - t3․gg· 20 oct 2026Theo on Why Smarter Models Help More Than DevelopersTheo Browne · Ping LabsFrom game modifications to compiler experiments, Theo revisits his assumptions about who benefits from more capable AI.Agentes de programaciónDeveloper productivityHuman-AI Collaboration+1
4 diapositivas31:47EN
Theo - t3․gg· 18 oct 2026Theo on Asking Agents for Outcomes and Building the Tools They NeedTheo Browne · Ping LabsA tool-call report, a troubleshooting playbook and connected data show how prompting can reshape product engineering.Prompting & in-context learningAgentes de programaciónIngeniería de agentes+2