A six-week coding agent run and what it took to supervise

OpenAI engineers describe a CI maintenance agent, long-running context and the cost of keeping it working.

Channel
OpenAI
Published
Nov 11, 2026
Video
27:09
Read
4 min
Slides
3
Original
English
Open on YouTube
Scroll to read and the video shrinks to the bottom-right corner. Captions follow your reading language.
Reading languageAvailable in 2 languages
You're reading the original English.
SUMMARY

In 30 seconds

An OpenAI engineering acceleration agent ran for six weeks monitoring and fixing flaky CI tests, its operator says. After four days he delegated individual investigations to subagents while the main thread organized incoming failures; he reports 213 fixes merged and more than 600 coordination messages. The speakers explain the tests, project rules, remote environments and spending limits they use to make long-running work manageable.

  1. 1A short instruction started a six-week CI maintenance runThe operator defined the repository, communication rules and use of CI resources.
  2. 2Delegating investigations kept new failures movingThe main thread coordinated while subagents worked on individual failures.
  3. 3A GPU test required days of investigation and researcher inputThe agent correlated logs, reproduced an intermittent failure and contacted the responsible team.
  4. 4The operator estimated the run at $32 per hourHe says a later model reduced the estimate to $16 per hour; review and CI resources are separate factors.

Takeaways

  1. Give a recurring agent a clear outcome, testable feedback and escalation rules.
  2. Delegate independent investigations when one difficult issue blocks new work.
  3. Keep compact notes so interrupted long-running work can resume.
  4. Set a spending or CI concurrency limit and account for review and infrastructure costs.
FULL TEXT

Read the edited text by chapter

Transcript only
01

Building 3D scenes over several days

The speakers describe a car model and a racetrack render that resumed after interruptions.

Two OpenAI engineers describe long-running coding agents: one works on engineering acceleration and the other on developer experience. They begin with experiments building interactive 3D scenes.

The developer experience engineer asked Codex and Astra to build an explorable Ferrari model and website from seven reference photographs. He worked with it over several days and says it also produced clay and wireframe views.

He then asked for a fly-through of the Nürburgring. He says Codex researched the 21-kilometer circuit, used subagents to check geometry and plan rendering, and resumed from saved frames after memory and overheating interruptions.

A generated Nürburgring fly-through
SLIDE 1 / 3A generated Nürburgring fly-throughThe demo shows the rendered track built during the long-running task.

The engineering acceleration speaker contrasts this with earlier detailed execution plans. With newer models, he says, he is more comfortable specifying the outcome, tradeoffs and success checks while letting the agent choose the steps.

02

Running CI maintenance for six weeks

An agent monitored flaky tests and delegated investigations. Its operator reports the resulting fixes and coordination.

His team maintains continuous integration, which automatically runs tests on changes. Flaky tests can fail once and pass later, making their causes costly to diagnose while new failures continue to arrive.

He assigned an agent to monitor and fix those failures. He says it ran for six weeks until colleagues started similar agents, beginning from a roughly 200-word prompt specifying the repository, communication and CI-resource rules.

Initially a single thread investigated and fixed issues, but difficult bugs blocked attention to new ones. Four days in, he told it to delegate individual investigations while the main thread collected failures, organized work and communicated.

He reports more than 100 pull requests per week, over 1,000 commits, more than 600 Slack messages and 213 of the agent’s fixes merged over the run. In other cases it recognized a colleague already had a similar fix and prioritized that work.

The run made just under half a million tool calls and used over 5,800 subagent sessions, he says. More than 67,000 calls were waits, reflecting the time needed for tests and CI jobs.

03

Investigating a difficult GPU test

The agent correlated intermittent failures and collaborated with researchers.

One difficult example involved intermittent floating-point errors in a GPU test. A subagent correlated logs, isolated a particular node and learned to run repeated tests there over several days.

The agent contacted the responsible researchers to ask whether the cause could be an undocumented optimization or faulty hardware. When uncertain about deleting a failing test, it sometimes asked another agent to challenge the proposed change before human review.

04

Set up long-running work

The speakers describe objectives, tests, logs, remote environments, plugins and parallel chats.

The developer experience speaker recommends one thread per outcome, with a concrete objective and tests that let the agent check its work. He suggests recording project rules and limits in AGENTS.md.

Example CI project instructions
SLIDE 2 / 3Example CI project instructionsThe slide shows tests, work notes and limits for an agent maintaining CI.

A compact work log can record what was tried and what remains, making it easier to resume after an interruption. Context compaction carries relevant information through a long conversation.

Remote environments let work continue without a laptop running continuously. The speakers describe connecting a remote machine or using Codex Cloud, where an environment can be resumed later.

Plugins can give an agent relevant context from sources such as GitHub or Linear, including existing issues, pull requests and discussions. This helps it avoid working without knowledge of related activity.

A large job can be split into child chats for independent parts, such as a 3D model and its website. Separate worktrees give parallel work separate checkouts; the user can open and steer each chat.

The speakers describe a side thread for questions and a higher-reasoning mode with subagents for hard problems. They distinguish independent work suited to parallel chats from a single difficult investigation.

05

Follow up, budget and escalate

Scheduled follow-ups handle external waits. The operator discusses estimated costs and boundaries.

When work depends on an external event such as a review, a scheduled heartbeat can revisit the same thread and act on new feedback. A separate scheduled task can instead create recurring summaries.

Estimated cost of the original run
SLIDE 3 / 3Estimated cost of the original runThe speaker gives an hourly estimate for the six-week agent run.

The engineering acceleration speaker estimates the original six-week run at about $32 per hour based on pricing, and says a later model would reduce the estimate to $16. He notes that review and CI resources are additional factors.

To begin, he suggests selecting recurring work, giving the agent tests and a completion criterion, defining when to escalate, and setting a spending or CI concurrency limit.

More from this channel