Plan in 90-Day Windows: How OpenAI's Product Leaders Ship Fast Without Losing the Plot

OpenAI's Tara Seshan and Nan Yu tell Claire Vo how they ship imperfect features, design agents people can follow, work with research, and think about 2027.

LRLenny Rachitskyホスト · Lenny's Podcast
チャンネル
Lenny's Podcast
動画
29:09
読了時間
5 分
原文
英語
YouTube で開く
スクロールすると動画は右下に小さくなって再生を続けます。字幕は閲覧言語に合わせて切り替わります。
閲覧言語2 言語で読めます
この記事はまだ日本語に翻訳されていないため、英語の原文を表示しています。
要約

30 秒でわかる

Tara Seshan and Nan Yu say building AI products now rewards urgency and empirical testing over a-priori polish, with a planning horizon of roughly two to three months because predicting years out is almost always wrong. They argue that classic PM skills still apply, but onboarding, user trust, last-mile reliability, evals and direct user relationships matter more than ever.

  1. 1Urgency and empirical evidence beat theorizingSeshan, coming from Stripe's deeply polished culture, says she had to shift from getting things perfect a priori to shipping and iterating as fast as possible, even with an imperfect toggle.
  2. 2Aim for where the models will be in two to three monthsNot the present, and not an unusable far future: Seshan keeps a personal doc of her wrong long-range predictions to remind herself why.
  3. 3Capability overhang is the real constraintYu says the biggest limit is people's ability to absorb what models can already do, so it matters little what you put in if users cannot take it up.
  4. 4Do what users need, not what they say they needOpenAI shipped agents to enterprises that were mostly using chat, knowing it broke their processes, because otherwise they risked being leapfrogged.
  5. 5The last mile decides whether an agent feels greatAn agent that gets to 99 percent and then fails is worse than a non-starter, which is why computer use works as a slow, token-hungry fallback that gets the job done.
  6. 6Writing evals is the best way to work with researchCome with specific use cases and sample sessions, then show that a prompt and skills achieve the outcome so research can post-train it into the model.
全文

チャプターごとに全文を読む

01

Ship the imperfect version, then tell users a story they can follow

Host Claire Vo opens with the "toggle", the fact that every AI product has a left and right setting, and asks how OpenAI decides to ship something imperfect. Seshan says that after about seven years at Stripe, where everything was polished and every enum name considered, she has had to change her mindset. Urgency now matters, and nothing compares to watching real users try a feature and iterating from there.

She says the toggle in question is certainly not the ideal solution, but it was important to get an agentic harness into the hands of the more than a billion people who use ChatGPT without disrupting developers' workflows. Yu adds that the obvious next step is no toggle at all. If users can follow a coherent story from step A to step B, with some transparency into what is going on behind the scenes, they accept the evolution and bridges are not burned.

Asked what keeps the quality bar high, Seshan lists a few tests: is it additive and genuinely useful, and does it get uptake and retention when used internally, with something delightful or a new use of the models? Most important in this era is whether it targets where the models will be in two to three months, and whether it gets out of the model's way.

02

People's capacity to absorb change, not the models, is the binding constraint

Yu says the biggest constraint is people's understanding and ability to absorb what they are given. He points to capability overhang: models can do much more than people are taking advantage of, so the gap lies in adoption. Vo notes that B2B customers often say they cannot absorb change at this pace.

The guests concede that to most enterprises the current pace feels beyond breakneck, but say that not shipping the frontier means getting leapfrogged. Most enterprise customers were merely asking questions in chat while the agent revolution was happening, and OpenAI needed to bring agents to them quickly even though it broke their processes and expectations about how updates arrive. They call this the old product truism turned up: do what users need, not what they say they need.

03

Design agents around human limits and finish the last mile with layered tools

Vo asks whether the future is one generic agent identity or many micro agents, as she runs a Codex she talks to all day and around 40 specialized bots. Yu says the most successful designs map onto human nature: 40 agents is a lot to hold in your head, and people who say they manage many usually have a chief-of-staff agent managing the rest. Seshan adds that practical questions decide it, including data access and permissions, whether an agent uses your credentials or a service account, and how memory behaves in a private Slack channel.

On skills, Vo describes a human side (mental models, empathy) and a systems side. Yu calls these the old product principles in disguise, and Seshan adds a third: a relentlessness to try, iterate and learn from feedback loops, now at a much faster clock speed. On the ecosystem, one guest describes a platform exposing layers of hooks for first-party and third-party developers, with computer use as the fallback when pre-built tools are missing.

One guest says there is a huge difference between doing the whole job and getting everything except the last mile: an agent that gets to 99 percent and then fails is worse than a non-starter, an unfulfilled promise. Computer use may be slow and costly in tokens, but it will do the job all the way while the ecosystem catches up with the right hooks and MCPs. The goal, quoting Charles Eames, is that the user should feel like a guest in a home where their needs were anticipated.

04

Work with research through evals, plan in 90-day windows, and talk to users directly

Seshan says working with research was entirely new and is different from working with engineering. Her contribution is to bring very specific use cases, clear user goals and sample sessions showing why the model failed. Writing evals is the most important thing, and the ideal is to show that a given prompt and skills achieve the outcome so research can try to post-train that capability into the model.

On time horizon, Seshan says the ideal is two to three months, since predictions years out are nearly always wrong, although building only for today means being left behind. Vo polls the audience on who is doing 2027 annual planning. Seshan notes that it depends on the business: Stripe's payments dynamics can be modeled with bull, bear and base cases, whereas OpenAI's cannot.

On what still matters, Yu says onboarding matters far more now because of capability overhang, and Seshan says users must be able to predict what an agent will do and understand how their data is used. The usual PM craft still applies, but testing empirically and moving faster has become more important. Both argue for direct, DM-able relationships with users: agent problems like a model that came across as having an attitude are subtle and need follow-up questions.

05

For 2027, the guests bet on voice and products that use themselves

Asked what will be big in 2027, Seshan answers voice. She says it has changed how she works, feels more natural, and has cut the tech support she does for her family, and that it made onboarding OpenAI's own people team onto a new product much easier. She ties this to the idea that human nature, evolved for speaking with others, makes voice intuitive now that the models are finally getting good at it.

Yu predicts something that looks like self-driving. He says the empty input box problem, where you have the product and now must learn how to use it, will be solved by products that are intelligent enough to use themselves and give a gentle on-ramp. Vo adds her own guess of hardware that replaces carrying a laptop, and they agree to see who was right.

同じチャンネルの記事

1:10:27EN
Lenny's Podcastポッドキャスト · 2 人Hard Skills, Soft Skills and Mentors: Jules Walter's Playbook for Growing as a PMゲスト Jules Walter · ホスト Lenny RachitskyYouTube product lead Jules Walter explains how he builds IQ and EQ skills, asks for honest feedback, and recruits mentors with the smallest possible ask.プロダクトと UXProduct ManagementLeadership+3
1:30:46EN
Lenny's PodcastポッドキャストSkip the Funnel of Doom: Cursor's Playbook for Hiring the Top 50ホスト Lenny RachitskyAdam Ward, Cursor's head of talent, explains how to scope, map and relentlessly pursue the best people instead of hiring whoever survives a recruiting funnel.企業と戦略Company BuildingLeadership+3
1:42:04EN
Lenny's Podcastポッドキャスト · 2 人Paid Growth, Step by Step: Shopify's Performance Marketing Lead on Tests, Signal and Team Designゲスト Timothy Davis · ホスト Lenny RachitskyTimothy Davis walks through when to start paid, how to run signs-of-life tests, which platforms to try, what to measure and who to hire first.企業と戦略Go-to-MarketGrowth Strategy+3
1:21:44EN
Lenny's PodcastポッドキャストFrom Rowing to Steering: Inside OpenAI's Push Toward Persistent AI Coworkersホスト Lenny RachitskyTara Seshan, who leads product for Codex and ChatGPT Work at OpenAI, explains how PM work changes when agents do the rowing and people do the steering.エージェントProduct StrategyAI Product Management+3
1:01:00EN
Lenny's Podcastポッドキャスト · 2 人Control Over Attention: How Substack Builds Product for Writers and Readersゲスト Sachin Monga · ホスト Lenny RachitskySubstack's head of product, Sachin Monga, explains the principle behind the company's roadmap, the story of the Recommendations feature, and what he thinks the next era of writing on the internet looks like.プロダクトと UXProduct StrategyGrowth Strategy+3
1:26:22EN
Lenny's PodcastポッドキャストStart Small, Earn Autonomy: What 50+ AI Product Deployments Taught Two Buildersホスト Lenny RachitskyAishwarya Naresh Reganti and Kiriti Badam explain why AI products need a different build process, and how to grow agent autonomy step by step without losing customer trust.プロダクトと UXProduct StrategyAI Product Management+3