Build the Factory, Not Just the Product: How Ramp Chases Bottlenecks Across the Whole Development Loop

Ramp CPO Geoff Charles walks through the AI agents his team built for every stage of product development, and what they mean for the PM's role.

LRLenny RachitskyAnime · Lenny's Podcast
Chaîne
Lenny's Podcast
Vidéo
19:31
Lecture
7 min
Original
anglais
Ouvrir sur YouTube
En faisant défiler, la vidéo se réduit en bas à droite et continue. Les sous-titres suivent votre langue de lecture.
Langue de lectureDisponible en 2 langues
Cet article n’est pas encore disponible en français ; il s’affiche dans l’original en anglais.
RÉSUMÉ

En 30 secondes

Using a Formula 1 analogy, Geoff Charles argues that faster coding only moves the bottleneck to the rest of the product process. He shows how Ramp built agents for customer insight, specs, coding, code review, QA, coordination and small UX fixes, then explains how PMs can evolve into factory builders, tastemakers or general managers.

  1. 1The driver is only about 15% of what wins a raceCharles uses motorsport to argue that individual speed is capped by the system around it, so product teams should work on removing bottlenecks rather than asking people to work harder.
  2. 2AI doesn't eliminate bottlenecks, it moves themOnce coding got easy, the constraint shifted to defining, reviewing, testing, coordinating and releasing, which is where product leaders now need to invest.
  3. 3Engineers want a contract, not a long specThe useful handoff combines qualitative and quantitative evidence of the problem, concrete requirements a coding agent can use, and a working prototype for inspiration.
  4. 4Ramp's in-house agents carry real loadInspect writes 75% of PRs, Review Buddy handles 93% of them automatically, and Testo caught 425 bugs in 30 days.
  5. 5Make the organization legible to agentsCharles says every question is effectively an API, and Ramp's Gadget agent now fully answers 85% of the questions PMs used to field.
  6. 6Obsess a little less about the product and a little more about the factoryCharles sees PMs splitting into technical factory builders, tastemakers who hold the quality bar, and GMs who own business outcomes.
TRANSCRIPTION

Lire la transcription complète par chapitre

01

Winning is about the system around the driver, so find the bottleneck and remove it

Charles opens with a story about racing in the 24 Hours of Lemons, where you buy a $500 car and try to survive a day of racing. He crashed hard, and he uses the episode to make a point: in professional racing the driver is only about 15% of the impact, and the rest comes from the interaction between driver, car and team. Even the best drivers can only perform up to the level of the system.

The pit stop is his main example. Changing tires took 67 seconds in the 1950s and takes 1.8 seconds today, and that did not happen by asking mechanics to work 37 times harder. Teams found bottlenecks and iterated on them with specialized functions, better technology and more practice. F1 is relentless about it, with only about 10% of the 16,000 parts in a car carrying over each year.

Charles asks leaders to imagine what it would mean if 90% of their code changed every year, because that is the bar. For a product team, he says, the clock starts when a customer has pain and stops when they have a product that solves it. AI removes a bottleneck but also moves it, so the winning team is the one that finds the next bottleneck fastest.

Engineers have automated much of their work, so the constraint has shifted to the rest of the loop: identify, define, build and improve. There is more to define, coordinate, test and release than ever. His advice to product people is to be as lazy as engineers and invest in their own factory, because the speed of that loop decides the race.

02

Identifying and defining problems works best when agents are connected to your systems

The first bottleneck is sifting through noise. Customer pain is scattered across Gong, Zendesk, LogRocket, surveys and angry emails to executives, and a one-million-token window holds less than 0.5% of Ramp's Gong transcripts. Ramp first tried a Slack "hate channel" posting daily customer complaints, which got out of hand, so the team rebuilt it from scratch.

The result is a customer insight agent that pulls from every data source using traditional ETL pipelines, vector search and clustering. It understands Ramp's product, teams and features, and the whole company can access it. Ramp then experimented with delivery formats including a Slack agent, an HTML dashboard and, as Charles's favorite, a "hate podcast" that plays customer complaints. The goal is not to skip customer conversations but to pick exactly which customers to talk to, since the data is traceable.

For defining the product, Charles argues that a generic AI asking "what do you want to build?" is a poor starting point. Ramp built an agent called Glass that connects to Snowflake, user research, product strategy, spec formats and the codebase. A PM can ask it whether something is possible or would break something, instead of interrupting an engineer, and use it as a tech lead and thought partner.

Glass can also build a working prototype that respects Ramp's product principles and design system. Charles says engineers don't want a standalone prototype or a long spec. They want the combination of qualitative and quantitative evidence, concrete requirements for their coding agents and a prototype to be inspired by, which he calls the next contract.

03

Once coding is solved, review and testing become the next constraints, and Ramp built agents for each

Ramp built its own coding agent, Inspect, so it could control the harness and make sure the agent really understood the codebase. It runs inside Slack, is fully provisioned and returns a deployed preview so product managers can use what was built. According to Charles, Inspect has had a million sessions and writes 75% of Ramp's PRs, and a thousand PRs last month came from non-engineers.

His tip is that coding agents work best on a strong architecture and codebase, which expands how much of the company can use AI. But more code means review becomes the bottleneck. Review Buddy knows the codebase, quality checks and security concerns, finds the right human reviewer and can audit the prompts that produced the code. It handles 93% of PRs automatically, leaving top engineers to focus on the 7% that carry real risk.

Testing was next. Instead of PMs spinning up QA environments and clicking through screens, Ramp built Testo, a browser-based QA agent. It runs the product in around 100 combinations based on production data and acts like a user, for instance paying an invoice and amortizing it. It reports blocking bugs and also thoughtful design feedback on confusing flows or breaks from the design system.

Testo's findings feed back into the development loop. Charles says it caught 425 bugs in the last 30 days, which he considers better found by Ramp than by customers. Shipping at this pace creates the next problem, which is making sure everyone stays informed.

04

Human attention is the next bottleneck, so make the organization legible to agents

With so much shipping, Charles says the scarce resource becomes human attention, and PMs drown in notifications. Too much process slows builders, while too little leaves everyone confused. His principle is that every question is an API. You design a system that understands the intent of a question and connects it to the formal record, such as roadmaps, specs and customer calls in Notion, plus Slack and Linear tickets.

Ramp's agent for this is called Gadget. Asked about a project's status or whether a launch is on track, it understands who owns the next steps and answers with evidence. It also updates the roadmap, posts status updates and pings people who are late. Sales can ask whether a feature is available in Brazil or how to sell it, and Gadget routes to a person when it doesn't know.

Gadget can also help with launches by drafting help center articles, blog posts and customer emails. Charles says 85% of the questions asked of PMs are now fully answered by AI, and unanswered ones are fed back into the system. His advice is to start in one place and watch it expand.

The last piece is automating the small things. Charles says PMs gravitate toward small, visible, reactive wins, and that is a mistake if you want to be ambitious. At Ramp an AI routes an issue to the right team, matches it to the Linear backlog, dedupes, ranks and plans it, checks in with a human on Slack, writes the code, runs tests and updates the knowledge base. Thanks to these loops, 60% of UX issues are fixed within 24 hours.

05

Constraints are a choice of dimension, and the PM's job will split into three tracks

Charles takes three questions from the audience's likely thoughts. On measuring speed, he notes it is harder than a lap time. His answer is to hire a driver who knows what real speed looks like, put them in charge and let them challenge you, as Niki Lauda did when he told Ferrari their car drove poorly.

On limited budgets of engineers or tokens, he cites Audi's slow car in 2006. Unable to go faster than rivals, the team focused on fuel efficiency, stopping less and spending more time on track, and won three years in a row. His lesson is to embrace constraints but not bottlenecks, and to pick the one bottleneck you believe could 10x your company.

On the future of product, Charles says he is not scared that loops run without PMs, because that gives leverage. He sees three tracks. The technical PM builds the factory and removes drag, shipping the product that helps build the product. The tastemaker is the driver who holds the steering wheel and the quality bar, and the GM extends beyond product into marketing, sales, growth and operations to own business outcomes.

He recaps three takeaways: speed is about finding and removing the bottleneck, each solved bottleneck reveals the next, and product leaders should obsess a bit less about the product and more about the factory. He adds that everything he showed is already outdated and invites others to copy and surpass it. Quoting Enzo Ferrari that the best Ferrari is the next one, he says the best product is the next one, and it starts in the software factory.

Sur la même chaîne

1:10:27EN
Lenny's PodcastPodcast · 2 voixHard Skills, Soft Skills and Mentors: Jules Walter's Playbook for Growing as a PMInvité : Jules Walter · Anime : Lenny RachitskyYouTube product lead Jules Walter explains how he builds IQ and EQ skills, asks for honest feedback, and recruits mentors with the smallest possible ask.Produit et UXProduct ManagementLeadership+3
1:30:46EN
Lenny's PodcastPodcastSkip the Funnel of Doom: Cursor's Playbook for Hiring the Top 50Anime : Lenny RachitskyAdam Ward, Cursor's head of talent, explains how to scope, map and relentlessly pursue the best people instead of hiring whoever survives a recruiting funnel.Entreprise et stratégieCompany BuildingLeadership+3
1:42:04EN
Lenny's PodcastPodcast · 2 voixPaid Growth, Step by Step: Shopify's Performance Marketing Lead on Tests, Signal and Team DesignInvité : Timothy Davis · Anime : Lenny RachitskyTimothy Davis walks through when to start paid, how to run signs-of-life tests, which platforms to try, what to measure and who to hire first.Entreprise et stratégieGo-to-MarketGrowth Strategy+3
1:21:44EN
Lenny's PodcastPodcastFrom Rowing to Steering: Inside OpenAI's Push Toward Persistent AI CoworkersAnime : Lenny RachitskyTara Seshan, who leads product for Codex and ChatGPT Work at OpenAI, explains how PM work changes when agents do the rowing and people do the steering.AgentsProduct StrategyAI Product Management+3
1:01:00EN
Lenny's PodcastPodcast · 2 voixControl Over Attention: How Substack Builds Product for Writers and ReadersInvité : Sachin Monga · Anime : Lenny RachitskySubstack's head of product, Sachin Monga, explains the principle behind the company's roadmap, the story of the Recommendations feature, and what he thinks the next era of writing on the internet looks like.Produit et UXProduct StrategyGrowth Strategy+3
1:26:22EN
Lenny's PodcastPodcastStart Small, Earn Autonomy: What 50+ AI Product Deployments Taught Two BuildersAnime : Lenny RachitskyAishwarya Naresh Reganti and Kiriti Badam explain why AI products need a different build process, and how to grow agent autonomy step by step without losing customer trust.Produit et UXProduct StrategyAI Product Management+3