Cognition's AI Productivity Guarantee for Devin

SUMMARY

In 30 seconds

Matthew Berman describes Cognition's AI Productivity Guarantee and its effort to measure useful work rather than token consumption. Cognition says the offer applies to enterprise deployments: if estimated engineering value falls short of consumption, it issues usage credits up to $10 million. The estimator is a proxy for productive hours, not a complete measure of business return.

1A productivity promiseBerman introduces Cognition's offer as a response to uncertain AI spending. The company's announcement specifies enterprise terms and usage credits.
2A capped guaranteeCognition says it compares estimated value and actual consumption near the end of an annual contract and issues credits up to $10 million if value falls short.
3Estimating useful workA separate agent estimates whether output is useful and how long a human engineer might take. That estimate is not a complete measure of ROI.

Takeaways

Cognition's guarantee compares estimated engineering value with actual Devin consumption for enterprise customers.
The company says it will issue usage credits up to $10 million if the value falls short; this is not an unconditional cash payment for every failed task.
An estimator judges whether each session produced useful output and estimates equivalent human engineering time.
The company itself notes that estimated engineering hours do not replace a full ROI assessment.

TopicsDeveloper productivity Coding agents Pricing Evals

FULL TEXT

Read the edited text by chapter

Show transcript

Transcript only

The productivity guarantee

Berman introduces Cognition's enterprise offer in the context of AI spending. The company specifies a capped usage-credit mechanism.

Matthew Berman introduces Cognition's AI Productivity Guarantee, arguing that companies need to know whether AI coding tools produce value rather than merely consume tokens. He cites a claim about Uber spending its annual budget in three months; the brief clip does not provide its source or scope.

Berman says Cognition will pay when AI does not earn its keep. The company's June 2026 announcement is more specific: for enterprise deployments of Devin, estimated productive engineering hours are converted to a dollar value and compared with actual consumption near the end of the annual contract. If value falls short, Cognition says it issues usage credits up to $10 million; it is not an unconditional cash payout for any failed AI task.

Measuring output

He describes a system for estimating useful output and equivalent human time. Cognition acknowledges that this is not a full ROI measure.

SLIDE 1 / 1Cognition describes its estimatorThe displayed post summarizes the system's two questions: usefulness and equivalent human engineering time.

The proposal shifts attention from maximizing token use to measuring useful work. Cognition says an agent reviews completed sessions to assess whether their output was useful and estimate how long a human engineer would have taken. Berman observes that the measurement problem is difficult; Cognition also says estimated productive hours are not a substitute for measuring full business ROI.