Mike Krieger on AI Products, Model Competition and the Future of Coding

Anthropic’s chief product officer explains how he thinks about product design, model differentiation and the limits of current AI tools.

MKMike KriegerGast · Anthropic
Kanal
20VC with Harry Stebbings
Veröffentlicht
3. März 2025
Video
1:02:41
Lesezeit
7 Min.
Original
Englisch
Auf YouTube öffnen
Beim Scrollen schrumpft das Video in die rechte untere Ecke und läuft weiter. Untertitel folgen Ihrer Lesesprache.
LesespracheIn 2 Sprachen verfügbar
Diesen Artikel gibt es noch nicht auf Deutsch, daher wird das Original (Englisch) angezeigt.
ZUSAMMENFASSUNG

In 30 Sekunden

Instagram co-founder and Anthropic chief product officer Mike Krieger talks with Harry Stebbings about where AI value may emerge, why product design and evaluation matter, and how builders can work with rapidly changing models. He discusses DeepSeek, Anthropic’s first-party products and API, and the evolving role of software developers. Krieger’s market views and forecasts reflect his role at Anthropic. His scenarios for agents, privacy and medical research are possibilities, not established outcomes.

  1. 1Where value may accrueKrieger expects differentiated distribution, domain knowledge and data to matter, while acknowledging uncertainty.
  2. 2Model differentiationHe predicts models may become more distinct and identifies talent, focus and customer relationships as advantages; Anthropic has a commercial interest.
  3. 3Chinese AI researchHe says observers should not underestimate the capability of Chinese researchers and product teams.
  4. 4Claude Code’s roleKrieger describes a coding tool that still requires human guidance and review.
  5. 5Agent privacyHe warns that assistants with sensitive context need discernment and protection against disclosure.
  6. 6Qualified health optimismA faster reporting step does not mean years of medical research have been compressed into minutes.

Das Wichtigste

  1. Distribution, industry knowledge and workflow data can complement foundation models.
  2. Product teams need to evaluate model behavior as well as design the visible interface.
  3. Fast-changing benchmarks do not by themselves prove sustained customer value.
  4. AI coding may shift work toward specification, delegation, testing and review, though the pace is uncertain.
  5. Agents that access sensitive information need privacy and security safeguards.
  6. Faster research workflows are not the same as proven medical cures.
VOLLTEXT

Den bearbeiteten Text nach Kapiteln lesen

Nur das Transkript
01

Where AI value may emerge

Krieger considers distribution, industry knowledge and the different challenges facing startups and incumbents.

Instagram co-founder and Anthropic chief product officer Mike Krieger joins Harry Stebbings to discuss AI models, product design, coding and the future of work. Krieger speaks as an executive of a company that builds and sells AI models and products.

Asked where value will be created, Krieger says he does not have a crystal ball. He expects durable businesses to combine differentiated distribution, industry knowledge or proprietary data with foundation-model capabilities, particularly in complex fields such as healthcare and finance.

Existing software vendors and new startups face different challenges. Incumbents have customer relationships and workflows but must avoid disappointing users with overpromised AI; startups can experiment more freely but often lack data, distribution and trust.

Krieger advises founders to explore a problem with the models available now rather than wait for a perfect model. Work done to understand the customer and the limitations of earlier tools can become valuable when a later model makes the product feasible.

02

Models, training and evaluation

He discusses differentiation, talent, synthetic data and measuring real-world work.

He identifies talent, differentiated model behavior and customer relationships as potential sources of value at the foundation-model layer. His view that models may become more distinct over time is a prediction offered by an Anthropic executive, not an established market outcome.

He says Claude has developed strengths including coding and that customer usage helps inform future research priorities. He also describes Anthropic’s goal of being a long-term AI partner rather than merely charging for input and output tokens.

For further progress, Krieger emphasizes training environments and evaluations that resemble real tasks. A software engineer does more than generate a code change: the work includes understanding requirements, coordinating with colleagues and responding to user feedback.

He says office work is similarly difficult to measure with a single benchmark. Better evaluation may require both breaking tasks into components and testing how a model operates across an entire, changing workflow.

On training data, Krieger expects a combination of human examples and synthetic environments. Games offer ways to explore many possible paths under clear rules, but he says less well-defined real-world tasks are harder to simulate and assess.

He also wants better methods for evaluating a model’s character and interaction style. Users may notice a model becoming friendlier or more terse even when conventional benchmarks do not capture the change.

Model selection and separate chat histories expose technical complexity to users. Krieger argues that a better interface would hide more of that machinery and make context easier to carry across conversations, rather than requiring users to understand each model’s internals.

03

Designing products around uncertain models

Prompts, evaluation and release practices all shape the user experience.

Product design for a probabilistic system reaches beyond the visible interface. Prompts, whether the model asks follow-up questions, model quality and evaluation all affect the experience; teams need regression tests to detect when a change makes a previously useful workflow worse.

Release practices differ by audience. API customers may prioritize stable behavior and opt-in changes, while consumer products can iterate more visibly; enterprise deployments add their own expectations and administrative constraints.

Krieger describes model launches as unusually difficult to schedule because competitors release products frequently and comparisons can change within days. He encourages teams to focus on their trajectory and customer value rather than overreact to each benchmark result.

Stebbings suggests that brand and personality shape whether consumers identify with a particular assistant. Krieger agrees that interface, model behavior and an intangible sense of how a product feels can matter, drawing an analogy with different social networks.

04

Distillation and DeepSeek

Krieger discusses policy and commercial incentives and recognizes Chinese research capabilities.

On distillation, Krieger acknowledges that transferring capabilities from a larger model to a smaller one can be useful. He argues for considering national security, terms of service and the ability of labs to fund research; these are policy and commercial views from a model provider.

He says model value ultimately depends on the team and whether a system performs reliably in real use, not just on benchmark scores. He does not claim to know exactly what proprietary training data competitors use.

Krieger says it was a mistake to underestimate Chinese AI researchers and product builders. He points to the quality and scale of Chinese technology products as evidence that frontier research and innovation are not confined to Western labs.

He says Anthropic’s researchers saw architectural ideas in DeepSeek worth considering or revisiting. The plan to show reasoning in Anthropic’s own product was already in place, he says, while observing other interfaces provided useful product lessons.

Krieger says DeepSeek broke through to a broad audience and that its story, timing and accessible product helped. He distinguishes that narrative from an independently verified comparison of full training costs, and says Anthropic could communicate Claude’s story more clearly.

He thinks lasting use will require more than an impressive first interaction: an assistant must help people complete valuable work repeatedly. At the time of the interview, he says AI was not yet indispensable to most people’s work.

05

From models to applications

He explains Anthropic’s product choices and the distinction between general assistants and specialized workflows.

Asked when a model provider should build applications, Krieger says Anthropic must select carefully because its product team serves several surfaces. He favors broadly useful capabilities over highly bespoke products for every vertical workflow.

A general assistant may handle occasional translation, while professional tools can differentiate through deep workflow design, reliability and integrations. He praises examples built for people doing the work every day, rather than assuming the underlying model is the whole product.

Krieger describes Claude Code as an agentic command-line tool first built for Anthropic’s internal engineers. He says it was useful enough to release, but not a solution to every coding problem and not a replacement for an integrated development environment.

He says current coding tools still need human interaction: users steer a task, review the result and sometimes backtrack. Anthropic’s focus in this area, he says, is agentic work rather than recreating every feature of an IDE.

06

The changing work of developers

Krieger forecasts more delegation and review while stressing testing and human judgment.

Looking three to five years ahead, Krieger expects developers to spend more time deciding what to build, delegating and reviewing generated code. This is a forecast; he points to the need for security checks, testing and better understanding of a company’s code conventions.

He imagines future agents evaluating several approaches, testing them and presenting a critical decision to a human reviewer. The example is an aspiration about future capabilities, not a description of a fully reliable system available at the time.

Faster code generation can move the bottleneck to deciding what users need and aligning a team around a product strategy. Krieger thinks small teams may benefit because they can reach that alignment more quickly, while emphasizing that this remains a difficult human problem.

07

API and first-party products

He describes feedback loops, product speed and Anthropic’s priorities.

Anthropic’s first-party products and API offer different feedback loops. He says internal use of Claude Code revealed a tool-use issue that informed a later model improvement, while third-party products provide broad distribution and different use cases.

Krieger says the company had underinvested in faster first-party iteration and in API abstractions beyond raw token exchange. He wants to improve capabilities such as tool use, planning and context management; these are product priorities, not guarantees of delivery.

To move faster, he wants teams to cross organizational boundaries, bring the right people together and spend more time in product and design reviews. He says some of the company’s processes had become too rigid for the early state of its products.

He cautions that adoption may be ahead of genuine product-market fit because users come to the apps to access the underlying models. From Anthropic’s perspective, he believes the company still has substantial work to make products serve people reliably.

In quick-fire questions, Krieger credits OpenAI with shipping early versions quickly and says Anthropic has work to do on product cohesion. His comparison reflects his position at a competing company.

He would simplify how users navigate projects, artifacts and conversations, emphasizing the right context and an understandable next step. He says Claude’s original interface began as a model showcase and now needs to support a broader set of jobs.

08

Privacy, human interaction and health

The interview closes with agent privacy risks, Europe and qualified optimism about medical research.

One underappreciated challenge, he argues, is privacy and discernment when agents know sensitive personal or organizational information and interact with others. A helpful assistant must also know when not to disclose information, and systems need protections against manipulation.

Krieger sees possible benefits in practicing social interaction with AI, but says it does not fully substitute for the consequences and experience of interacting with people. His comments about children and AI friends are speculative, not a demonstrated developmental finding.

On Europe, he values the questions its institutions and customers ask about privacy and product design. He sees possible opportunities for application builders but says the outcome depends on the regulatory and startup environment.

Asked about health and longevity, Krieger is optimistic about AI helping research and administration. He cites a company example where a clinical-trial reporting step became faster, while explicitly noting that this did not compress the years of research preceding it.

He also points to research on models of cells as a possible way to accelerate experimentation. His optimism about future drug discovery is a prediction and does not establish a cure or a specific increase in lifespan.

Mehr aus diesem Kanal

23:48EN
20VC with Harry Stebbings· 26. Okt. 2026Podcast · 2 StimmenSatya Nadella on Zero Trust for AI and Why Every Company Should Own Its IntelligenceGast: Satya Nadella · Moderation: Harry StebbingsThe Microsoft CEO argues that capable agents need security boundaries even as alignment research remains unsettled, and explains why firms should retain the value created by their own AI use.Enterprise-KIAI securityEvals+2
1:13:26EN
20VC with Harry Stebbings· 24. Okt. 2026Podcast · 2 StimmenNaveen Rao on Energy, AI Hardware, Verification and the Future of RoboticsGast: Naveen Rao · Moderation: Harry StebbingsThe Unconventional AI founder argues that energy efficiency will shape AI hardware, while the growing volume of model output makes verification more valuable.EnergySemiconductorsInference+2
59:41EN
20VC with Harry Stebbings· 22. Okt. 2026Podcast · 3 Stimmen20VC: Venture Fund Size, AI Valuations and the Changing Software MarketGast: Jason Lemkin, Rory O’Driscoll · Moderation: Harry StebbingsHarry Stebbings, Jason Lemkin and Rory O'Driscoll debate venture concentration, infrastructure risk, code review and the assumptions behind fast-growing AI companies.Venture CapitalInvestingAI cost & performance+2
1:19:50EN
20VC with Harry Stebbings· 19. Okt. 2026Podcast · 2 StimmenSameer Dholakia on AI Investing, Bessemer's Growth Strategy and Company CultureGast: Sameer Dholakia · Moderation: Harry StebbingsThe Bessemer partner explains his approach to pricing fast-growing AI companies, backing founders and building teams, while discussing the risks behind his optimistic forecasts.Venture CapitalAI StrategyLeadership+2
1:03:05EN
20VC with Harry Stebbings· 17. Okt. 2026Podcast · 2 StimmenHarrison Chase on Building Reliable Agents, Model Routing and MemoryGast: Harrison Chase · Moderation: Harry StebbingsThe LangChain co-founder explains why agents remain difficult to control, where domain expertise matters, and how his team manages coding-agent costs.AI agentsAgent orchestrationEvals+2
1:17:09EN
20VC with Harry Stebbings· 15. Okt. 2026Podcast · 3 Stimmen20VC on Pro Rata Rights, AI Pricing and the Changing Software MarketGast: Jason Lemkin, Rory O’Driscoll · Moderation: Harry StebbingsHarry Stebbings, Jason Lemkin and Rory O’Driscoll debate investor rights, model economics and the choices facing software companies and their employees.Venture CapitalAI cost & performanceRobotics+2