Seven People Did the Work of 700. Salesforce's AI Chief Says Enterprise AI Is Still in the Second Inning

Clara Shih tells Sarah Guo and Elad Gil why Salesforce built a shared LLM platform, why data cleanup beats model shopping, and why AI is becoming the enterprise UI.

SGSarah Guo진행자 · Conviction
채널
No Priors
게시일
2023년 12월 7일
영상
27:14
읽기
10분
원문
영어
YouTube에서 열기
스크롤하면 영상이 오른쪽 아래로 작아져 계속 재생됩니다. 자막은 읽기 언어를 따릅니다.
읽기 언어1개 언어로 읽을 수 있음
이 글은 아직 한국어 번역이 없어 영어 원문으로 표시합니다.
요약

30초 요약

Clara Shih, CEO of Salesforce AI, argues that ChatGPT was a starting gun, not the whole race. After prototyping Service GPT with customers such as Gucci, Salesforce pulled model fine-tuning, prompt building, and a trust layer into a common platform instead of letting every cloud invent its own. Most enterprises, she says, are still in the second or third inning: a few have rewritten the contact-center day, the rest are still getting their data in a row. The conversation covers open model architecture, retrieval-augmented service, a generative canvas prototype, pricing for real compute costs, and where startups still have room beside a giant CRM.

  1. 1After ChatGPT, every Salesforce cloud wanted its own LLM stack. The company instead built shared services for fine-tuning, prompt building, a trust layer, and a gateway so product lines and the ecosystem could all move fast.
  2. 2Enterprise generative AI, Shih says, is roughly the second or third inning: enough proof that processes can transform, not enough clean data for most large companies to follow.
  3. 3Step one is not the model. It is the dataSalesforce Data Cloud became the fastest organically developed product in company history because training, fine-tuning, and RAG all starve without it.
  4. 4At Gucci, retrieval-augmented advisors cut handle time and then used the extra minutes to sell: a service rep with a 360-degree customer view started doing sales and marketing in the same call.
  5. 5Shih's product bet is blunt: AI is the new UI — or Slack is the new UI for AI. Acquisitions made for other reasons, Slack, Tableau, and MuleSoft, now look like an agent stack.
  6. 6Runway's work on *Everything Everywhere All at Once* is her extreme ROI story: a visual-effects team of seven where a film that size would once have needed 700. Cover compute costs, but only if customers can see handle time and conversion move.
전문

챕터별 전체 원고 읽기

01

ChatGPT was the starting gun. Salesforce answered by building one platform, not seven

Sarah Guo introduces Clara Shih as CEO of Salesforce AI, a job that covers the copilot and agent platform, model development, go-to-market, adoption, partnerships, ecosystems, and secure, responsible AI. Guo jokes that she got tired just reading the list. Before that, Shih ran Salesforce Service Cloud, co-founded and led Hearsay Social, and sat on the Starbucks board. The dual resume — scaled operator and founder — is why Guo and Elad Gil wanted her view of enterprise generative AI in late 2023, when every company was asking how to actually use the stuff.

Shih's AI work predates the current wave. At Hearsay, the company already used NLP to mine financial advisors' social messages for lead-generation opportunities and compliance infractions, all before large language models. When she joined Service Cloud almost three years earlier, customer service was already thick with chatbots running early, pre-GPT transformer models. As those models and the OpenAI ecosystem improved, it became obvious this would be core to the product. About a year and a half before the recording, she and engineering leader Jayesh doubled down on experiments and prototypes, including with Gucci, that became the early shape of Service GPT. They were learning and iterating as they went.

Then ChatGPT launched, and every customer was suddenly interested. Across Salesforce there was a wakeup: how do you apply large language models to every cloud? Sales, marketing, commerce, and Slack could each have built their own stack. Shih's group argued for a common platform and shared services instead — model fine-tuning, Prompt Builder, a trust layer, a gateway — so the company and its ecosystem could all go fast. That argument was formalized into the Salesforce AI CEO role she had held for about six or seven months when she sat down with No Priors.

02

The model strategy is open architecture because no single model fits every customer

Salesforce has been in the AI story since Einstein, now evolved into Einstein Copilot and Einstein GPT. The company has built large language models for four or five years and open-sourced many of them on Hugging Face, another Salesforce Ventures investment. Shih is not trying to freeze a single-model strategy. Large enterprises arrive with their own models or want to fine-tune. SMBs want Salesforce to figure everything out. A third group wants Salesforce to pick the right model for the right task from data, feedback, cost, performance, and latency. A software company serving that mix cannot write strategy as one model assumption.

The supply side is therefore three layers. In-house models include CodeGen from the research team, which powers Apex code generation in Developer GPT, plus fine-tuned domain versions for customer service, sales, healthcare, and financial services. Customers can spin up and fine-tune their own models on data in Salesforce Data Cloud. Third-party options include Anthropic and Cohere, both Salesforce Ventures investments, OpenAI as a close partner, and Google Vertex — buy through Salesforce or bring your own API keys.

In March 2023 the company announced out-of-the-box AI features in every existing Salesforce cloud. Service GPT, Sales GPT, and Marketing GPT are, in Shih's telling, prompt templates product managers wrote against operational bottlenecks. The most popular in market is service reply recommendations: a customer emails or chats, and the system drafts a response grounded in knowledge articles and similar past cases. It is generally available, with customers using it and sending feedback.

In parallel, the platform team is building Copilot as a natural-language interface across the clouds and Slack, plus Copilot Studio in three parts. Prompt Builder, piloted the week before the interview, lets customers take official templates and change brand tone, model, and grounding — including custom fields that exist only in their org. Action Builder gives the copilot agent powers: decades of Salesforce workflows, sharing rules, permissions, and MuleSoft integrations, with their SLAs and security guardrails, can be designated as actions in one click. Einstein Studio is bring-your-own-model, training or fine-tuning predictive and generative models on data Salesforce holds or indexes.

03

Adoption is the second inning, and the first move is getting the data ducks in a row

Gil wants the unglamorous number: how much generative AI is actually in production versus experiments and pilots? Salesforce has so many customers that the answer is all of the above. A handful have rolled Service GPT or Sales GPT across the contact center, already changing reps' days. Shih has talked to agents who feel they are doing the best work of their careers because the manual lookup and rote tasks that used to bog them down — and make customers angry — are largely automated or accelerated. Most customers sit in the middle, still experimenting, suddenly aware that they need their data ducks in a row, connecting Salesforce Data Cloud to the multiple data lakes every Fortune 500 company seems to own.

Asked whether large-scale enterprise adoption is one, two, or three years away — a question that matters to eval and observability startups whose futures ride on that ramp — Shih refuses a single date. There is a distribution. Aggregated, it is early: probably the second or third inning. She is not a baseball expert, she adds, but that is roughly the location. Enough companies, though few and far between, have proved you can transform business processes in a big way. Most enterprises still have data all over the place. That is step one. Data Cloud has become the fastest organically developed product in Salesforce history, driven by the need for data to train, fine-tune, and retrieve. Zero-ETL sharing integrations with BigQuery, Databricks, and Snowflake are meant to pull structured and unstructured data into one place.

Gil's sequence — data, then internal or external prototypes, then push to end products — is largely right, Shih says, with a smaller bite available. Because Salesforce is a CRM company, the most common entry is customer service. You do not have to clean all enterprise data first. Bring knowledge articles across silos together with Data Cloud connectors, vector search, and embeddings, and you can drive decent RAG for questions that hit the self-service agent, formerly Einstein Bots, or a human. That is a production-shaped wedge while the rest of the lake is still a mess.

04

AI is the new UI, and it is already rewriting the service job at Gucci

Guo asks how Shih educated product managers and engineers across such a wide suite. It has not been one-way. Curiosity is high; much of the roadmap is coming from people across the organization. As agents mature, she thinks software development itself will change. Branching logic, execution paths, and painstakingly specced screens may get handed to an agent to do dynamically. Guo then asks the better consumer question: efficiency in the contact center is easy to picture, but what should an ordinary end user expect to get better?

Shih's line is the episode's thesis: AI is the new UI, or maybe Slack is the new UI for AI. Slack, Tableau, and MuleSoft were not acquired in the name of AI. In hindsight they look perfectly placed — a conversational interface, data visualization, and every plugin an enterprise might want. On product UX, Salesforce is testing a raw prototype called Generative Canvas. As you talk to Einstein Copilot about a sales opportunity, components pop up: Tableau and Salesforce report visualizations, record updates, the pieces a Lightning web component page used to hard-wire. The components already exist; the model has to call the right ones. It is messy and not ready for prime time. They are showing it to customers, using it themselves, and expecting to roll out something radically different. Slack work is also exploring agents that serve teams, not just one person.

The day-to-day change is already visible in service. Gucci hired a wave of new representatives during Covid, with high early turnover. Luxury service is hard: customers spend a lot and expect the advisor to know the product. Retrieval augmentation now arms every advisor, even a new hire, with expert brand storytelling and troubleshooting. Average handle time on support issues has gone down, but the call does not get colder. Because Salesforce holds a 360-degree customer view, the advisor can see that the broken purse buckle is fixed and that a belt and shoes sit in the cart, or that the customer has been browsing the site. The same person then tells you about the heritage of the shoes, and that Jackie Kennedy used to wear them. Service, sales, and marketing collapse into one question: what does the customer want, and how do you give a new hire all the knowledge required to meet it.

05

Not all unstructured data is equal, and AI pricing only works if the ROI is visible

Guo asks what enterprises have learned about sensitive data, ownership, and quality. Shih says they do not have all the answers, but one distinction is already load-bearing. Unstructured data is not one thing. A PRD or a knowledge article was written to communicate; you can probably assume every sentence matters. Call transcripts, chat logs, and Slack channels are the opposite: most of it was not intended for other people — back-and-forth, clarification, someone talking about their dog. That second kind cannot go straight into retrieval. It has to be preprocessed and mined, a capability Salesforce is building into the platform. Vectorizing is not enough, either. A retail call may reveal that a customer's favorite color is blue and that she has a teenage daughter she also shops for. Those facts should land in structured Salesforce fields.

Asked for unexpected emergence, Shih says everything — the fact that it works so well, a surprise every week. Two to four years out, she analogizes to the early cloud. Some applications clearly belonged on demand and on a phone; some still want to stay on-prem. AI will split the same way. Workflows that must be fully deterministic and reproduce the same way every time — authentication, a financial transaction, a healthcare procedure — will stay as they are. Everywhere else, the job of the engineer, product manager, and designer shifts from prescribing the how to describing the why, the what, and the goal, leaving the AI to figure out the how stochastically.

Pricing is the hard business problem because AI has real compute COGS. Salesforce has put prices in market and talks about the tension constantly: cover costs, but do not make customers run complicated token calculators. The requirement that actually matters is ROI. For Gucci and other retailers, is average handle time down, and is sales conversion up versus baseline? If the value is there, customers will pay. It cannot be an added cost without a clear benefit. Gil is optimistic for two reasons: many applications are net-new capabilities or order-of-magnitude productivity gains, and the cost of doing the same task with models should fall as the stack improves. Shih's extreme sample is a meeting the day before with Runway ML founder Cristóbal Valenzuela. Runway powered much of the effects in *Everything Everywhere All at Once* with a video-editing team of seven; a movie that size would traditionally have needed 700. Jobs and the Hollywood strikes sit behind that number. From an ROI standpoint, she is sure the studio and Runway can find a model that works.

Guo's last question is the founder one: with Salesforce's product, channel, and data advantages in the room, where should startups push? Shih lists four layers. Foundation-model companies, if you can still call them startups given their size. Domain-specific work in legal or medicine. Tooling, because different organizations have different needs. And applications, which will be built very differently than they are today. Her concrete advice for the application layer is to align with existing data graphs, because usefulness needs an anchor in data. We do not know what we do not know, she says. It is a time to invent and test. Salesforce is doing a lot. It cannot do everything.

같은 채널의 다른 글

39:23EN
No Priors: AI, Machine Learning, Tech, & Startups· 2026년 10월 15일팟캐스트 · 2명The Defenders' Window: Greg Brockman on AI-Generated Knowledge, Drug Discovery, and the New Physics of Cybersecurity진행자 Sarah Guo, Elad GilOpenAI's president explains why solving open math problems is a proof point for science, how proactive agents change product form, and why security spending must exceed software spending.보안과 안전AI security안전과 거버넌스+3
1:09:44EN
No Priors: AI, Machine Learning, Tech, & Startups· 2026년 10월 9일팟캐스트 · 2명10,000 GB300s for Four Weeks: Reflection’s Open-Model Ledger진행자 Sarah Guo, Elad GilMisha Laskin tells No Priors how Reflection trained Beam, why reinforcement learning outspent pre-training, and why the West needs its own open weights.오픈소스와 커뮤니티Open-weight modelsReinforcement Learning+3
35:39EN
No Priors: AI, Machine Learning, Tech, & Startups· 2026년 10월 2일팟캐스트 · 2명Compute Scaled a Millionfold. Bandwidth Only 40x. Fractile Wants to Fix That Ratio진행자 Sarah Guo, Elad GilIn the summer of 2022, Walter Goodwin founded Fractile in London to build very fast inference chips for the world's largest models.인프라와 배포InferenceAI cost & performance+3
42:44EN
No Priors: AI, Machine Learning, Tech, & Startups· 2026년 9월 24일팟캐스트 · 2명They Paid $7.7 Billion for a Broker — and Intend to Do One Deal a Year진행자 Sarah Guo, Elad GilSequence Holdings co-founder Michael Lee tells No Priors why owning a market leader, not selling it software, is how AI actually remakes an incumbent.기업과 전략엔터프라이즈 AIAI Strategy+3
38:14EN
No Priors: AI, Machine Learning, Tech, & Startups· 2026년 9월 18일팟캐스트 · 2명Diffusion Will Win Inference: Stefano Ermon Bets Parallel Tokens Beat Custom Silicon진행자 Sarah Guo, Elad GilThe Stanford diffusion pioneer tells No Priors why a 50-person lab is training language models that generate many tokens at once — and why that maps to GPUs the way transformers once mapped to training.모델과 학습InferenceAI cost & performance+3
45:10EN
No Priors: AI, Machine Learning, Tech, & Startups· 2026년 9월 10일팟캐스트 · 2명76% of Agentic Commerce Is Under 30 Cents — So Coinbase Is Banking the AIs진행자 Sarah Guo, Elad GilBrian Armstrong tells Elad Gil how Coinbase became an everything exchange, why card networks cannot price agent-to-agent payments, and what his longevity company is taking into the clinic.에이전트Agentic commerce금융 AI+3