Claude Managed Agents Q&A: Evals, CI/CD and Multi-Tenancy (Part 4 of 4) — Anthropic

PPPriyanka PhatakSpeaker · AnthropicGCGabe CemajSpeaker · Anthropic
Channel
AI Engineer
Published
Oct 12, 2026
Video
18:57
Original
English
Open on YouTube
The article isn't ready yetWe have this video's details, but its article hasn't been written. You can watch it on YouTube in the meantime.Open on YouTube

More from this channel

7 slides19:43EN
AI Engineer· Oct 26, 2026Jack Wotherspoon on Building a Team of Managed AgentsJack Wotherspoon · Google DeepMindGoogle DeepMind’s Jack Wotherspoon introduces Gemini Managed Agents: cloud sandboxes that let teams run coding and research agents with a single API call. He explains how persistent environments, reusable skills, proxy-injected credentials, schedules, and specialized agents fit together.Agent engineeringAgent orchestrationSandboxes & isolation+2
5 slides20:55EN
AI Engineer· Oct 26, 2026Jesse Hall:语音智能体要为对话而优化,而非只看排行榜Jesse Hall · LiveKitLiveKit 的 Jesse Hall 解释了为什么语音智能体必须像实时系统一样接受评测:听清用户、允许打断、在工具调用期间继续对话,并在用户真正听到声音之前控制延迟。Voice AIAgent engineeringEvals+2
12 slides17:56EN
AI Engineer· Oct 25, 2026How Bridgewater Keeps Its AI Analyst Inside Permission BoundariesNikhil Benesch, Aaron Linsky · turbopufferAaron Linsky and Nikhil Benesch explain why search over an enterprise vault must honor document permissions without sacrificing recall or speed. Their solution combines vector indexing with native filtering to search hundreds of millions of vectors in roughly 120 milliseconds.Enterprise AIPrivacy & data governanceSearch & retrieval+2
7 slides35:19EN
AI Engineer· Oct 25, 2026SallyAnn DeLucia: How to Write Your First AI EvalSallyAnn DeLucia · Arize AITurn an agent’s real traces into concrete pass/fail criteria, then build an LLM judge you can test, align with people, and run in production.Evals & observabilityEvalsAgent engineering+2
9 slides20:58EN
AI Engineer· Oct 25, 2026Vinoo Ganesh on Making Financial AI Cite Every NumberVinoo Ganesh · KeplerKepler CEO Vinoo Ganesh explains why financial AI should retrieve and cite figures while deterministic software handles the math. His design makes traceability, retrieval quality, and tenant security part of the answer itself.AI in financeEnterprise AIRetrieval-augmented generation+2
10 slides18:31EN
AI Engineer· Oct 25, 2026Janie Gu and Suyeol Yun: Why Frontier Models Fail as Buy-Side AnalystsJanie Gu, Suyeol Yun · Google DeepMindJanie Gu explains why benchmark scores can mislead, while Suyeol Yun presents MandateBench, which tests whether a model can turn a fund mandate into a defensible investment memo. The two talks show why real workflows, reproducible grading, and evidence-backed reasoning matter.AI in financeBenchmarksEvals+2