Resultados
5 artículosOrdenar
20:55ENJesse Hall: Build Voice Agents for Conversations, Not LeaderboardsJesse Hall · LiveKitLiveKit’s Jesse Hall explains how to evaluate voice agents as real-time systems: understand callers, handle interruptions, keep talking while tools run, and measure the delay people actually hear.
35:19ENSallyAnn DeLucia: How to Write Your First AI EvalSallyAnn DeLucia · Arize AITurn an agent’s real traces into concrete pass/fail criteria, then build an LLM judge you can test, align with people, and run in production.
18:31ENJanie Gu and Suyeol Yun: Why Frontier Models Fail as Buy-Side AnalystsJanie Gu, Suyeol Yun · Google DeepMindJanie Gu explains why benchmark scores can mislead, while Suyeol Yun presents MandateBench, which tests whether a model can turn a fund mandate into a defensible investment memo. The two talks show why real workflows, reproducible grading, and evidence-backed reasoning matter.
15:27ENWhat AI Engineers Do Now: Build the Loop Around AgentsAparna Dhinakaran · Arize AIAparna Dhinakaran argues that AI engineers are moving from shipping individual features to building systems that let agent teams improve them. At Arize, that means tracing agent behavior, evaluating its work against human judgment, and feeding those signals back into an always-on agent.
17:42ENIs a Faster Model Actually Faster? Measure the Finished Job, Not the TokensMorgan Suo · MiniMaxMiniMax's Morgan Suo takes the engineering changes inside M3.1 Flash one by one and asks the question that matters to users: does the job an analyst needs actually get done sooner, cheaper and correctly?









