Results
3 articlesSort
1:50:48ENWhy Inference Matters 12× More Than TrainingFrançois Chaubard, Dan Fu, Jeff Morgan, Joe Fioti, Liangsheng Yin · Y CombinatorYC Paper Club walks the inference stack from an API request down to GPU kernels. Four talks from Together AI, Ollama, Luminal, and SGLang argue that serving quality, not just training FLOPs, is where most of the compute and the money now sit.
31:30ENWhy Some AI Models Use Fewer Tokens to Solve a TaskTheoTheo explains input, output, caching and reasoning tokens, then explores a hypothesis about terse internal reasoning.
1:22:52ENRichmond Alake on Agent Memory, Context Engineering and the Cost of RecallMatthew Berman, Richmond Alake · Forward FutureIn a livestream with Matthew Berman, Oracle’s Richmond Alake explains how agents store, retrieve and consolidate information, and where memory design trades off with caching and latency.









