필터 결과
2개정렬
1:50:48ENWhy Inference Matters 12× More Than TrainingFrançois Chaubard, Dan Fu, Jeff Morgan, Joe Fioti, Liangsheng Yin · Y CombinatorYC Paper Club walks the inference stack from an API request down to GPU kernels. Four talks from Together AI, Ollama, Luminal, and SGLang argue that serving quality, not just training FLOPs, is where most of the compute and the money now sit.
0:22ENDeepSeek's Memory Use: A Short Claim About KV CacheMatthew Berman · Forward FutureMatthew Berman links lower cache memory use to serving more tokens, but the excerpt does not state the comparison behind its figures.









