Résultats
4 articlesTrier
2:24:18ENMMLU Stays at Chance Until Late Training. Loss Is Only an Alarm.Anime : Nathan LabenzZyphra’s training lead walks through Zamba 2’s hybrid architecture, the evals that actually matter, and the trade secrets small labs still have to rediscover.
1:01:39ENGPT-5 Wants 100 Trillion Tokens. Does Earth Have Enough?Anime : Nathan LabenzTraining GPT-3 took about a trillion tokens; GPT-4 took about ten trillion. The next jump is a data question as much as a compute one.
1:33:56ENThe AI Scouting Report: 90 Minutes From GPT-4's Exam Scores to Whether Models UnderstandAnime : Nathan LabenzNathan Labenz spends a solo episode walking through what general-purpose models can do, how they are trained, how capabilities unlock, and whether they understand anything at all.
59:28ENFrom $500,000 to $50,000: MosaicML Made Training Your Own Model a Priced ProductAnime : Nathan LabenzJonathan Frankle and Abhi Venigalla explain who is training custom LLMs, why extraction beats chat, and how ALiBi stretches a 65k context window.









