YoutuBlog
/
Channels
Podcasts
People
Topics
English
Recently updated channels
Pick one to see only that channel
Browse all channels →
Matthew Berman
today +310
AI Engineer
today +6
Theo - t3․gg
today
The Builders
today +1
a16z
today +2
硅谷101
today +1
SemiAnalysis
today +1
Chris Williamson
today
Cheeky Pint
today
Invest Like The Best
today
Results
1 articles
Sort
Newest
Newest
Oldest
Shortest first
Topic
ML fundamentals
Person
Grant Sanderson
7 slides
1:16:29
EN
Jane Street
· Aug 26, 2026
Grant Sanderson and Alok Puranik: Positional Encodings Through Group Theory
Grant Sanderson, Alok Puranik · 3Blue1Brown
Starting with assumptions about attention, they derive matrix exponentials and connect rotations, decay and Jordan blocks to RoPE and ALiBi.
Transformers & attention
Mathematics
ML fundamentals
+1