YoutuBlog
/
Channels
Podcasts
People
Topics
English
Recently updated channels
Pick one to see only that channel
Browse all channels →
Matthew Berman
today +1
Theo - t3․gg
yesterday +74
AI Engineer
yesterday +2
a16z
2 days ago +1
The Builders
2 days ago +1
硅谷101
2 days ago +1
SemiAnalysis
2 days ago +1
Chris Williamson
2 days ago
Cheeky Pint
2 days ago
Invest Like The Best
2 days ago
Results
1 articles
Sort
Newest
Newest
Oldest
Shortest first
Channel
Jane Street
Topic
Transformers & attention
Speakers
2 people
7 slides
1:16:29
EN
Jane Street
· Aug 26, 2026
Grant Sanderson and Alok Puranik: Positional Encodings Through Group Theory
Grant Sanderson, Alok Puranik · 3Blue1Brown
Starting with assumptions about attention, they derive matrix exponentials and connect rotations, decay and Jordan blocks to RoPE and ALiBi.
Transformers & attention
Mathematics
ML fundamentals
+1