YoutuBlog
/
Channels
Podcasts
People
Topics
English
Recently updated channels
Pick one to see only that channel
Browse all channels →
Matthew Berman
yesterday +226
AI Engineer
yesterday +6
Theo - t3․gg
yesterday +9
The Builders
yesterday +1
a16z
yesterday +2
硅谷101
yesterday +1
SemiAnalysis
yesterday +1
Chris Williamson
yesterday
Cheeky Pint
yesterday
Invest Like The Best
yesterday
Results
1 articles
Sort
Newest
Newest
Oldest
Shortest first
Channel
Jane Street
Topic
Transformers & attention
7 slides
1:16:29
EN
Jane Street
· Aug 26, 2026
Grant Sanderson and Alok Puranik: Positional Encodings Through Group Theory
Grant Sanderson, Alok Puranik · 3Blue1Brown
Starting with assumptions about attention, they derive matrix exponentials and connect rotations, decay and Jordan blocks to RoPE and ALiBi.
Transformers & attention
Mathematics
ML fundamentals
+1