YoutuBlog
/
Channels
Podcasts
People
Topics
English
Recently updated channels
Pick one to see only that channel
Browse all channels →
Matthew Berman
yesterday +226
AI Engineer
yesterday +6
Theo - t3․gg
yesterday +8
The Builders
yesterday +1
a16z
yesterday +2
硅谷101
yesterday +1
SemiAnalysis
yesterday +1
Chris Williamson
yesterday
Cheeky Pint
yesterday
Invest Like The Best
yesterday
Results
1 articles
Sort
Newest
Newest
Oldest
Shortest first
Topic
Distillation
Person
Matthew Berman
Length
15–30 min
5 slides
19:38
EN
Matthew Berman
· Jun 9, 2023
Orca: Teaching a Smaller Model with GPT-4 Explanations
Matthew Berman · Forward Future
Matthew Berman reviews Microsoft Research’s 2023 Orca paper and its approach to training a 13-billion-parameter model on detailed teacher responses.
Distillation
Fine-tuning
Synthetic data
+2