Andrej Karpathy: Reproducing GPT-2 from Scratch

This is the video's original transcript, shown as is and unedited. The edited full text, the summary and the translations are on the article page.