CAT 
This blog post will go line-by-line through the code in Section 3 of Andrej Karpathy’s “Let’s reproduce GPT-2 (124M)”
Originally appeared here:
Line-By-Line, Let’s Reproduce GPT-2: Section 3 — Training
Go Here to Read this Fast! Line-By-Line, Let’s Reproduce GPT-2: Section 3 — Training
