Let's reproduce GPT-2 (124M)

Andrej Karpathy · 1.2M views · 2024 · 4:01:26

Open on YouTube

LLMs & generative AIother

Why the open web links it

A detailed, hands-on tutorial on reproducing the GPT-2 (124M) model from scratch, including training setup and optimization.

Linked by 32 independent sites, 2 of them widely read in the 2026-10 crawl of the open web, including hopto.org, lesswrong.com, alignmentforum.org, godofprompt.ai, cocoawithlove.com.