Karpathy’s youtube channel – this has the most amount of signal, highest amount of alpha to learn about LLMs and building out GPT-2 level transformer models
Tips
Do the exercises, always
You’re not learning math if you don’t do the exercises
You’re not learning ML if you don’t build models! Train them from scratch! Implement a multi-layer percepetron from scratch!
Tinker after chapters/videos, tweak the examples or exercises, build simple models, build yet another MNIST classifier, but tinker!