Large Language Models
Pretraining
Next-token prediction over a large slice of the internet.
You can jump straight in, but this star assumes The Transformer. Not recommended as a first stop.
Four layers of depth
Each layer ends with a quiz. Finish layer 4 and you own this concept.
- L1IntuitionWhat it is and why it matterssoon
- L2MechanicsThe logical machinerysoon
- L3CodeImplement it yourselfsoon
- L4FoundationsThe math and the hardwaresoon
Where this leads
33 stars in the atlas.