Large Language Models
Scaling Laws
Predicting capability from parameters, data, and compute.
You can jump straight in, but this star assumes Pretraining. Not recommended as a first stop.
Four layers of depth
Each layer ends with a quiz. Finish layer 4 and you own this concept.
- L1IntuitionWhat it is and why it matterssoon
- L2MechanicsThe logical machinerysoon
- L3CodeImplement it yourselfsoon
- L4FoundationsThe math and the hardwaresoon
33 stars in the atlas.