Large Language Models
Data Sourcing & Curation
Where the tokens come from, and why filtering is the real work.
You can jump straight in, but this star assumes Pretraining. Not recommended as a first stop.
Four layers of depth
Each layer ends with a quiz. Finish layer 4 and you own this concept.
- L1IntuitionWhat it is and why it matterssoon
- L2MechanicsThe logical machinerysoon
- L3CodeImplement it yourselfsoon
- L4FoundationsThe math and the hardwaresoon
33 stars in the atlas.