Large Language Models
Mixture of Experts
Huge parameter count, small compute per token.
You can jump straight in, but this star assumes The Transformer. Not recommended as a first stop.
Four layers of depth
Each layer ends with a quiz. Finish layer 4 and you own this concept.
- L1IntuitionWhat it is and why it matterssoon
- L2MechanicsThe logical machinerysoon
- L3CodeImplement it yourselfsoon
- L4FoundationsThe math and the hardwaresoon
33 stars in the atlas.