Layer 4 · Foundations

Neural Networks

Forward pass as function composition, backpropagation derived via the chain rule, and why depth causes vanishing/exploding gradients.

15 min read180 XP

Backpropagation is repeated application of the chain rule through the computation graph.

An $L$ -layer network is a composition of functions: