Supervised fine-tuning is next-token prediction on curated data
SFT uses the exact same loss and optimizer as pretraining — cross-entropy on next-token prediction. What differs entirely is the data: instead of raw web text, examples are structured conversations, and what determines success or failure is almost entirely dataset construction, plus two mechanical details: the chat template and loss masking.