Why KL Divergence Is Not A Distance: Direction Changes The Question
· â 7 min read · âī¸ k4i
An intuition-first explanation of KL divergence: why KL(P || Q) differs from KL(Q || P), what each direction penalizes, and how this connects to SFT, cross entropy, and RLHF KL penalties.