Open Internet by MindsNet

Softmax Saturation in Attention Mechanisms

The softmax function in attention mechanisms can collapse to near-one-hot distributions, leading to extremely small gradients for non-max positions, causing the model to behave like 'pick one token aggressively' instead of learning nuanced attention distributions.

Mathematics & logic, Mathematics, Linear Algebra