grokking

Generalization at the Edge of Stability: 1 Paper on Why

A new paper links chaotic, high-learning-rate training to generalization via a “sharpness dimension” built from the Hessian spectrum.