no code implementations • 27 May 2023 • Daiwei Chen, Weikai Chang, Pratik Chaudhari
We exploit a formal correspondence between thermodynamics and inference, where the number of samples can be thought of as the inverse temperature, to define a "learning capacity'' which is a measure of the effective dimensionality of a model.