no code implementations • 15 Feb 2021 • Mohammad Mahdi Mahvari, Mari Kobayashi, Abdellatif Zaidi
In the context of statistical learning, the Information Bottleneck method seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description length, and distortion evaluated under logarithmic loss measure.
no code implementations • 2 Nov 2020 • Mohammad Mahdi Mahvari, Mari Kobayashi, Abdellatif Zaidi
The Information Bottleneck method is a learning technique that seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description length, and distortion evaluated under logarithmic loss measure.