Variational Stochastic Gradient Descent for Deep Neural Networks

1 code implementation • 9 Apr 2024 • Haotian Chen, Anna Kuzina, Babak Esmaeili, Jakub M Tomczak

We model gradient updates as a probabilistic model and utilize stochastic variational inference (SVI) to derive an efficient and effective update rule.

Image Classification Variational Inference