Search Results for author: Givi Meishvilli

Found 1 papers, 0 papers with code

KOALA: A Kalman Optimization Algorithm with Loss Adaptivity

no code implementations7 Jul 2021 Aram Davtyan, Sepehr Sameni, Llukman Cerkezi, Givi Meishvilli, Adam Bielski, Paolo Favaro

Moreover, we show that the Kalman Filter dynamical model for the evolution of the unknown parameters can be used to capture the gradient dynamics of advanced methods such as Momentum and Adam.

Language Modelling Stochastic Optimization

Cannot find the paper you are looking for? You can Submit a new open access paper.