no code implementations • 30 May 2019 • Jan Melchior, Mehdi Bayati, Amir Azizi, Sen Cheng, Laurenz Wiskott
To our knowledge this is the first model of the hippocampus that allows to store correlated pattern sequences online in a one-shot fashion without a consolidation process, which can instantaneously be recalled later.
no code implementations • 25 May 2019 • Jan Melchior, Laurenz Wiskott
Hebbian-descent addresses these problems by getting rid of the activation function's derivative and by centering, i. e. keeping the neural activities mean free, leading to a biologically plausible update rule that is provably convergent, does not suffer from the vanishing error term problem, can deal with correlated data, profits from seeing patterns several times, and enables successful online learning when centering is used.
1 code implementation • 23 Jan 2014 • Nan Wang, Jan Melchior, Laurenz Wiskott
We present a theoretical analysis of Gaussian-binary restricted Boltzmann machines (GRBMs) from the perspective of density models.
1 code implementation • 6 Nov 2013 • Jan Melchior, Asja Fischer, Laurenz Wiskott
This work analyzes centered binary Restricted Boltzmann Machines (RBMs) and binary Deep Boltzmann Machines (DBMs), where centering is done by subtracting offset values from visible and hidden variables.