Search Results for author: Kamil Rocki

Found 7 papers, 1 papers with code

Learning to Remember, Forget and Ignore using Attention Control in Memory

no code implementations28 Sep 2018 T. S. Jayram, Younes Bouhadjar, Ryan L. McAvoy, Tomasz Kornuta, Alexis Asseman, Kamil Rocki, Ahmet S. Ozcan

Typical neural networks with external memory do not effectively separate capacity for episodic and working memory as is required for reasoning in humans.

Surprisal-Driven Zoneout

no code implementations24 Oct 2016 Kamil Rocki, Tomasz Kornuta, Tegan Maharaj

We propose a novel method of regularization for recurrent neural networks called suprisal-driven zoneout.

Recurrent Memory Array Structures

2 code implementations11 Jul 2016 Kamil Rocki

The following report introduces ideas augmenting standard Long Short Term Memory (LSTM) architecture with multiple memory cells per hidden unit in order to improve its generalization capabilities.

Language Modelling

Towards Machine Intelligence

no code implementations27 Mar 2016 Kamil Rocki

There exists a theory of a single general-purpose learning algorithm which could explain the principles of its operation.

Thinking Required

no code implementations7 Dec 2015 Kamil Rocki

There exists a theory of a single general-purpose learning algorithm which could explain the principles its operation.

Cannot find the paper you are looking for? You can Submit a new open access paper.