Learning to Remember Rare Events

9 Mar 2017 Łukasz Kaiser Ofir Nachum Aurko Roy Samy Bengio

Despite recent advances, memory-augmented deep neural networks are still limited when it comes to life-long and one-shot learning, especially in remembering rare events. We present a large-scale life-long memory module for use in deep learning... (read more)

PDF Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Few-Shot Image Classification OMNIGLOT - 1-Shot, 20-way ConvNet with Memory Module Accuracy 95% # 13
Few-Shot Image Classification OMNIGLOT - 1-Shot, 5-way ConvNet with Memory Module Accuracy 98.4 # 12
Few-Shot Image Classification OMNIGLOT - 5-Shot, 20-way ConvNet with Memory Module Accuracy 98.6% # 10
Few-Shot Image Classification OMNIGLOT - 5-Shot, 5-way ConvNet with Memory Module Accuracy 99.6 # 8

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet