Search Results for author: Sebastian Lee

Found 4 papers, 2 papers with code

Maslow's Hammer for Catastrophic Forgetting: Node Re-Use vs Node Activation

1 code implementation18 May 2022 Sebastian Lee, Stefano Sarao Mannelli, Claudia Clopath, Sebastian Goldt, Andrew Saxe

Continual learning - learning new tasks in sequence while maintaining performance on old tasks - remains particularly challenging for artificial neural networks.

Continual Learning

Continual Learning in the Teacher-Student Setup: Impact of Task Similarity

1 code implementation9 Jul 2021 Sebastian Lee, Sebastian Goldt, Andrew Saxe

Using each teacher to represent a different task, we investigate how the relationship between teachers affects the amount of forgetting and transfer exhibited by the student when the task switches.

Continual Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.