1 code implementation • 14 Dec 2023 • Imad Eddine Marouf, Subhankar Roy, Enzo Tartaglione, Stéphane Lathuilière
In this work, we study the problem of continual learning (CL) where the goal is to learn a model on a sequence of tasks, such that the data from the previous tasks becomes unavailable while learning on the current task data.
1 code implementation • 7 Nov 2023 • Imad Eddine Marouf, Enzo Tartaglione, Stéphane Lathuilière
Vision Transformers (ViTs) have become one of the dominant architectures in computer vision, and pre-trained ViT models are commonly adapted to new tasks via fine-tuning.
2 code implementations • 17 Oct 2023 • Imad Eddine Marouf, Subhankar Roy, Enzo Tartaglione, Stéphane Lathuilière
However, repeated fine-tuning on each task destroys the rich representations of the PTMs and further leads to forgetting previous tasks.