Continual Learning
827 papers with code • 29 benchmarks • 30 datasets
Continual Learning (also known as Incremental Learning, Life-long Learning) is a concept to learn a model for a large number of tasks sequentially without forgetting knowledge obtained from the preceding tasks, where the data in the old tasks are not available anymore during training new ones.
If not mentioned, the benchmarks here are Task-CL, where task-id is provided on validation.
Source:
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation
Three scenarios for continual learning
Lifelong Machine Learning
Continual lifelong learning with neural networks: A review
Benchmarks
These leaderboards are used to track progress in Continual Learning
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
Libraries
Use these libraries to find Continual Learning models and implementationsDatasets
CIFAR-10
CIFAR-100
MNIST
Oxford 102 Flower
Stanford Cars
Sketch
Permuted MNIST
CORe50
WikiArt
ROAD
Subtasks
Latest papers
ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning
Panoptic segmentation, combining semantic and instance segmentation, stands as a cutting-edge computer vision task.
CLAP4CLIP: Continual Learning with Probabilistic Finetuning for Vision-Language Models
The deterministic nature of the existing finetuning methods makes them overlook the many possible interactions across the modalities and deems them unsafe for high-risk CL tasks requiring reliable uncertainty estimation.
DS-AL: A Dual-Stream Analytic Learning for Exemplar-Free Class-Incremental Learning
ZHUANGHP/Analytic-continual-learning
•
•
The compensation stream is governed by a Dual-Activation Compensation (DAC) module.
G-ACIL: Analytic Learning for Exemplar-Free Generalized Class Incremental Learning
ZHUANGHP/Analytic-continual-learning
•
•
The generalized CIL (GCIL) aims to address the CIL problem in a more real-world scenario, where incoming data have mixed data categories and unknown sample size distribution, leading to intensified forgetting.
A Unified and General Framework for Continual Learning
joey-wang123/cl-refresh-learning
•
•
Extensive experiments on CL benchmarks and theoretical analysis demonstrate the effectiveness of the proposed refresh learning.
Predictive, scalable and interpretable knowledge tracing on structured domains
mlcolab/psi-kt
•
•
This requires estimates of both the learner's progress (''knowledge tracing''; KT), and the prerequisite structure of the learning domain (''knowledge mapping'').
Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters
Continual learning can empower vision-language models to continuously acquire new knowledge, without the need for access to the entire historical dataset.
Reconstruct before Query: Continual Missing Modality Learning with Decomposed Prompt Collaboration
tree-shu-zhao/rebq.pytorch
•
•
Meanwhile, our RebQ leverages extensive multi-modal knowledge from pre-trained LMMs to reconstruct the data of missing modality.
Function-space Parameterization of Neural Networks for Sequential Learning
Our parameterization offers: (i) a way to scale function-space methods to large data sets via sparsification, (ii) retention of prior knowledge when access to past data is limited, and (iii) a mechanism to incorporate new data without retraining.
CoLeCLIP: Open-Domain Continual Learning via Joint Task Prompt and Vocabulary Learning
Large pre-trained VLMs like CLIP have demonstrated superior zero-shot recognition ability, and a number of recent studies leverage this ability to mitigate catastrophic forgetting in CL, but they focus on closed-set CL in a single domain dataset.
