Slanted Triangular Learning Rates (STLR) is a learning rate schedule which first linearly increases the learning rate and then linearly decays it, which can be seen in Figure to the right. It is a modification of Triangular Learning Rates, with a short increase and a long decay period.
Source: Universal Language Model Fine-tuning for Text ClassificationPaper | Code | Results | Date | Stars |
---|
Task | Papers | Share |
---|---|---|
Language Modelling | 13 | 15.66% |
General Classification | 13 | 15.66% |
Text Classification | 11 | 13.25% |
Sentiment Analysis | 9 | 10.84% |
Classification | 7 | 8.43% |
Hate Speech Detection | 3 | 3.61% |
Marketing | 2 | 2.41% |
Transliteration | 2 | 2.41% |
Language Identification | 2 | 2.41% |
Component | Type |
|
---|---|---|
🤖 No Components Found | You can add them if they exist; e.g. Mask R-CNN uses RoIAlign |