Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptively

1 code implementation • 3 Nov 2022 • Haojie Zhang, Ge Li, Jia Li, Zhongjin Zhang, Yuqi Zhu, Zhi Jin

Large-scale pre-trained language models have achieved impressive results on a wide range of downstream tasks recently.

Language Modelling