1 code implementation • 22 Feb 2024 • Zhuoyan Xu, Zhenmei Shi, Junyi Wei, Fangzhou Mu, Yin Li, YIngyu Liang
An emerging solution with recent success in vision and NLP involves finetuning a foundation model on a selection of relevant tasks, before its adaptation to a target task with limited labeled samples.
no code implementations • ICLR 2022 • Zhenmei Shi, Junyi Wei, YIngyu Liang
These results provide theoretical evidence showing that feature learning in neural networks depends strongly on the input structure and leads to the superior performance.