Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters

no code implementations • 20 Sep 2023 • Yukang Xie, Chengyu Wang, Junbing Yan, Jiyong Zhou, Feiqi Deng, Jun Huang

Recently, Large Language Models (LLMs) have achieved amazing zero-shot learning performance over a variety of Natural Language Processing (NLP) tasks, especially for text generative tasks.

Zero-Shot Learning