3 code implementations • 19 Feb 2024 • Rishabh Bhardwaj, Do Duc Anh, Soujanya Poria
We demonstrate the effectiveness of RESTA in both parameter-efficient and full fine-tuning, covering a wide range of downstream tasks, including instruction following in Chinese, English, and Hindi, as well as problem-solving capabilities in Code and Math.