no code implementations • 9 Feb 2024 • Haizhong Zheng, Xiaoyan Bai, Beidi Chen, Fan Lai, Atul Prakash
The emergence of activation sparsity in LLMs provides a natural approach to reduce this cost by involving only parts of the parameters for inference.
1 code implementation • 3 Jan 2024 • Andrew Lee, Xiaoyan Bai, Itamar Pres, Martin Wattenberg, Jonathan K. Kummerfeld, Rada Mihalcea
While alignment algorithms are now commonly used to tune pre-trained language models towards a user's preferences, we lack explanations for the underlying mechanisms in which models become ``aligned'', thus making it difficult to explain phenomena like jailbreaks.
1 code implementation • 8 May 2023 • Aobo Kong, Shiwan Zhao, Hao Chen, Qicheng Li, Yong Qin, Ruiqi Sun, Xiaoyan Bai
This demonstrates the great potential of using prompt for unsupervised keyphrase extraction.
Ranked #1 on Keyphrase Extraction on NUS