1 code implementation • 6 Apr 2024 • Changjiang Gao, Hongda Hu, Peng Hu, Jiajun Chen, Jixing Li, ShuJian Huang
In this paper, we propose CLiKA, a systematic framework to assess the cross-lingual knowledge alignment of LLMs in the Performance, Consistency and Conductivity levels, and explored the effect of multilingual pretraining and instruction tuning on the degree of alignment.
no code implementations • 7 Mar 2024 • Changjiang Gao, Jixing Li, Jiajun Chen, ShuJian Huang
Drawing on the key-value memory interpretation of transformer feed-forward network blocks, we introduce the Composition Score, a novel model-based metric designed to quantify the degree of meaning composition during sentence comprehension.
1 code implementation • 29 Oct 2023 • Changjiang Gao, ShuJian Huang, Jixing Li, Jiajun Chen
Recent large language models (LLMs) have revealed strong abilities to understand natural language.