Integrating BERT and Score-based Feature Gates for Chinese Grammatical Error Diagnosis

no code implementations • AACL (NLP-TEA) 2020 • Yongchang Cao, Liang He, Robert Ridley, Xinyu Dai

This paper describes our proposed model for the Chinese Grammatical Error Diagnosis (CGED) task in NLPTEA2020.

Make BERT-based Chinese Spelling Check Model Enhanced by Layerwise Attention and Gaussian Mixture Model

no code implementations • 27 Dec 2023 • Yongchang Cao, Liang He, Zhen Wu, Xinyu Dai

Meanwhile, to incorporate implicit hierarchical linguistic knowledge within the encoder, we propose a novel form of n-gram-based layerwise self-attention to generate a multilayer representation.

Part-Of-Speech Tagging POS +1