no code implementations • 11 Jan 2024 • Bo Chen, Xingyi Cheng, Pan Li, Yangli-ao Geng, Jing Gong, Shen Li, Zhilei Bei, Xu Tan, Boyan Wang, Xin Zeng, Chiming Liu, Aohan Zeng, Yuxiao Dong, Jie Tang, Le Song
We propose a unified protein language model, xTrimoPGLM, to address these two types of tasks simultaneously through an innovative pre-training framework.
no code implementations • 2 Dec 2023 • Shuxian Zou, Hui Li, Shentong Mo, Xingyi Cheng, Eric Xing, Le Song
Predicting the structure of interacting chains is crucial for understanding biological systems and developing new drugs.
no code implementations • NeurIPS 2023 • Jing Gong, Minsheng Hao, Xingyi Cheng, Xin Zeng, Chiming Liu, Jianzhu Ma, Xuegong Zhang, Taifeng Wang, Le Song
Advances in high-throughput sequencing technology have led to significant progress in measuring gene expressions at the single-cell level.
1 code implementation • 5 Jul 2023 • Shengding Hu, Yifan Luo, Huadong Wang, Xingyi Cheng, Zhiyuan Liu, Maosong Sun
In this paper, we find that the PLMs already possess the knowledge required to rebut such questions, and the key is how to activate the knowledge.
1 code implementation • 7 Jun 2023 • Lifan Yuan, Yangyi Chen, Ganqu Cui, Hongcheng Gao, Fangyuan Zou, Xingyi Cheng, Heng Ji, Zhiyuan Liu, Maosong Sun
Then we introduce BOSS, a Benchmark suite for Out-of-distribution robustneSS evaluation covering 5 tasks and 20 datasets.
no code implementations • 22 Sep 2021 • Fu Sun, Feng-Lin Li, Ruize Wang, Qianglong Chen, Xingyi Cheng, Ji Zhang
Knowledge enhanced pre-trained language models (K-PLMs) are shown to be effective for many public tasks in the literature but few of them have been successfully applied in practice.
1 code implementation • 15 Jun 2021 • Ganqu Cui, Yufeng Du, Cheng Yang, Jie zhou, Liang Xu, Xing Zhou, Xingyi Cheng, Zhiyuan Liu
The recent emergence of contrastive learning approaches facilitates the application on graph representation learning (GRL), introducing graph contrastive learning (GCL) into the literature.
no code implementations • 18 Apr 2021 • Xingyi Cheng
In this paper, we propose a Dual-view distilled BERT~(DvBERT) for sentence matching with sentence embeddings.
no code implementations • COLING 2020 • Weipeng Huang, Xingyi Cheng, Kunlong Chen, Taifeng Wang, Wei Chu
The ambiguous annotation criteria lead to divergence of Chinese Word Segmentation (CWS) datasets in various granularities.
no code implementations • EMNLP 2020 • Kunlong Chen, Weidi Xu, Xingyi Cheng, Zou Xiaochuan, Yuyu Zhang, Le Song, Taifeng Wang, Yuan Qi, Wei Chu
Numerical reasoning over texts, such as addition, subtraction, sorting and counting, is a challenging machine reading comprehension task, since it requires both natural language understanding and arithmetic computation.
Ranked #1 on Question Answering on DROP Test
1 code implementation • 19 Jun 2020 • Daria B. Kokha, Bernd Doser, Stefan Richter, Fabian Ormersbach, Xingyi Cheng, Rebecca C. Wade
The combined implementation of RAMD and MD-IFP provides a computationally efficient and freely available workflow that can be applied to hundreds of compounds in a reasonable computational time and will facilitate the use of tauRAMD in drug design.
1 code implementation • ACL 2020 • Xingyi Cheng, Weidi Xu, Kunlong Chen, Shaohua Jiang, Feng Wang, Taifeng Wang, Wei Chu, Yuan Qi
This paper proposes to incorporate phonological and visual similarity knowledge into language models for CSC via a specialized graph convolutional network (SpellGCN).
1 code implementation • 8 Sep 2019 • Weidi Xu, Xingyi Cheng, Kunlong Chen, Wei Wang, Bin Bi, Ming Yan, Chen Wu, Luo Si, Wei Chu, Taifeng Wang
To remedy this, we propose to augment the NSP task to a 3-class categorization task, which includes a category for previous sentence prediction (PSP).
1 code implementation • 16 Aug 2019 • Weipeng Huang, Xingyi Cheng, Taifeng Wang, Wei Chu
Combining these three contributions, we enhance the information extracting ability of the multi-head selection model and achieve F1-score 0. 876 on testset-1 with a single model.
no code implementations • 22 Mar 2019 • Jie Zhou, Xingyi Cheng, Jinchao Zhang
Conventional \mbox{methods} generally treat this task using separated steps, including text representation learning and clustering the representations.
no code implementations • 11 Mar 2019 • Weipeng Huang, Xingyi Cheng, Kunlong Chen, Taifeng Wang, Wei Chu
The ambiguous annotation criteria lead to divergence of Chinese Word Segmentation (CWS) datasets in various granularities.
no code implementations • CONLL 2019 • Xingyi Cheng, Weidi Xu, Taifeng Wang, Wei Chu
By disentangling the latent representation into the aspect-specific sentiment and the lexical context, our method induces the underlying sentiment prediction for the unlabeled data, which then benefits the ATSA classifier.
Aspect-Based Sentiment Analysis (ABSA) Natural Language Understanding +1
1 code implementation • 27 Sep 2017 • Xingyi Cheng, Ruiqing Zhang, Jie zhou, Wei Xu
Several pioneering approaches have been proposed based on traffic observations of the target location as well as its adjacent regions, but they obtain somewhat limited accuracy due to a lack of mining road topology.