1 code implementation • 12 Mar 2024 • Jiawei Tang, Shuang Wu, Bo Lan, Yahui Dong, Yuqiang Jin, Guangjian Tian, Wen-An Zhang, Ling Shi
The configuration of most robotic systems lies in continuous transformation groups.
no code implementations • 10 Feb 2023 • Yuanming Zhang, Pinghui Wang, Yiyan Qi, Kuankuan Cheng, Junzhou Zhao, Guangjian Tian, Xiaohong Guan
The well-known Gumbel-Max Trick for sampling elements from a categorical distribution (or more generally a non-negative vector) and its variants have been widely used in areas such as machine learning and information retrieval.
1 code implementation • 8 Feb 2023 • Yanwen Fang, Yuxi Cai, Jintai Chen, Jingyu Zhao, Guangjian Tian, Guodong Li
Motivated by this, we devise a cross-layer attention mechanism, called multi-head recurrent layer attention (MRLA), that sends a query representation of the current layer to all previous layers to retrieve query-related information from different levels of receptive fields.
no code implementations • 29 Sep 2021 • Liangliang Shi, Fangyu Ding, Junchi Yan, Yanjie Duan, Guangjian Tian
Despite the fast advance in neural temporal point processes (NTPP) which enjoys high model capacity, there are still some standing gaps to fill including model expressiveness, predictability, and interpretability, especially with the wide application of event sequence modeling.
no code implementations • 29 Sep 2021 • Jing Zhang, Peng Zhang, Yupeng He, Siwei Rao, Jun Wang, Guangjian Tian
In this framework, we derive the mathematical representation of the variable space, and then use a tensor network based on the idea of low-rank approximation to model the variable space.
no code implementations • 31 Jan 2021 • Longyuan Li, Jihai Zhang, Junchi Yan, Yaohui Jin, Yunhao Zhang, Yanjie Duan, Guangjian Tian
Time-series is ubiquitous across applications, such as transportation, finance and healthcare.
no code implementations • 1 Jan 2021 • Peng Zhang, Jing Zhang, Xindian Ma, Siwei Rao, Guangjian Tian, Jun Wang
As a novel model that bridges machine learning and quantum theory, tensor network (TN) has recently gained increasing attention and successful applications for processing natural images.
no code implementations • Findings of the Association for Computational Linguistics 2020 • Zhen Wang, Siwei Rao, Jie Zhang, Zhen Qin, Guangjian Tian, Jun Wang
However, question generation is actually a one-to-many problem, as it is possible to raise questions with different focuses on contexts and various means of expression.
1 code implementation • ICML 2020 • Jingyu Zhao, Feiqing Huang, Jia Lv, Yanjie Duan, Zhen Qin, Guodong Li, Guangjian Tian
The LSTM network was proposed to overcome the difficulty in learning long-term dependence, and has made significant advancements in applications.
no code implementations • 2 Feb 2020 • Yiyan Qi, Pinghui Wang, Yuanming Zhang, Junzhou Zhao, Guangjian Tian, Xiaohong Guan
Instead of computing $k$ independent Gumbel random variables directly, we find that there exists a technique to generate these variables in descending order.
no code implementations • 6 Sep 2019 • Di Wang, Feiqing Huang, Jingyu Zhao, Guodong Li, Guangjian Tian
Autoregressive networks can achieve promising performance in many sequence modeling tasks with short-range dependence.