Search Results for author: Guangjian Tian

Found 11 papers, 3 papers with code

Fast Gumbel-Max Sketch and its Applications

no code implementations10 Feb 2023 Yuanming Zhang, Pinghui Wang, Yiyan Qi, Kuankuan Cheng, Junzhou Zhao, Guangjian Tian, Xiaohong Guan

The well-known Gumbel-Max Trick for sampling elements from a categorical distribution (or more generally a non-negative vector) and its variants have been widely used in areas such as machine learning and information retrieval.

Information Retrieval Retrieval

Cross-Layer Retrospective Retrieving via Layer Attention

1 code implementation8 Feb 2023 Yanwen Fang, Yuxi Cai, Jintai Chen, Jingyu Zhao, Guangjian Tian, Guodong Li

Motivated by this, we devise a cross-layer attention mechanism, called multi-head recurrent layer attention (MRLA), that sends a query representation of the current layer to all previous layers to retrieve query-related information from different levels of receptive fields.

Image Classification Instance Segmentation +3

On the Expressiveness, Predictability and Interpretability of Neural Temporal Point Processes

no code implementations29 Sep 2021 Liangliang Shi, Fangyu Ding, Junchi Yan, Yanjie Duan, Guangjian Tian

Despite the fast advance in neural temporal point processes (NTPP) which enjoys high model capacity, there are still some standing gaps to fill including model expressiveness, predictability, and interpretability, especially with the wide application of event sequence modeling.

Point Processes

Modeling Variable Space with Residual Tensor Networks for Multivariate Time Series

no code implementations29 Sep 2021 Jing Zhang, Peng Zhang, Yupeng He, Siwei Rao, Jun Wang, Guangjian Tian

In this framework, we derive the mathematical representation of the variable space, and then use a tensor network based on the idea of low-rank approximation to model the variable space.

Multivariate Time Series Forecasting Tensor Networks +2

TextTN: Probabilistic Encoding of Language on Tensor Network

no code implementations1 Jan 2021 Peng Zhang, Jing Zhang, Xindian Ma, Siwei Rao, Guangjian Tian, Jun Wang

As a novel model that bridges machine learning and quantum theory, tensor network (TN) has recently gained increasing attention and successful applications for processing natural images.

General Classification Sentence +4

Do RNN and LSTM have Long Memory?

1 code implementation ICML 2020 Jingyu Zhao, Feiqing Huang, Jia Lv, Yanjie Duan, Zhen Qin, Guodong Li, Guangjian Tian

The LSTM network was proposed to overcome the difficulty in learning long-term dependence, and has made significant advancements in applications.

Fast Generating A Large Number of Gumbel-Max Variables

no code implementations2 Feb 2020 Yiyan Qi, Pinghui Wang, Yuanming Zhang, Junzhou Zhao, Guangjian Tian, Xiaohong Guan

Instead of computing $k$ independent Gumbel random variables directly, we find that there exists a technique to generate these variables in descending order.

Graph Embedding Information Retrieval +1

Compact Autoregressive Network

no code implementations6 Sep 2019 Di Wang, Feiqing Huang, Jingyu Zhao, Guodong Li, Guangjian Tian

Autoregressive networks can achieve promising performance in many sequence modeling tasks with short-range dependence.

TAR

Cannot find the paper you are looking for? You can Submit a new open access paper.