Generative Retrieval with Semantic Tree-Structured Item Identifiers via Contrastive Learning

no code implementations • 23 Sep 2023 • Zihua Si, Zhongxiang Sun, Jiale Chen, Guozhang Chen, Xiaoxue Zang, Kai Zheng, Yang song, Xiao Zhang, Jun Xu

To obtain efficiency and effectiveness, this paper introduces a generative retrieval framework, namely SEATER, which learns SEmAntic Tree-structured item identifiERs via contrastive learning.

Contrastive Learning Recommendation Systems +1

ViR:the Vision Reservoir

no code implementations • 27 Dec 2021 • Xian Wei, Bin Wang, Mingsong Chen, Ji Yuan, Hai Lan, Jiehuang Shi, Xuan Tang, Bo Jin, Guozhang Chen, Dongping Yang

To address these problems, a novel method, namely, Vision Reservoir computing (ViR), is proposed here for image classification, as a parallel to ViT.

Classification Image Classification

Anomalous diffusion dynamics of learning in deep neural networks

1 code implementation • 22 Sep 2020 • Guozhang Chen, Cheng Kevin Qu, Pulin Gong

The anomalous superdiffusion process during the initial learning phase indicates that the motion of SGD along the loss landscape possesses intermittent, big jumps; this non-equilibrium property enables the SGD to escape from sharp local minima.