Search Results for author: Wenzhou Chen

Found 6 papers, 1 papers with code

Thoughts on the Consistency between Ricci Flow and Neural Network Behavior

no code implementations16 Nov 2021 Jun Chen, Tianxin Huang, Wenzhou Chen, Yong liu

During the training process of the neural network, we observe that its metric will also regularly converge to the linearly nearly Euclidean metric, which is consistent with the convergent behavior of linearly nearly Euclidean metrics under the Ricci-DeTurck flow.

Manifold Micro-Surgery with Linearly Nearly Euclidean Metrics

no code implementations29 Sep 2021 Jun Chen, Tianxin Huang, Wenzhou Chen, Yong liu

The Ricci flow is a method of manifold surgery, which can trim manifolds to more regular.

Analogous to Evolutionary Algorithm: Designing a Unified Sequence Model

1 code implementation NeurIPS 2021 Jiangning Zhang, Chao Xu, Jian Li, Wenzhou Chen, Yabiao Wang, Ying Tai, Shuo Chen, Chengjie Wang, Feiyue Huang, Yong liu

Inspired by biological evolution, we explain the rationality of Vision Transformer by analogy with the proven practical Evolutionary Algorithm (EA) and derive that both of them have consistent mathematical representation.

Image Retrieval Retrieval

Optimizing Quantized Neural Networks with Natural Gradient

no code implementations1 Jan 2021 Jun Chen, Hanwen Chen, Jiangning Zhang, Wenzhou Chen, Yong liu, Yunliang Jiang

Quantized Neural Networks (QNNs) have achieved an enormous step in improving computational efficiency, making it possible to deploy large models to mobile and miniaturized devices.

Computational Efficiency

HILONet: Hierarchical Imitation Learning from Non-Aligned Observations

no code implementations5 Nov 2020 Shanqi Liu, Junjie Cao, Wenzhou Chen, Licheng Wen, Yong liu

In this work, we propose a new imitation learning approach called Hierarchical Imitation Learning from Observation(HILONet), which adopts a hierarchical structure to choose feasible sub-goals from demonstrated observations dynamically.

Imitation Learning Position

Cannot find the paper you are looking for? You can Submit a new open access paper.