EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba

1 code implementation • 15 Mar 2024 • Xiaohuan Pei, Tao Huang, Chang Xu

Inspired by this, this work proposes to explore the potential of visual state space models in light-weight model design and introduce a novel efficient model variant dubbed EfficientVMamba.

Language Modelling

LocalMamba: Visual State Space Model with Windowed Selective Scan

1 code implementation • 14 Mar 2024 • Tao Huang, Xiaohuan Pei, Shan You, Fei Wang, Chen Qian, Chang Xu

This paper posits that the key to enhancing Vision Mamba (ViM) lies in optimizing scan directions for sequence modeling.

Neural Architecture Retrieval

1 code implementation • 16 Jul 2023 • Xiaohuan Pei, Yanxi Li, Minjing Dong, Chang Xu

With the increasing number of new neural architecture designs and substantial existing neural architectures, it becomes difficult for the researchers to situate their contributions compared with existing neural architectures or establish the connections between their designs and other relevant ones.

Contrastive Learning Graph Representation Learning +1

GPT Self-Supervision for a Better Data Annotator

no code implementations • 7 Jun 2023 • Xiaohuan Pei, Yanxi Li, Chang Xu

In the one-shot tuning phase, we sample a data from the support set as part of the prompt for GPT to generate a textual summary, which is then used to recover the original data.

One-Shot Learning Sentence