Search Results for author: Haoqing Wang

Found 8 papers, 7 papers with code

Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancy

1 code implementation ICCV 2023 Shibo Jie, Haoqing Wang, Zhi-Hong Deng

Current state-of-the-art results in computer vision depend in part on fine-tuning large pre-trained vision models.

Quantization

Masked Image Modeling with Local Multi-Scale Reconstruction

1 code implementation CVPR 2023 Haoqing Wang, Yehui Tang, Yunhe Wang, Jianyuan Guo, Zhi-Hong Deng, Kai Han

The lower layers are not explicitly guided and the interaction among their patches is only used for calculating new activations.

Representation Learning

Contrastive Prototypical Network with Wasserstein Confidence Penalty

1 code implementation European Conference on Computer Vision 2022 Haoqing Wang, Zhi-Hong Deng

This results in our CPN (Contrastive Prototypical Network) model, which combines the prototypical loss with pairwise contrast and outperforms the existing models from this paradigm with modestly large batch size.

Contrastive Learning Inductive Bias +2

What Makes for Good Representations for Contrastive Learning

no code implementations29 Sep 2021 Haoqing Wang, Xun Guo, Zhi-Hong Deng, Yan Lu

Therefore, we assume the task-relevant information that is not shared between views can not be ignored and theoretically prove that the minimal sufficient representation in contrastive learning is not sufficient for the downstream tasks, which causes performance degradation.

Contrastive Learning Representation Learning

Cross-Domain Few-Shot Classification via Adversarial Task Augmentation

1 code implementation29 Apr 2021 Haoqing Wang, Zhi-Hong Deng

However, when there exists the domain shift between the training tasks and the test tasks, the obtained inductive bias fails to generalize across domains, which degrades the performance of the meta-learning models.

Classification Cross-Domain Few-Shot +4

Few-shot Learning with LSSVM Base Learner and Transductive Modules

1 code implementation12 Sep 2020 Haoqing Wang, Zhi-Hong Deng

The performance of meta-learning approaches for few-shot learning generally depends on three aspects: features suitable for comparison, the classifier ( base learner ) suitable for low-data scenarios, and valuable information from the samples to classify.

Few-Shot Learning

Fast Structured Decoding for Sequence Models

1 code implementation NeurIPS 2019 Zhiqing Sun, Zhuohan Li, Haoqing Wang, Zi Lin, Di He, Zhi-Hong Deng

However, these models assume that the decoding process of each token is conditionally independent of others.

Machine Translation Sentence +1

Cannot find the paper you are looking for? You can Submit a new open access paper.