Search Results for author:
Found 5 papers, 2 papers with code
Revisiting the Power of Prompt for Visual Tuning
Inspired by the observation that the prompt tokens tend to share high mutual information with patch tokens, we propose initializing prompts with downstream token prototypes.
Ranked #1 on
Visual Prompt Tuning
on VTAB-1k(Structured<8>)
Attention-Driven Multichannel Speech Enhancement in Moving Sound Source Scenarios
The clean speech clips from WSJ0 are employed for simulating speech signals of moving speakers in a reverberant environment.
Improving Knowledge Distillation via Regularizing Feature Norm and Direction
Finally, we propose a rather simple loss term (dubbed ND loss) to simultaneously (1) encourage student to produce large-\emph{norm} features, and (2) align the \emph{direction} of student features and teacher class-means.
Ranked #1 on
Knowledge Distillation
on ImageNet
