Search Results for author:
Found 28 papers, 19 papers with code
Local Correlation Consistency for Knowledge Distillation
Sufficient knowledge extraction from the teacher network plays a critical role in the knowledge distillation task to improve the performance of the student network.
GenView: Enhancing View Quality with Pretrained Generative Model for Self-Supervised Learning
To tackle these challenges, we present GenView, a controllable framework that augments the diversity of positive views leveraging the power of pretrained generative models while preserving semantics.
WKVQuant: Quantizing Weight and Key/Value Cache for Large Language Models Gains More
Large Language Models (LLMs) face significant deployment challenges due to their substantial memory requirements and the computational demands of auto-regressive text generation process.
SNP-S3: Shared Network Pre-training and Significant Semantic Strengthening for Various Video-Text Tasks
By employing one shared BERT-type network to refine textual and cross-modal features simultaneously, SNP is lightweight and could support various downstream applications.
Detecting and Grounding Multi-Modal Media Manipulation and Beyond
HAMMER performs 1) manipulation-aware contrastive learning between two uni-modal encoders as shallow manipulation reasoning, and 2) modality-aware cross-attention by multi-modal aggregator as deep manipulation reasoning.
Temporal Sentence Grounding in Streaming Videos
The goal of TSGSV is to evaluate the relevance between a video stream and a given sentence query.
Neural Collapse Terminus: A Unified Solution for Class Incremental Learning and Its Variants
Beyond the normal case, long-tail class incremental learning and few-shot class incremental learning are also proposed to consider the data imbalance and data scarcity, respectively, which are common in real-world implementations and further exacerbate the well-known problem of catastrophic forgetting.
Micro-video Tagging via Jointly Modeling Social Influence and Tag Relation
Existing methods mostly focus on analyzing video content, neglecting users' social influence and tag relation.
CHMATCH: Contrastive Hierarchical Matching and Robust Adaptive Threshold Boosted Semi-Supervised Learning
In the meantime, we make full use of the structured information in the hierarchical labels to learn an accurate affinity graph for contrastive learning.
Visual Perturbation-aware Collaborative Learning for Overcoming the Language Prior Problem
Several studies have recently pointed that existing Visual Question Answering (VQA) models heavily suffer from the language prior problem, which refers to capturing superficial statistical correlations between the question type and the answer whereas ignoring the image contents.
Semantic-aware Modular Capsule Routing for Visual Question Answering
Visual Question Answering (VQA) is fundamentally compositional in nature, and many questions are simply answered by decomposing them into modular sub-problems.
HEAD: HEtero-Assists Distillation for Heterogeneous Object Detectors
We observe that the core difficulty for heterogeneous KD (hetero-KD) is the significant semantic gap between the backbone features of heterogeneous detectors due to the different optimization manners.
Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generation
Scene Graph Generation, which generally follows a regular encoder-decoder pipeline, aims to first encode the visual contents within the given image and then parse them into a compact summary graph.
Ranked #1 on
Unbiased Scene Graph Generation
on Visual Genome
(mR@20 metric)
High Quality Segmentation for Ultra High-resolution Images
To segment 4K or 6K ultra high-resolution images needs extra computation consideration in image segmentation.
Dynamic Modality Interaction Modeling for Image-Text Retrieval
To address these issues, we develop a novel modality interaction modeling network based upon the routing mechanism, which is the first unified and dynamic multimodal interaction framework towards image-text retrieval.
Graph Contrastive Clustering
On the other hand, a novel graph-based contrastive learning strategy is proposed to learn more compact clustering assignments.
Fast and Differentiable Matrix Inverse and Its Extension to SVD
First of all, to perform matrix inverse, we provide a differentiable yet efficient way, named LD-Minv, which is a learnable deep neural network (DNN) with each layer being an $L$-th order matrix polynomial.
Agree to Disagree: Adaptive Ensemble Knowledge Distillation in Gradient Space
In this paper, we examine the diversity of teacher models in the gradient space and regard the ensemble knowledge distillation as a multi-objective optimization problem so that we can determine a better optimization direction for the training of student network.
Multi-modal Cooking Workflow Construction for Food Recipes
Understanding food recipe requires anticipating the implicit causal effects of cooking actions, such that the recipe can be converted into a graph describing the temporal workflow of the recipe.
Maximum-and-Concatenation Networks
While successful in many fields, deep neural networks (DNNs) still suffer from some open problems such as bad local minima and unsatisfactory generalization performance.
Dynamical System Inspired Adaptive Time Stepping Controller for Residual Network Families
We establish a stability condition for ResNets with step sizes and weight parameters, and point out the effects of step sizes on the stability and performance.
SOGNet: Scene Overlap Graph Network for Panoptic Segmentation
In order to overcome the lack of supervision, we introduce a differentiable module to resolve the overlap between any pair of instances.
Ranked #8 on
Panoptic Segmentation
on Cityscapes test
Expectation-Maximization Attention Networks for Semantic Segmentation
It is designed to compute the representation of each position by a weighted sum of the features at all positions.
Ranked #11 on
Semantic Segmentation
on COCO-Stuff test
Differentiable Linearized ADMM
Recently, a number of learning-based optimization methods that combine data-driven architectures with the classical optimization algorithms have been proposed and explored, showing superior empirical performance in solving various ill-posed inverse problems, but there is still a scarcity of rigorous analysis about the convergence behaviors of learning-based optimization.
Deep Comprehensive Correlation Mining for Image Clustering
Recent developed deep unsupervised methods allow us to jointly learn representation and cluster unlabelled data.
Ranked #7 on
Image Clustering
on Tiny-ImageNet
Matrix Recovery with Implicitly Low-Rank Data
To tackle this issue, we propose a novel method for matrix recovery in this paper, which could well handle the case where the target matrix is low-rank in an implicit feature space but high-rank or even full-rank in its original form.
Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining
In heavy rain, rain streaks have various directions and shapes, which can be regarded as the accumulation of multiple rain streak layers.
Ranked #7 on
Single Image Deraining
on Test2800
Essential Tensor Learning for Multi-view Spectral Clustering
In this paper, we focus on the Markov chain based spectral clustering method and propose a novel essential tensor learning method to explore the high order correlations for multi-view representation.
