Search Results for author:
Found 17 papers, 10 papers with code
ParameterNet: Parameters Are All You Need
In the language domain, LLaMA-1B enhanced with ParameterNet achieves 2\% higher accuracy over vanilla LLaMA.
Robust and Efficient Memory Network for Video Object Segmentation
For limitation 2, we first adaptively decide whether to update the memory features depending on the variation of foreground objects to reduce temporal redundancy.
Bag of Tricks with Quantized Convolutional Neural Networks for image classification
To bridge this gap, we collect and improve existing quantization methods and propose a gold guideline for post-training quantization.
3D Human Pose Lifting with Grid Convolution
Existing lifting networks for regressing 3D human poses from 2D single-view poses are typically constructed with linear layers based on graph-structured representation learning.
Elastic Aggregation for Federated Optimization
Federated learning enables the privacy-preserving training of neural network models using real-world data across distributed clients.
Redistribution of Weights and Activations for AdderNet Quantization
To this end, we first thoroughly analyze the difference on distributions of weights and activations in AdderNet and then propose a new quantization algorithm by redistributing the weights and the activations.
Rethinking skip connection model as a learnable Markov chain
In this work, we deep dive into the model's behaviors with skip connections which can be formulated as a learnable Markov chain.
Vision GNN: An Image is Worth Graph of Nodes
In this paper, we propose to represent the image as a graph structure and introduce a new Vision GNN (ViG) architecture to extract graph-level feature for visual tasks.
Ranked #365 on
Image Classification
on ImageNet
GhostNets on Heterogeneous Devices via Cheap Operations
The proposed C-Ghost module can be taken as a plug-and-play component to upgrade existing convolutional neural networks.
Elastic-Link for Binarized Neural Network
For example, we raise the top-1 accuracy of binarized ResNet26 from 57. 9% to 64. 0%.
Learning Versatile Convolution Filters for Efficient Visual Recognition
A series of secondary filters can be derived from a primary filter with the help of binary masks.
Overfitting the Data: Compact Neural Video Delivery via Content-aware Feature Modulation
Internet video delivery has undergone a tremendous explosion of growth over the past few years.
Dynamic Resolution Network
To this end, we propose a novel dynamic-resolution network (DRNet) in which the input resolution is determined dynamically based on each input sample.
Transformer in Transformer
In this paper, we point out that the attention inside these local patches are also essential for building visual transformers with high performance and we explore a new architecture, namely, Transformer iN Transformer (TNT).
Training Binary Neural Networks through Learning with Noisy Supervision
This paper formalizes the binarization operations over neural networks from a learning perspective.
Squeeze-and-Excitation Networks
Squeeze-and-Excitation Networks formed the foundation of our ILSVRC 2017 classification submission which won first place and reduced the top-5 error to 2. 251%, surpassing the winning entry of 2016 by a relative improvement of ~25%.
Ranked #59 on
Image Classification
on CIFAR-10
Handling Motion Blur in Multi-Frame Super-Resolution
Ubiquitous motion blur easily fails multi-frame super-resolution (MFSR).
