Search Results for author:
Found 40 papers, 16 papers with code
SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks
Based on DSSA, we propose a novel spiking Vision Transformer architecture called SpikingResformer, which combines the ResNet-based multi-stage architecture with our proposed DSSA to improve both performance and energy efficiency while reducing parameters.
SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams
Our approach begins with the formulation of a spike-guided deblurring model that explores the theoretical relationships among spike streams, blurry images, and their corresponding sharp sequences.
LM-HT SNN: Enhancing the Performance of SNN to ANN Counterpart through Learnable Multi-hierarchical Threshold Model
Compared to traditional Artificial Neural Network (ANN), Spiking Neural Network (SNN) has garnered widespread academic interest for its intrinsic ability to transmit information in a more biological-inspired and energy-efficient manner.
Deep Learning for Visual Neuroprosthesis
The visual pathway involves complex networks of cells and regions which contribute to the encoding and processing of visual information.
Deep Pulse-Coupled Neural Networks
In this work, we leverage a more biologically plausible neural model with complex dynamics, i. e., a pulse-coupled neural network (PCNN), to improve the expressiveness and recognition performance of SNNs for vision tasks.
INeAT: Iterative Neural Adaptive Tomography
Here, we propose a neural rendering method for CT reconstruction, named Iterative Neural Adaptive Tomography (INeAT), which incorporates iterative posture optimization to effectively counteract the influence of posture perturbations in data, particularly in cases involving significant posture variations.
SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence
Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties.
Unveiling the Potential of Spike Streams for Foreground Occlusion Removal from Densely Continuous Views
To process the spikes, we build a novel model \textbf{SpkOccNet}, in which we integrate information of spikes from continuous viewpoints within multi-windows, and propose a novel cross-view mutual attention mechanism for effective fusion and refinement.
Spike timing reshapes robustness against attacks in spiking neural networks
The success of deep learning in the past decade is partially shrouded in the shadow of adversarial attacks.
One Forward is Enough for Neural Network Training via Likelihood Ratio Method
While backpropagation (BP) is the mainstream approach for gradient computation in neural network training, its heavy reliance on the chain rule of differentiation constrains the designing flexibility of network architecture and training pipelines.
Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies
Vanilla spiking neurons in Spiking Neural Networks (SNNs) use charge-fire-reset neuronal dynamics, which can only be simulated serially and can hardly learn long-time dependencies.
Spike Stream Denoising via Spike Camera Simulation
Based on our noise model, the first benchmark for spike stream denoising is proposed which includes clear (noisy) spike stream.
Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World Scenarios
Based on this, we propose Asymmetric Tunable Blind-Spot Network (AT-BSN), where the blind-spot size can be freely adjusted, thus better balancing noise correlation suppression and image local spatial destruction during training and inference.
SpikeCV: Open a Continuous Computer Vision Era
SpikeCV focuses on encapsulation for spike data, standardization for dataset interfaces, modularization for vision tasks, and real-time applications for challenging scenes.
Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks
In this paper, we theoretically analyze ANN-SNN conversion error and derive the estimated activation function of SNNs.
A Unified Framework for Soft Threshold Pruning
In this work, we reformulate soft threshold pruning as an implicit optimization problem solved using the Iterative Shrinkage-Thresholding Algorithm (ISTA), a classic method from the fields of sparse recovery and compressed sensing.
Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikes
The experimental results show that our proposed method achieves state-of-the-art performance on CIFAR-10, CIFAR-100, and ImageNet datasets.
A Novel Noise Injection-based Training Scheme for Better Model Robustness
Noise injection-based method has been shown to be able to improve the robustness of artificial neural networks in previous work.
Reducing ANN-SNN Conversion Error through Residual Membrane Potential
Spiking Neural Networks (SNNs) have received extensive academic attention due to the unique properties of low power consumption and high-speed computing on neuromorphic chips.
Rate Gradient Approximation Attack Threats Deep Spiking Neural Networks
Spiking Neural Networks (SNNs) have attracted significant attention due to their energy-efficient properties and potential application on neuromorphic hardware.
Complementary Intrinsics From Neural Radiance Fields and CNNs for Outdoor Scene Relighting
Relighting an outdoor scene is challenging due to the diverse illuminations and salient cast shadows.
Deep Spike Learning with Local Classifiers
We then propose two variants that additionally incorporate temporal dependencies through a backward and forward process, respectively.
Optimized Potential Initialization for Low-latency Spiking Neural Networks
We evaluate our algorithm on the CIFAR-10, CIFAR-100 and ImageNet datasets and achieve state-of-the-art accuracy, using fewer time-steps.
1000x Faster Camera and Machine Vision with Ordinary Devices
By treating vidar as spike trains in biological vision, we have further developed a spiking neural network-based machine vision system that combines the speed of the machine and the mechanism of biological vision, achieving high-speed object detection and tracking 1, 000x faster than human vision.
Accelerating Training of Deep Spiking Neural Networks with Parameter Initialization
Despite that spiking neural networks (SNNs) show strong advantages in information encoding, power consuming, and computational capability, the underdevelopment of supervised learning algorithms is still a hindrance for training SNN.
Spatio-Temporal Recurrent Networks for Event-Based Optical Flow Estimation
Recently, many deep learning methods have shown great success in providing promising solutions to many event-based problems, such as optical flow estimation.
High-Speed Image Reconstruction Through Short-Term Plasticity for Spiking Cameras
Mimicking the sampling mechanism of the fovea, a retina-inspired camera, named spiking camera, is developed to record the external information with a sampling rate of 40, 000 Hz, and outputs asynchronous binary spike streams.
Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks
We show that the inference time can be reduced by optimizing the upper bound of the fit curve in the revised ANN to achieve fast inference.
Pruning of Deep Spiking Neural Networks through Gradient Rewiring
Our key innovation is to redefine the gradient to a new synaptic parameter, allowing better exploration of network structures by taking full advantage of the competition between pruning and regrowth of connections.
Deep Residual Learning in Spiking Neural Networks
Previous Spiking ResNet mimics the standard residual block in ANNs and simply replaces ReLU activation layers with spiking neurons, which suffers the degradation problem and can hardly implement residual learning.
Super Resolve Dynamic Scene From Continuous Spike Streams
In this paper, we properly exploit the relative motion and derive the relationship between light intensity and each spike, so as to recover the external scene with both high temporal and high spatial resolution.
Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks
In this paper, we take inspiration from the observation that membrane-related parameters are different across brain regions, and propose a training algorithm that is capable of learning not only the synaptic weights but also the membrane time constants of SNNs.
Reconstruction of Natural Visual Scenes from Neural Spikes with Deep Neural Networks
The SID is an end-to-end decoder with one end as neural spikes and the other end as images, which can be trained directly such that visual scenes are reconstructed from spikes in a highly accurate fashion.
Probabilistic Inference of Binary Markov Random Fields in Spiking Neural Networks through Mean-field Approximation
Recent studies have suggested that the cognitive process of the human brain is realized as probabilistic inference and can be further modeled by probabilistic graphical models like Markov random fields.
Revealing Fine Structures of the Retinal Receptive Field by Deep Learning Networks
When a deep CNN with many layers is used for the visual system, it is not easy to compare the structure components of CNNs with possible neuroscience underpinnings due to highly complex circuits from the retina to higher visual cortex.
Neural System Identification with Spike-triggered Non-negative Matrix Factorization
Furthermore, we show that STNMF can separate spikes of a ganglion cell into a few subsets of spikes where each subset is contributed by one presynaptic bipolar cell.
Winner-Take-All as Basic Probabilistic Inference Unit of Neuronal Circuits
Taken together, our results suggest that the WTA circuit could be seen as the minimal inference unit of neuronal circuits.
Revealing structure components of the retina by deep learning networks
By training CNNs with white noise images to predicate neural responses, we found that convolutional filters learned in the end are resembling to biological components of the retinal circuit.
CaMKII activation supports reward-based neural network optimization through Hamiltonian sampling
Our theoretical analysis shows that stochastic search could in principle even attain optimal network configurations by emulating one of the most well-known nonlinear optimization methods, simulated annealing.
Sampling-based Causal Inference in Cue Combination and its Neural Implementation
Although the Bayesian causal inference model explains the problem of causal inference in cue combination successfully, how causal inference in cue combination could be implemented by neural circuits, is unclear.
