Search Results for author: Dongcheng Zhao

Found 24 papers, 3 papers with code

TIM: An Efficient Temporal Interaction Module for Spiking Transformer

1 code implementation22 Jan 2024 Sicheng Shen, Dongcheng Zhao, Guobin Shen, Yi Zeng

Spiking Neural Networks (SNNs), as the third generation of neural networks, have gained prominence for their biological plausibility and computational efficiency, especially in processing diverse datasets.

Computational Efficiency

Astrocyte-Enabled Advancements in Spiking Neural Networks for Large Language Modeling

no code implementations12 Dec 2023 Guobin Shen, Dongcheng Zhao, Yiting Dong, Yang Li, Jindong Li, Kang Sun, Yi Zeng

Within the complex neuroarchitecture of the brain, astrocytes play crucial roles in development, structure, and metabolism.

Language Modelling Text Generation

Is Conventional SNN Really Efficient? A Perspective from Network Quantization

no code implementations17 Nov 2023 Guobin Shen, Dongcheng Zhao, Tenglong Li, Jindong Li, Yi Zeng

This paper introduces a unified perspective, illustrating that the time steps in SNNs and quantized bit-widths of activation values present analogous representations.

Fairness Quantization

FireFly v2: Advancing Hardware Support for High-Performance Spiking Neural Network with a Spatiotemporal FPGA Accelerator

no code implementations28 Sep 2023 Jindong Li, Guobin Shen, Dongcheng Zhao, Qian Zhang, Yi Zeng

As a further step in supporting high-performance SNNs on specialized hardware, we introduce FireFly v2, an FPGA SNN accelerator that can address the issue of non-spike operation in current SOTA SNN algorithms, which presents an obstacle in the end-to-end deployment onto existing SNN hardware.

Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks

no code implementations23 Aug 2023 Guobin Shen, Dongcheng Zhao, Yiting Dong, Yang Li, Feifei Zhao, Yi Zeng

This shift in focus from weight adjustment to mastering the intricacies of synaptic change offers a more flexible and dynamic pathway for neural networks to evolve and adapt.

Improving Stability and Performance of Spiking Neural Networks through Enhancing Temporal Consistency

no code implementations23 May 2023 Dongcheng Zhao, Guobin Shen, Yiting Dong, Yang Li, Yi Zeng

Notably, our algorithm has achieved state-of-the-art performance on neuromorphic datasets DVS-CIFAR10 and N-Caltech101, and can achieve superior performance in the test phase with timestep T=1.

Dive into the Power of Neuronal Heterogeneity

no code implementations19 May 2023 Guobin Shen, Dongcheng Zhao, Yiting Dong, Yang Li, Yi Zeng

The biological neural network is a vast and diverse structure with high neural heterogeneity.

Continuous Control

Spiking Generative Adversarial Network with Attention Scoring Decoding

no code implementations17 May 2023 Linghao Feng, Dongcheng Zhao, Yi Zeng

As it stands, such models are primarily limited to the domain of artificial neural networks.

Generative Adversarial Network

Temporal Knowledge Sharing enable Spiking Neural Network Learning from Past and Future

no code implementations13 Apr 2023 Yiting Dong, Dongcheng Zhao, Yi Zeng

However, SNNs typically grapple with challenges such as extended time steps, low temporal information utilization, and the requirement for consistent time step between testing and training.

MSAT: Biologically Inspired Multi-Stage Adaptive Threshold for Conversion of Spiking Neural Networks

no code implementations23 Mar 2023 Xiang He, Yang Li, Dongcheng Zhao, Qingqun Kong, Yi Zeng

The self-adaptation to membrane potential and input allows a timely adjustment of the threshold to fire spike faster and transmit more information.

Sentiment Analysis Sentiment Classification +2

An Efficient Knowledge Transfer Strategy for Spiking Neural Networks from Static to Event Domain

1 code implementation23 Mar 2023 Xiang He, Dongcheng Zhao, Yang Li, Guobin Shen, Qingqun Kong, Yi Zeng

In order to improve the generalization ability of SNNs on event-based datasets, we use static images to assist SNN training on event data.

Transfer Learning

Exploiting High Performance Spiking Neural Networks with Efficient Spiking Patterns

no code implementations29 Jan 2023 Guobin Shen, Dongcheng Zhao, Yi Zeng

Inspired by spike patterns in biological neurons, this paper introduces the dynamic Burst pattern and designs the Leaky Integrate and Fire or Burst (LIFB) neuron that can make a trade-off between short-time performance and dynamic temporal performance from the perspective of network information capacity.

Vocal Bursts Intensity Prediction

FireFly: A High-Throughput Hardware Accelerator for Spiking Neural Networks with Efficient DSP and Memory Optimization

no code implementations5 Jan 2023 Jindong Li, Guobin Shen, Dongcheng Zhao, Qian Zhang, Yi Zeng

To improve memory efficiency, we design a memory system to enable efficient synaptic weights and membrane voltage memory access with reasonable on-chip RAM consumption.

BrainCog: A Spiking Neural Network based Brain-inspired Cognitive Intelligence Engine for Brain-inspired AI and Brain Simulation

no code implementations18 Jul 2022 Yi Zeng, Dongcheng Zhao, Feifei Zhao, Guobin Shen, Yiting Dong, Enmeng Lu, Qian Zhang, Yinqian Sun, Qian Liang, Yuxuan Zhao, Zhuoya Zhao, Hongjian Fang, Yuwei Wang, Yang Li, Xin Liu, Chengcheng Du, Qingqun Kong, Zizhe Ruan, Weida Bi

These brain-inspired AI models have been effectively validated on various supervised, unsupervised, and reinforcement learning tasks, and they can be used to enable AI models to be with multiple brain-inspired cognitive functions.

Decision Making

An Unsupervised STDP-based Spiking Neural Network Inspired By Biologically Plausible Learning Rules and Connections

no code implementations6 Jul 2022 Yiting Dong, Dongcheng Zhao, Yang Li, Yi Zeng

By integrating the above three adaptive mechanisms and STB-STDP, our model greatly accelerates the training of unsupervised spiking neural networks and improves the performance of unsupervised SNNs on complex tasks.

EventMix: An Efficient Augmentation Strategy for Event-Based Data

no code implementations24 May 2022 Guobin Shen, Dongcheng Zhao, Yi Zeng

Data augmentation can improve the quantity and quality of the original data by processing more representations from the original data.

Data Augmentation

DPSNN: A Differentially Private Spiking Neural Network with Temporal Enhanced Pooling

no code implementations24 May 2022 Jihang Wang, Dongcheng Zhao, Guobin Shen, Qian Zhang, Yi Zeng

Privacy protection is a crucial issue in machine learning algorithms, and the current privacy protection is combined with traditional artificial neural networks based on real values.

Face Recognition Image Classification +5

N-Omniglot, a large-scale neuromorphic dataset for spatio-temporal sparse few-shot learning

1 code implementation25 Dec 2021 Yang Li, Yiting Dong, Dongcheng Zhao, Yi Zeng

Few-shot learning (learning with a few samples) is one of the most important cognitive abilities of the human brain.

Few-Shot Learning

Spiking CapsNet: A Spiking Neural Network With A Biologically Plausible Routing Rule Between Capsules

no code implementations15 Nov 2021 Dongcheng Zhao, Yang Li, Yi Zeng, Jihang Wang, Qian Zhang

Our Spiking CapsNet fully combines the strengthens of SNN and CapsNet, and shows strong robustness to noise and affine transformation.

Backpropagation with Biologically Plausible Spatio-Temporal Adjustment For Training Deep Spiking Neural Networks

no code implementations17 Oct 2021 Guobin Shen, Dongcheng Zhao, Yi Zeng

Secondly, we propose a biologically plausible temporal adjustment making the error propagate across the spikes in the temporal dimension, which overcomes the problem of the temporal dependency within a single spike period of the traditional spiking neurons.

BSNN: Towards Faster and Better Conversion of Artificial Neural Networks to Spiking Neural Networks with Bistable Neurons

no code implementations27 May 2021 Yang Li, Yi Zeng, Dongcheng Zhao

Also, when ResNet structure-based ANNs are converted, the information of output neurons is incomplete due to the rapid transmission of the shortcut path.

BackEISNN: A Deep Spiking Neural Network with Adaptive Self-Feedback and Balanced Excitatory-Inhibitory Neurons

no code implementations27 May 2021 Dongcheng Zhao, Yi Zeng, Yang Li

With the combination of the two mechanisms, we propose a deep spiking neural network with adaptive self-feedback and balanced excitatory and inhibitory neurons (BackEISNN).

Cannot find the paper you are looking for? You can Submit a new open access paper.