SDiT: Spiking Diffusion Model with Transformer

no code implementations • 18 Feb 2024 • Shu Yang, Hanzhi Ma, Chengting Yu, Aili Wang, Er-Ping Li

In this paper, we explore a novel diffusion model architecture within spiking neural networks.

Image Generation

Go beyond End-to-End Training: Boosting Greedy Local Learning with Context Supply

1 code implementation • 12 Dec 2023 • Chengting Yu, Fengzhao Zhang, Hanzhi Ma, Aili Wang, Erping Li

Traditional end-to-end (E2E) training of deep networks necessitates storing intermediate activations for back-propagation, resulting in a large memory footprint on GPUs and restricted model parallelization.

STSC-SNN: Spatio-Temporal Synaptic Connection with Temporal Convolution and Attention for Spiking Neural Networks

1 code implementation • 11 Oct 2022 • Chengting Yu, Zheming Gu, Da Li, Gaoang Wang, Aili Wang, Erping Li

We show that endowing synaptic models with temporal dependencies can improve the performance of SNNs on classification tasks.

Audio Classification Gesture Recognition +1

MAP-SNN: Mapping Spike Activities with Multiplicity, Adaptability, and Plasticity into Bio-Plausible Spiking Neural Networks

1 code implementation • 21 Apr 2022 • Chengting Yu, Yangkai Du, Mufeng Chen, Aili Wang, Gaoang Wang, Erping Li

For plasticity, we propose a trainable convolutional synapse that models spike response current to enhance the diversity of spiking neurons for temporal feature extraction.

Audio Classification