Search Results for author: Timoleon Moraitis

Found 9 papers, 5 papers with code

Single Neuromorphic Memristor closely Emulates Multiple Synaptic Mechanisms for Energy Efficient Neural Networks

no code implementations26 Feb 2024 Christoph Weilenmann, Alexandros Ziogas, Till Zellweger, Kevin Portner, Marko Mladenović, Manasa Kaniselvan, Timoleon Moraitis, Mathieu Luisier, Alexandros Emboras

Based on this finding, we infer that memristive devices with a better emulation of the synaptic functionalities do not only broaden the applicability of neuromorphic computing, but could also improve the performance and energy costs of certain artificial intelligence applications.

Meta-Learning

Self-Supervised Learning Through Efference Copies

1 code implementation17 Oct 2022 Franz Scherr, Qinghai Guo, Timoleon Moraitis

Specifically, the brain also transforms the environment through efference, i. e. motor commands, however it sends to itself an EC of the full commands, i. e. more than a mere SSL sign.

Image Classification object-detection +2

Hebbian Deep Learning Without Feedback

1 code implementation23 Sep 2022 Adrien Journé, Hector Garcia Rodriguez, Qinghai Guo, Timoleon Moraitis

Recent approximations to backpropagation (BP) have mitigated many of BP's computational inefficiencies and incompatibilities with biology, but important limitations still remain.

Short-Term Plasticity Neurons Learning to Learn and Forget

1 code implementation28 Jun 2022 Hector Garcia Rodriguez, Qinghai Guo, Timoleon Moraitis

Its key mechanism is that synapses have a state, propagated through time by a self-recurrent connection-within-the-synapse.

Reinforcement Learning (RL) Retrieval

Spike-inspired Rank Coding for Fast and Accurate Recurrent Neural Networks

1 code implementation ICLR 2022 Alan Jeffares, Qinghai Guo, Pontus Stenetorp, Timoleon Moraitis

We demonstrate these in two toy problems of sequence classification, and in a temporally-encoded MNIST dataset where our RC model achieves 99. 19% accuracy after the first input time-step, outperforming the state of the art in temporal coding with SNNs, as well as in spoken-word classification of Google Speech Commands, outperforming non-RC-trained early inference with LSTMs.

SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networks

1 code implementation12 Jul 2021 Timoleon Moraitis, Dmitry Toichkin, Adrien Journé, Yansong Chua, Qinghai Guo

All in all, Hebbian efficiency, theoretical underpinning, cross-entropy-minimization, and surprising empirical advantages, suggest that SoftHebb may inspire highly neuromorphic and radically different, but practical and advantageous learning algorithms and hardware accelerators.

Bayesian Inference

Optimality of short-term synaptic plasticity in modelling certain dynamic environments

no code implementations15 Sep 2020 Timoleon Moraitis, Abu Sebastian, Evangelos Eleftheriou

Biological neurons and their in-silico emulations for neuromorphic artificial intelligence (AI) use extraordinarily energy-efficient mechanisms, such as spike-based communication and local synaptic plasticity.

Bayesian Inference

File Classification Based on Spiking Neural Networks

no code implementations8 Apr 2020 Ana Stanojevic, Giovanni Cherubini, Timoleon Moraitis, Abu Sebastian

In this paper, we propose a system for file classification in large data sets based on spiking neural networks (SNNs).

Classification General Classification +1

Fatiguing STDP: Learning from Spike-Timing Codes in the Presence of Rate Codes

no code implementations17 Jun 2017 Timoleon Moraitis, Abu Sebastian, Irem Boybat, Manuel Le Gallo, Tomas Tuma, Evangelos Eleftheriou

However, some spike-timing-related strengths of SNNs are hindered by the sensitivity of spike-timing-dependent plasticity (STDP) rules to input spike rates, as fine temporal correlations may be obstructed by coarser correlations between firing rates.

Cannot find the paper you are looking for? You can Submit a new open access paper.