Search Results for author: Daniele Paliotta

Found 2 papers, 1 papers with code

Faster Causal Attention Over Large Sequences Through Sparse Flash Attention

1 code implementation1 Jun 2023 Matteo Pagliardini, Daniele Paliotta, Martin Jaggi, François Fleuret

While many works have proposed schemes to sparsify the attention patterns and reduce the computational overhead of self-attention, those are often limited by implementations concerns and end up imposing a simple and static structure over the attention matrix.

16k 8k +1

Graph Neural Networks Go Forward-Forward

no code implementations10 Feb 2023 Daniele Paliotta, Mathieu Alain, Bálint Máté, François Fleuret

We present the Graph Forward-Forward (GFF) algorithm, an extension of the Forward-Forward procedure to graphs, able to handle features distributed over a graph's nodes.

Graph Property Prediction Property Prediction

Cannot find the paper you are looking for? You can Submit a new open access paper.