Search Results for author: Pranav S. Dulepet

Found 1 papers, 0 papers with code

FAST: Factorizable Attention for Speeding up Transformers

no code implementations12 Feb 2024 Armin Gerami, Monte Hoover, Pranav S. Dulepet, Ramani Duraiswami

Motivated by the factorization inherent in the original fast multipole method and the improved fast Gauss transform we introduce a factorable form of attention that operates efficiently in high dimensions.

Cannot find the paper you are looking for? You can Submit a new open access paper.