Search Results for author: Dmitry Doryn

Found 2 papers, 1 papers with code

Logic and the 2-Simplicial Transformer

1 code implementation ICLR 2020 James Clift, Dmitry Doryn, Daniel Murfet, James Wallbridge

We introduce the 2-simplicial Transformer, an extension of the Transformer which includes a form of higher-dimensional attention generalising the dot-product attention, and uses this attention to update entity representations with tensor products of value vectors.

Inductive Bias Logical Reasoning +2

Logic and the $2$-Simplicial Transformer

no code implementations2 Sep 2019 James Clift, Dmitry Doryn, Daniel Murfet, James Wallbridge

We introduce the $2$-simplicial Transformer, an extension of the Transformer which includes a form of higher-dimensional attention generalising the dot-product attention, and uses this attention to update entity representations with tensor products of value vectors.

Inductive Bias Logical Reasoning +2

Cannot find the paper you are looking for? You can Submit a new open access paper.