Transformers are Multi-State RNNs

1 code implementation • 11 Jan 2024 • Matanel Oren, Michael Hassid, Yossi Adi, Roy Schwartz

We further show that pretrained transformers can be converted into $\textit{finite}$ multi-state RNNs by fixing the size of their hidden state.

SERRANT: a syntactic classifier for English Grammatical Error Types

1 code implementation • 6 Apr 2021 • Leshem Choshen, Matanel Oren, Dmitry Nikolaev, Omri Abend

SERRANT is a system and code for automatic classification of English grammatical errors that combines SErCl and ERRANT.

General Classification