no code implementations • 20 Nov 2022 • Li S. Yifei, Lyle Ungar, João Sedoc
We propose two methods of applying conceptors (1) bias subspace projection by post-processing by the conceptor NOT operation; and (2) a new architecture, conceptor-intervened BERT (CI-BERT), which explicitly incorporates the conceptor projection into all layers during training.