Offline bilingual word vectors, orthogonal transformations and the inverted softmax

6 code implementations • 13 Feb 2017 • Samuel L. Smith, David H. P. Turban, Steven Hamblin, Nils Y. Hammerla

We introduce a novel "inverted softmax" for identifying translation pairs, with which we improve the precision @1 of Mikolov's original mapping from 34% to 43%, when translating a test set composed of both common and rare English words into Italian.

Translation