no code implementations • 30 Jun 2020 • Yoel Zeldes, Dan Padnos, Or Sharir, Barak Peleg
We introduce a simple and efficient method, called Auxiliary Tuning, for adapting a pre-trained Language Model to a novel task; we demonstrate this approach on the task of conditional text generation.
no code implementations • 19 Apr 2020 • Or Sharir, Barak Peleg, Yoav Shoham
We review the cost of training large-scale language models, and the drivers of these costs.