KR-BERT: A Small-Scale Korean-Specific Language Model

1 code implementation • 10 Aug 2020 • Sangah Lee, Hansol Jang, Yunmee Baik, Suzi Park, Hyopil Shin

Since the appearance of BERT, recent works including XLNet and RoBERTa utilize sentence embedding models pre-trained by large corpora and a large number of parameters.

Language Modelling Sentence +2