ERNIE: Enhanced Representation through Knowledge Integration

We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration). Inspired by the masking strategy of BERT, ERNIE is designed to learn language representation enhanced by knowledge masking strategies, which includes entity-level masking and phrase-level masking... (read more)

Results in Papers With Code
(↓ scroll down to see all results)