1 code implementation • 18 Mar 2021 • Matthew B. A. McDermott, Brendan Yap, Peter Szolovits, Marinka Zitnik
Based on this review, we introduce a descriptive framework for pre-training that allows for a granular, comprehensive understanding of how relational structure can be induced.
no code implementations • 31 Jan 2021 • Matthew B. A. McDermott, Brendan Yap, Harry Hsu, Di Jin, Peter Szolovits
Recent developments in Natural Language Processing (NLP) demonstrate that large-scale, self-supervised pre-training can be extremely beneficial for downstream tasks.