Search Results for author: Brendan Yap

Found 2 papers, 1 papers with code

Structure Inducing Pre-Training

1 code implementation18 Mar 2021 Matthew B. A. McDermott, Brendan Yap, Peter Szolovits, Marinka Zitnik

Based on this review, we introduce a descriptive framework for pre-training that allows for a granular, comprehensive understanding of how relational structure can be induced.

Descriptive Inductive Bias +3

Adversarial Contrastive Pre-training for Protein Sequences

no code implementations31 Jan 2021 Matthew B. A. McDermott, Brendan Yap, Harry Hsu, Di Jin, Peter Szolovits

Recent developments in Natural Language Processing (NLP) demonstrate that large-scale, self-supervised pre-training can be extremely beneficial for downstream tasks.

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.