Browse SoTA > Natural Language Processing > Linguistic Acceptability

Linguistic Acceptability

13 papers with code · Natural Language Processing

Leaderboards

Greatest papers with code

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

NeurIPS 2019 huggingface/transformers

As Transfer Learning from large-scale pre-trained models becomes more prevalent in Natural Language Processing (NLP), operating these large models in on-the-edge and/or under constrained computational training or inference budgets remains challenging.

LANGUAGE MODELLING LINGUISTIC ACCEPTABILITY NATURAL LANGUAGE INFERENCE QUESTION ANSWERING SEMANTIC TEXTUAL SIMILARITY SENTIMENT ANALYSIS TRANSFER LEARNING

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

arXiv 2019 google-research/text-to-text-transfer-transformer

Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP).

 SOTA for Sentiment Analysis on SST-2 Binary classification (using extra training data)

LINGUISTIC ACCEPTABILITY NATURAL LANGUAGE INFERENCE QUESTION ANSWERING SEMANTIC TEXTUAL SIMILARITY SENTIMENT ANALYSIS TEXT CLASSIFICATION TRANSFER LEARNING

TinyBERT: Distilling BERT for Natural Language Understanding

23 Sep 2019huawei-noah/Pretrained-Language-Model

To accelerate inference and reduce model size while maintaining accuracy, we firstly propose a novel transformer distillation method that is a specially designed knowledge distillation (KD) method for transformer-based models.

LANGUAGE MODELLING LINGUISTIC ACCEPTABILITY NATURAL LANGUAGE INFERENCE NATURAL LANGUAGE UNDERSTANDING PARAPHRASE IDENTIFICATION QUESTION ANSWERING SEMANTIC TEXTUAL SIMILARITY SENTIMENT ANALYSIS

ERNIE: Enhanced Language Representation with Informative Entities

ACL 2019 thunlp/ERNIE

Neural language representation models such as BERT pre-trained on large-scale corpora can well capture rich semantic patterns from plain text, and be fine-tuned to consistently improve the performance of various NLP tasks.

ENTITY LINKING ENTITY TYPING KNOWLEDGE GRAPHS LINGUISTIC ACCEPTABILITY NATURAL LANGUAGE INFERENCE PARAPHRASE IDENTIFICATION SEMANTIC TEXTUAL SIMILARITY SENTIMENT ANALYSIS