Browse SoTA > Natural Language Processing > Linguistic Acceptability

Linguistic Acceptability

17 papers with code · Natural Language Processing

Benchmarks

Greatest papers with code

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

NeurIPS 2019 huggingface/transformers

As Transfer Learning from large-scale pre-trained models becomes more prevalent in Natural Language Processing (NLP), operating these large models in on-the-edge and/or under constrained computational training or inference budgets remains challenging.

LANGUAGE MODELLING LINGUISTIC ACCEPTABILITY NATURAL LANGUAGE INFERENCE QUESTION ANSWERING SEMANTIC TEXTUAL SIMILARITY SENTIMENT ANALYSIS TRANSFER LEARNING

RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 Jul 2019huggingface/transformers

Language model pretraining has led to significant performance gains but careful comparison between different approaches is challenging.

Ranked #2 on Natural Language Inference on ANLI test (using extra training data)

LANGUAGE MODELLING LEXICAL SIMPLIFICATION LINGUISTIC ACCEPTABILITY NATURAL LANGUAGE INFERENCE QUESTION ANSWERING READING COMPREHENSION SEMANTIC TEXTUAL SIMILARITY SENTIMENT ANALYSIS

TinyBERT: Distilling BERT for Natural Language Understanding

23 Sep 2019huawei-noah/Pretrained-Language-Model

To accelerate inference and reduce model size while maintaining accuracy, we first propose a novel Transformer distillation method that is specially designed for knowledge distillation (KD) of the Transformer-based models.

LANGUAGE MODELLING LINGUISTIC ACCEPTABILITY NATURAL LANGUAGE INFERENCE NATURAL LANGUAGE UNDERSTANDING PARAPHRASE IDENTIFICATION QUESTION ANSWERING SEMANTIC TEXTUAL SIMILARITY SENTIMENT ANALYSIS

ERNIE: Enhanced Language Representation with Informative Entities

ACL 2019 thunlp/ERNIE

Neural language representation models such as BERT pre-trained on large-scale corpora can well capture rich semantic patterns from plain text, and be fine-tuned to consistently improve the performance of various NLP tasks.

ENTITY LINKING ENTITY TYPING KNOWLEDGE GRAPHS LINGUISTIC ACCEPTABILITY NATURAL LANGUAGE INFERENCE PARAPHRASE IDENTIFICATION SEMANTIC TEXTUAL SIMILARITY SENTIMENT ANALYSIS