Trending Research

Language Models are Unsupervised Multitask Learners

Preprint 2019 openai/gpt-2

Natural language processing tasks, such as question answering, machine translation, reading comprehension, and summarization, are typically approached with supervised learning on taskspecific datasets.

COMMON SENSE REASONING DOCUMENT SUMMARIZATION LANGUAGE MODELLING MACHINE TRANSLATION QUESTION ANSWERING READING COMPREHENSION

2,201
9.92 stars / hour

A Style-Based Generator Architecture for Generative Adversarial Networks

12 Dec 2018NVlabs/stylegan

We propose an alternative generator architecture for generative adversarial networks, borrowing from style transfer literature.

IMAGE GENERATION

3,136
3.81 stars / hour

Deep Neural Networks with Box Convolutions

NeurIPS 2018 shrubb/box-convolutions

Box filters computed using integral images have been part of the computer vision toolset for a long time.

SEMANTIC SEGMENTATION

96
1.16 stars / hour

nlp-tutorial

11 Oct 2018graykode/nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

COMMON SENSE REASONING CROSS-LINGUAL NATURAL LANGUAGE INFERENCE NAMED ENTITY RECOGNITION QUESTION ANSWERING

1,490
0.51 stars / hour

Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context

ICLR 2019 huggingface/pytorch-pretrained-BERT

Transformer networks have a potential of learning longer-term dependency, but are limited by a fixed-length context in the setting of language modeling.

LANGUAGE MODELLING

3,543
0.39 stars / hour

Efficient softmax approximation for GPUs

ICML 2017 huggingface/pytorch-pretrained-BERT

We propose an approximate strategy to efficiently train neural network based language models over very large vocabularies.

3,543
0.39 stars / hour

ELF OpenGo: An Analysis and Open Reimplementation of AlphaZero

12 Feb 2019pytorch/ELF

The AlphaGo, AlphaGo Zero, and AlphaZero series of algorithms are a remarkable demonstration of deep reinforcement learning's capabilities, achieving superhuman performance in the complex game of Go with progressively increasing autonomy.

GAME OF GO

2,639
0.39 stars / hour

dopamine

14 Dec 2018google/dopamine

Dopamine is a research framework for fast prototyping of reinforcement learning algorithms.

7,414
0.31 stars / hour

shap

12 Feb 2018slundberg/shap

A unified approach to explain the output of any machine learning model.

3,742
0.30 stars / hour

Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations

29 Nov 2018google-research/disentanglement_lib

On the negative side, we observe in our study that well-disentangled models seemingly cannot be identified without access to ground-truth labels even if we are allowed to transfer hyperparameters across data sets.

84
0.29 stars / hour