Browse SoTA > Computer Vision > Contrastive Learning

Contrastive Learning

75 papers with code · Computer Vision

Benchmarks

No evaluation results yet. Help compare methods by submit evaluation metrics.

Greatest papers with code

Contrastive Learning of General-Purpose Audio Representations

21 Oct 2020google-research/google-research

We introduce COLA, a self-supervised pre-training approach for learning a general-purpose representation of audio.

CONTRASTIVE LEARNING

Improved Baselines with Momentum Contrastive Learning

9 Mar 2020facebookresearch/moco

Contrastive unsupervised learning has recently shown encouraging progress, e. g., in Momentum Contrast (MoCo) and SimCLR.

CONTRASTIVE LEARNING DATA AUGMENTATION REPRESENTATION LEARNING SELF-SUPERVISED IMAGE CLASSIFICATION

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training

15 Jul 2020microsoft/unilm

In this work, we formulate cross-lingual language model pre-training as maximizing mutual information between multilingual-multi-granularity texts.

CONTRASTIVE LEARNING CROSS-LINGUAL TRANSFER LANGUAGE MODELLING

Viewmaker Networks: Learning Views for Unsupervised Representation Learning

ICLR 2021 makcedward/nlpaug

However, designing these views requires considerable human expertise and experimentation, hindering widespread adoption of unsupervised representation learning methods across domains and modalities.

CONTRASTIVE LEARNING UNSUPERVISED REPRESENTATION LEARNING

Delving into Inter-Image Invariance for Unsupervised Visual Representations

26 Aug 2020open-mmlab/OpenSelfSup

Contrastive learning has recently shown immense potential in unsupervised visual representation learning.

CONTRASTIVE LEARNING REPRESENTATION LEARNING

Contrastive Multiview Coding

ECCV 2020 HobbitLong/CMC

We analyze key properties of the approach that make it work, finding that the contrastive loss outperforms a popular alternative based on cross-view prediction, and that the more views we learn from, the better the resulting representation captures underlying scene semantics.

CONTRASTIVE LEARNING OBJECT CLASSIFICATION SELF-SUPERVISED ACTION RECOGNITION SELF-SUPERVISED IMAGE CLASSIFICATION

Contrastive Representation Distillation

ICLR 2020 HobbitLong/RepDistiller

We demonstrate that this objective ignores important structural knowledge of the teacher network.

CONTRASTIVE LEARNING MODEL COMPRESSION TRANSFER LEARNING