About

The objective of video retrieval is as follows: given a text query and a pool of candidate videos, select the video which corresponds to the text query. Typically, the videos are returned as a ranked list of candidates and scored via document retrieval metrics.

Benchmarks

TREND DATASET BEST METHOD PAPER TITLE PAPER CODE COMPARE

Subtasks

Datasets

Greatest papers with code

Talking Face Generation by Adversarially Disentangled Audio-Visual Representation

20 Jul 2018Hangz-nju-cuhk/Talking-Face-Generation-DAVS

Talking face generation aims to synthesize a sequence of face images that correspond to a clip of speech.

LIP READING TALKING FACE GENERATION VIDEO RETRIEVAL

Deep Hashing with Category Mask for Fast Video Retrieval

22 Dec 2017willard-yuan/hashing-baseline-for-image-retrieval

This paper proposes an end-to-end deep hashing framework with category mask for fast video retrieval.

CODE GENERATION VIDEO RETRIEVAL

ECO: Efficient Convolutional Network for Online Video Understanding

ECCV 2018 mzolfaghari/ECO-efficient-video-understanding

In this paper, we introduce a network architecture that takes long-term content into account and enables fast per-video processing at the same time.

Ranked #28 on Action Recognition on Something-Something V1 (using extra training data)

ACTION CLASSIFICATION ACTION CLASSIFICATION ACTION RECOGNITION VIDEO CAPTIONING VIDEO RETRIEVAL VIDEO UNDERSTANDING

Person Search in Videos with One Portrait Through Visual and Temporal Links

ECCV 2018 hqqasw/person-search-PPCC

In real-world applications, e. g. law enforcement and video retrieval, one often needs to search a certain person in long videos with just one portrait.

PERSON RE-IDENTIFICATION PERSON SEARCH VIDEO RETRIEVAL

The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)

3 Aug 2020albanie/collaborative-experts

This report summarizes the results of the first edition of the challenge together with the findings of the participants.

VIDEO RETRIEVAL VIDEO UNDERSTANDING

Use What You Have: Video Retrieval Using Representations From Collaborative Experts

31 Jul 2019albanie/collaborative-experts

The rapid growth of video on the internet has made searching for video content using natural language queries a significant challenge.

VIDEO RETRIEVAL

Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling

11 Feb 2021jayleicn/ClipBERT

Experiments on text-to-video retrieval and video question answering on six datasets demonstrate that ClipBERT outperforms (or is on par with) existing methods that exploit full-length videos, suggesting that end-to-end learning with just a few sparsely sampled clips is often more accurate than using densely extracted offline features from full-length videos, proving the proverbial less-is-more principle.

QUESTION ANSWERING VIDEO QUESTION ANSWERING VIDEO RETRIEVAL

Dual Encoding for Zero-Example Video Retrieval

CVPR 2019 danieljf24/dual_encoding

This paper attacks the challenging problem of zero-example video retrieval.

AD-HOC VIDEO SEARCH VIDEO RETRIEVAL