Search Results for author:
Found 4 papers, 2 papers with code
Learning text-to-video retrieval from image captioning
In this paper, we make use of this progress and instantiate the image experts from two types of models: a text-to-image retrieval model to provide an initial backbone, and image captioning models to provide supervision signal into unlabeled videos.
CoVR: Learning Composed Video Retrieval from Web Video Captions
Most CoIR approaches require manually annotated datasets, comprising image-text-image triplets, where the text describes a modification from the query image to the target image.
Ranked #1 on
Composed Video Retrieval (CoVR)
on WebVid-CoVR
Can Everybody Sign Now? Exploring Sign Language Video Generation from 2D Poses
Recent work have addressed the generation of human poses represented by 2D/3D coordinates of human joints for sign language.
How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language
Towards this end, we introduce How2Sign, a multimodal and multiview continuous American Sign Language (ASL) dataset, consisting of a parallel corpus of more than 80 hours of sign language videos and a set of corresponding modalities including speech, English transcripts, and depth.
