Search Results for author:
Found 4 papers, 2 papers with code
VLRM: Vision-Language Models act as Reward Models for Image Captioning
In this work, we present an unsupervised method for enhancing an image captioning model (in our case, BLIP2) using reinforcement learning and vision-language models like CLIP and BLIP2-ITM as reward models.
MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization
In this work we present a new State-of-The-Art on the text-to-video retrieval task on MSR-VTT, LSMDC, MSVD, YouCook2 and TGIF obtained by a single model.
Ranked #1 on
Video Retrieval
on TGIF
(using extra training data)
MDMMT: Multidomain Multimodal Transformer for Video Retrieval
We present a new state-of-the-art on the text to video retrieval task on MSRVTT and LSMDC benchmarks where our model outperforms all previous solutions by a large margin.
Ranked #25 on
Video Retrieval
on LSMDC
(using extra training data)
Mutual Modality Learning for Video Action Classification
In this paper, we explore the various methods to embed the ensemble power into a single model.
Ranked #47 on
Action Recognition
on Something-Something V2
(using extra training data)
