Search Results for author:
Found 6 papers, 2 papers with code
Emergence of Abstract State Representations in Embodied Sequence Modeling
Decision making via sequence modeling aims to mimic the success of language models, where actions taken by an embodied agent are modeled as tokens to predict.
MaXM: Towards Multilingual Visual Question Answering
In this paper, we propose scalable solutions to multilingual visual question answering (mVQA), on both data and modeling fronts.
Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset
Research in massively multilingual image captioning has been severely hampered by a lack of high-quality evaluation datasets.
End-to-end Dense Video Captioning as Sequence Generation
Dense video captioning aims to identify the events of interest in an input video, and generate descriptive captions for each event.
Ranked #3 on
Dense Video Captioning
on ViTT
(CIDEr metric, using extra
training data)
Cross-modal Language Generation using Pivot Stabilization for Web-scale Language Coverage
Cross-modal language generation tasks such as image captioning are directly hurt in their ability to support non-English languages by the trend of data-hungry models combined with the lack of non-English annotations.
Quality Estimation for Image Captions Based on Large-scale Human Evaluations
Automatic image captioning has improved significantly over the last few years, but the problem is far from being solved, with state of the art models still often producing low quality captions when used in the wild.
