Fuse & Calibrate: A bi-directional Vision-Language Guided Framework for Referring Image Segmentation

no code implementations • 18 May 2024 • Yichen Yan, Xingjian He, Sihan Chen, Shichen Lu, Jing Liu

Referring Image Segmentation (RIS) aims to segment an object described in natural language from an image, with the main challenge being a text-to-pixel correlation.

Normalized and Geometry-Aware Self-Attention Network for Image Captioning

no code implementations • CVPR 2020 • Longteng Guo, Jing Liu, Xinxin Zhu, Peng Yao, Shichen Lu, Hanqing Lu

First, we propose Normalized Self-Attention (NSA), a reparameterization of SA that brings the benefits of normalization inside SA.

Image Captioning Machine Translation +4

Vatex Video Captioning Challenge 2020: Multi-View Features and Hybrid Reward Strategies for Video Captioning

no code implementations • 17 Oct 2019 • Xinxin Zhu, Longteng Guo, Peng Yao, Shichen Lu, Wei Liu, Jing Liu

This report describes our solution for the VATEX Captioning Challenge 2020, which requires generating descriptions for the videos in both English and Chinese languages.

Video Captioning