Search Results for author:
Found 6 papers, 0 papers with code
Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labels
This paper focuses on open-ended video question answering, which aims to find the correct answers from a large answer set in response to a video-related question.
Siamese Learning with Joint Alignment and Regression for Weakly-Supervised Video Paragraph Grounding
Different from previous weakly-supervised grounding frameworks based on multiple instance learning or reconstruction learning for two-stage candidate ranking, we propose a novel siamese learning framework that jointly learns the cross-modal feature alignment and temporal coordinate regression without timestamp labels to achieve concise one-stage localization for WSVPG.
Collaborative Static and Dynamic Vision-Language Streams for Spatio-Temporal Video Grounding
The static stream performs cross-modal understanding in a single frame and learns to attend to the target object spatially according to intra-frame visual cues like object appearances.
Hierarchical Semantic Correspondence Networks for Video Paragraph Grounding
Specifically, we develop a hierarchical encoder that encodes the multi-modal inputs into semantics-aligned representations at different levels.
STVGFormer: Spatio-Temporal Video Grounding with Static-Dynamic Cross-Modal Understanding
The static branch performs cross-modal understanding in a single frame and learns to localize the target object spatially according to intra-frame visual cues like object appearances.
Ranked #2 on
Spatio-Temporal Video Grounding
on HC-STVG2
Augmented 2D-TAN: A Two-stage Approach for Human-centric Spatio-Temporal Video Grounding
We propose an effective two-stage approach to tackle the problem of language-based Human-centric Spatio-Temporal Video Grounding (HC-STVG) task.
