Search Results for author:
Found 7 papers, 5 papers with code
Video ReCap: Recursive Captioning of Hour-Long Videos
We utilize a curriculum learning training scheme to learn the hierarchical structure of videos, starting from clip-level captions describing atomic actions, then focusing on segment-level descriptions, and concluding with generating summaries for hour-long videos.
A Simple LLM Framework for Long-Range Video Question-Answering
Furthermore, we show that a specialized prompt that asks the LLM first to summarize the noisy short-term visual captions and then answer a given input question leads to a significant LVQA performance boost.
Ranked #1 on
Zero-Shot Video Question Answer
on NExT-GQA
RGNet: A Unified Clip Retrieval and Grounding Network for Long Videos
Adapting existing short video (5-30 seconds) grounding methods to this problem yields poor performance.
Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives
We present Ego-Exo4D, a diverse, large-scale multimodal multiview video dataset and benchmark challenge.
Efficient Movie Scene Detection using State-Space Transformers
Given a sequence of frames divided into movie shots (uninterrupted periods where the camera position does not change), the S4A block first applies self-attention to capture short-range intra-shot dependencies.
Object State Change Classification in Egocentric Videos using the Divided Space-Time Attention Mechanism
This report describes our submission called "TarHeels" for the Ego4D: Object State Change Classification Challenge.
Long Movie Clip Classification with State-Space Video Models
Most modern video recognition models are designed to operate on short video clips (e. g., 5-10s in length).
Ranked #4 on
Video Classification
on Breakfast
