1 code implementation • 20 Apr 2024 • Zihao Yue, Yepeng Zhang, Ziheng Wang, Qin Jin
Automatic movie narration targets at creating video-aligned plot descriptions to assist visually impaired audiences.
1 code implementation • 22 Feb 2024 • Zihao Yue, Liang Zhang, Qin Jin
In this paper, we explore a new angle of this issue: overly detailed training data hinders the model's ability to timely terminate generation, leading to continued outputs beyond visual perception limits.
1 code implementation • 20 May 2023 • Zihao Yue, Qi Zhang, Anwen Hu, Liang Zhang, Ziheng Wang, Qin Jin
Closer to real scenarios, the Movie Clip Narrating (MCN) task in our benchmark asks models to generate role-aware narration paragraphs for complete movie clips where no actors are speaking.