Video Frame Interpolation
95 papers with code • 20 benchmarks • 11 datasets
The goal of Video Frame Interpolation is to synthesize several frames in the middle of two adjacent frames of the original video. Video Frame Interpolation can be applied to generate slow motion video, increase video frame rate, and frame recovery in video streaming.
Benchmarks
These leaderboards are used to track progress in Video Frame Interpolation
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
Libraries
Use these libraries to find Video Frame Interpolation models and implementationsDatasets
UCF101
DAVIS
GoPro
Middlebury
Vimeo90K
X4K1000FPS
MSU Video Frame Interpolation
Inter4K
SlowFlow
ATD-12K
Subtasks
Latest papers
Motion-Aware Video Frame Interpolation
zdyshine/Video-Frame-Interpolation-Summary
•
•
Subsequently, a cross-scale motion structure is presented to estimate and refine intermediate flow maps by the extracted features.
A Multi-In-Single-Out Network for Video Frame Interpolation without Optical Flow
J911/MISO-VFI
•
•
In general, deep learning-based video frame interpolation (VFI) methods have predominantly focused on estimating motion vectors between two input frames and warping them to the target time.
Clearer Frames, Anytime: Resolving Velocity Ambiguity in Video Frame Interpolation
zzh-tech/interpany-clearer
•
•
Existing video frame interpolation (VFI) methods blindly predict where each object is at a specific timestep t ("time indexing"), which struggles to predict precise object movements.
Scale-Adaptive Feature Aggregation for Efficient Space-Time Video Super-Resolution
megvii-research/wacv2024-safa
•
•
The Space-Time Video Super-Resolution (STVSR) task aims to enhance the visual quality of videos, by simultaneously performing video frame interpolation (VFI) and video super-resolution (VSR).
LOVECon: Text-driven Training-Free Long Video Editing with ControlNet
Leveraging pre-trained conditional diffusion models for video editing without further tuning has gained increasing attention due to its promise in film production, advertising, etc.
IBVC: Interpolation-driven B-frame Video Compression
ruhig6/ibvc
•
•
Learned B-frame video compression aims to adopt bi-directional motion estimation and motion compensation (MEMC) coding for middle frame reconstruction.
Dynamic Frame Interpolation in Wavelet Domain
Video frame interpolation is an important low-level vision task, which can increase frame rate for more fluent visual experience.
Boost Video Frame Interpolation via Motion Adaptation
Video frame interpolation (VFI) is a challenging task that aims to generate intermediate frames between two consecutive frames in a video.
Neural Image Re-Exposure
zhangxydlut/Neural-Image-Re-Exposure
•
•
In this work, we aim to re-expose the captured photo in post-processing to provide a more flexible way of addressing those issues within a unified framework.
IDO-VFI: Identifying Dynamics via Optical Flow Guidance for Video Frame Interpolation with Events
shicy17/ido-vfi
•
•
The proposed method first estimates the optical flow based on frames and events, and then decides whether to further calculate the residual optical flow in those sub-regions via a Gumbel gating module according to the optical flow amplitude.
