3D Face Reconstruction
76 papers with code • 7 benchmarks • 11 datasets
3D Face Reconstruction is a computer vision task that involves creating a 3D model of a human face from a 2D image or a set of images. The goal of 3D face reconstruction is to reconstruct a digital 3D representation of a person's face, which can be used for various applications such as animation, virtual reality, and biometric identification.
( Image credit: 3DDFA_V2 )
Benchmarks
These leaderboards are used to track progress in 3D Face Reconstruction
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
Libraries
Use these libraries to find 3D Face Reconstruction models and implementationsDatasets
AFLW2000-3D
FaceWarehouse
FaceScape
Florence
ExPose
NoW Benchmark
REALY
FFHQ-UV
DAD-3DHeads
FaMoS
Most implemented papers
MeInGame: Create a Game Character Face from a Single Portrait
FuxiCV/MeInGame
•
•
To tackle these problems, we propose 1) a low-cost facial texture acquisition method, 2) a shape transfer algorithm that can transform the shape of a 3DMM mesh to games, and 3) a new pipeline for training 3D game face reconstruction networks.
Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracing
abdallahdib/abdallahdib.github.io
•
•
ICCV 2021
In this paper, we build our work on the aforementioned approaches and propose a new method that greatly improves reconstruction quality and robustness in general scenes.
Riggable 3D Face Reconstruction via In-Network Optimization
zqbai-jeremy/INORig
•
•
CVPR 2021
This paper presents a method for riggable 3D face reconstruction from monocular images, which jointly estimates a personalized face rig and per-image parameters including expressions, poses, and illuminations.
Collaborative Regression of Expressive Bodies using Moderation
YadiraF/PIXIE
•
•
Second, human shape is highly correlated with gender, but existing work ignores this.
Fast-GANFIT: Generative Adversarial Network for High Fidelity 3D Face Reconstruction
In this paper, we take a radically different approach and harness the power of Generative Adversarial Networks (GANs) and DCNNs in order to reconstruct the facial texture and shape from single images.
SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction
MCG-NJU/SADRNet
•
•
Three-dimensional face dense alignment and reconstruction in the wild is a challenging problem as partial facial information is commonly missing in occluded and large pose face images.
Robust Model-based Face Reconstruction through Weakly-Supervised Outlier Segmentation
unibas-gravis/Occlusion-Robust-MoFA
•
•
CVPR 2023
The main challenge is that the model fitting and the outlier segmentation are mutually dependent on each other, and need to be inferred jointly.
HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swapping
In this work, we propose a high fidelity face swapping method, called HifiFace, which can well preserve the face shape of the source face and generate photo-realistic results.
FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction
By training on FaceScape data, a novel algorithm is proposed to predict elaborate riggable 3D face models from a single image input.
Self-supervised Re-renderable Facial Albedo Reconstruction from Single Image
To further make facial textures disentangled with illumination, we propose a novel detailed illumination representation which is reconstructed with the detailed albedo together.
