no code implementations • 12 Feb 2024 • Jaeseong Lee, Junha Hyung, SOHYUN JEONG, Jaegul Choo
The majority of previous face swapping approaches have relied on the seesaw game training scheme, which often leads to the instability of the model training and results in undesired samples with blended identities due to the target identity leakage problem.
no code implementations • 13 Sep 2023 • Junha Hyung, Jaeyo Shin, Jaegul Choo
The main challenge with this task is the absence of ground truth for the composed concepts, leading to a reduction in the quality of the final output and an identity shift of the source subject.
no code implementations • 7 Sep 2023 • Sungwon Hwang, Junha Hyung, Jaegul Choo
Our main strategy is to construct the 3D avatar in Neural Radiance Fields (NeRF) optimized with a set of controlled viewpoint-aware images that we generate from ControlNet, whose condition input is the depth map extracted from the input video.
no code implementations • ICCV 2023 • Sungwon Hwang, Junha Hyung, Daejin Kim, Min-Jung Kim, Jaegul Choo
To do so, we first train a scene manipulator, a latent code-conditional deformable NeRF, over a dynamic scene to control a face deformation using the latent code.
no code implementations • 18 Jul 2023 • Gyumin Shim, Jaeseong Lee, Junha Hyung, Jaegul Choo
In this paper, we propose PixelHuman, a novel human rendering model that generates animatable human scenes from a few images of a person with unseen identity, views, and poses.
no code implementations • CVPR 2023 • Junha Hyung, Sungwon Hwang, Daejin Kim, Hyunji Lee, Jaegul Choo
Specifically, we present three add-on modules of LENeRF, the Latent Residual Mapper, the Attention Field Network, and the Deformation Network, which are jointly used for local manipulations of 3D features by estimating a 3D attention field.