Near-realtime Facial Animation by Deep 3D Simulation Super-Resolution

no code implementations • 5 May 2023 • Hyojoon Park, Sangeetha Grama Srinivasan, Matthew Cong, Doyub Kim, Byungsoo Kim, Jonathan Swartz, Ken Museth, Eftychios Sifakis

We present a neural network-based simulation super-resolution framework that can efficiently and realistically enhance a facial performance produced by a low-cost, realtime physics-based simulation to a level of detail that closely approximates that of a reference-quality off-line simulator with much higher resolution (26x element count in our examples) and accurate physical modeling.

Semantic correspondence Super-Resolution

NeuralVDB: High-resolution Sparse Volume Representation using Hierarchical Neural Networks

no code implementations • 8 Aug 2022 • Doyub Kim, Minjae Lee, Ken Museth

We introduce NeuralVDB, which improves on an existing industry standard for efficient storage of sparse volumetric data, denoted VDB [Museth 2013], by leveraging recent advancements in machine learning.

Vocal Bursts Intensity Prediction