Dynamic Gaussians Mesh: Consistent Mesh Reconstruction from Monocular Videos

no code implementations • 18 Apr 2024 • Isabella Liu, Hao Su, Xiaolong Wang

We introduce the Gaussian-Mesh Anchoring, which encourages evenly distributed Gaussians, resulting better mesh reconstruction through mesh-guided densification and pruning on the deformed Gaussians.

Robo360: A 3D Omnispective Multi-Material Robotic Manipulation Dataset

no code implementations • 9 Dec 2023 • Litian Liang, Liuyu Bian, Caiwei Xiao, Jialin Zhang, Linghao Chen, Isabella Liu, Fanbo Xiang, Zhiao Huang, Hao Su

Building robots that can automate labor-intensive tasks has long been the core motivation behind the advancements in computer vision and the robotics community.

Representation Learning

OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objects

no code implementations • NeurIPS 2023 • Isabella Liu, Linghao Chen, Ziyang Fu, Liwen Wu, Haian Jin, Zhong Li, Chin Ming Ryan Wong, Yi Xu, Ravi Ramamoorthi, Zexiang Xu, Hao Su

We introduce OpenIllumination, a real-world dataset containing over 108K images of 64 objects with diverse materials, captured under 72 camera views and a large number of different illuminations.

Foreground Segmentation Inverse Rendering

TensoIR: Tensorial Inverse Rendering

1 code implementation • CVPR 2023 • Haian Jin, Isabella Liu, Peijia Xu, Xiaoshuai Zhang, Songfang Han, Sai Bi, Xiaowei Zhou, Zexiang Xu, Hao Su

We propose TensoIR, a novel inverse rendering approach based on tensor factorization and neural fields.

Inverse Rendering Novel View Synthesis

ActiveZero: Mixed Domain Learning for Active Stereovision with Zero Annotation

no code implementations • CVPR 2022 • Isabella Liu, Edward Yang, Jianyu Tao, Rui Chen, Xiaoshuai Zhang, Qing Ran, Zhu Liu, Hao Su

First, we demonstrate the transferability of our method to out-of-distribution real data by using a mixed domain learning strategy.