Search Results for author: Tianwei Shen

Found 20 papers, 11 papers with code

Nerfels: Renderable Neural Codes for Improved Camera Pose Estimation

no code implementations4 Jun 2022 Gil Avraham, Julian Straub, Tianwei Shen, Tsun-Yi Yang, Hugo Germain, Chris Sweeney, Vasileios Balntas, David Novotny, Daniel DeTone, Richard Newcombe

This paper presents a framework that combines traditional keypoint-based camera pose optimization with an invertible neural rendering mechanism.

Neural Rendering Pose Estimation

NinjaDesc: Content-Concealing Visual Descriptors via Adversarial Learning

no code implementations CVPR 2022 Tony Ng, Hyo Jin Kim, Vincent Lee, Daniel DeTone, Tsun-Yi Yang, Tianwei Shen, Eddy Ilg, Vassileios Balntas, Krystian Mikolajczyk, Chris Sweeney

We let a feature encoding network and image reconstruction network compete with each other, such that the feature encoder tries to impede the image reconstruction with its generated descriptors, while the reconstructor tries to recover the input image from the descriptors.

Camera Localization Image Reconstruction

Domain Adaptation of Learned Features for Visual Localization

no code implementations21 Aug 2020 Sungyong Baik, Hyo Jin Kim, Tianwei Shen, Eddy Ilg, Kyoung Mu Lee, Chris Sweeney

We tackle the problem of visual localization under changing conditions, such as time of day, weather, and seasons.

Domain Adaptation Visual Localization

Learning Stereo Matchability in Disparity Regression Networks

1 code implementation11 Aug 2020 Jingyang Zhang, Yao Yao, Zixin Luo, Shiwei Li, Tianwei Shen, Tian Fang, Long Quan

Finally, a matchability-aware disparity refinement is introduced to improve the depth inference in weakly matchable regions.

regression Stereo Disparity Estimation +1

Stochastic Bundle Adjustment for Efficient and Scalable 3D Reconstruction

1 code implementation ECCV 2020 Lei Zhou, Zixin Luo, Mingmin Zhen, Tianwei Shen, Shiwei Li, Zhuofei Huang, Tian Fang, Long Quan

In this work, we propose a stochastic bundle adjustment algorithm which seeks to decompose the RCS approximately inside the LM iterations to improve the efficiency and scalability.

3D Reconstruction Clustering

Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistency

1 code implementation ECCV 2020 Jiaxiang Shang, Tianwei Shen, Shiwei Li, Lei Zhou, Mingmin Zhen, Tian Fang, Long Quan

Recent learning-based approaches, in which models are trained by single-view images have shown promising results for monocular 3D face reconstruction, but they suffer from the ill-posed face pose and depth ambiguity issue.

3D Face Reconstruction Depth Estimation +2

KFNet: Learning Temporal Camera Relocalization using Kalman Filtering

1 code implementation CVPR 2020 Lei Zhou, Zixin Luo, Tianwei Shen, Jiahui Zhang, Mingmin Zhen, Yao Yao, Tian Fang, Long Quan

Temporal camera relocalization estimates the pose with respect to each video frame in sequence, as opposed to one-shot relocalization which focuses on a still image.

Camera Relocalization

Self-Supervised Learning of Depth and Motion Under Photometric Inconsistency

1 code implementation19 Sep 2019 Tianwei Shen, Lei Zhou, Zixin Luo, Yao Yao, Shiwei Li, Jiahui Zhang, Tian Fang, Long Quan

The self-supervised learning of depth and pose from monocular sequences provides an attractive solution by using the photometric consistency of nearby frames as it depends much less on the ground-truth data.

Pose Estimation Self-Supervised Learning

Learning Two-View Correspondences and Geometry Using Order-Aware Network

1 code implementation ICCV 2019 Jiahui Zhang, Dawei Sun, Zixin Luo, Anbang Yao, Lei Zhou, Tianwei Shen, Yurong Chen, Long Quan, Hongen Liao

First, to capture the local context of sparse correspondences, the network clusters unordered input correspondences by learning a soft assignment matrix.

Vocal Bursts Valence Prediction

ContextDesc: Local Descriptor Augmentation with Cross-Modality Context

1 code implementation CVPR 2019 Zixin Luo, Tianwei Shen, Lei Zhou, Jiahui Zhang, Yao Yao, Shiwei Li, Tian Fang, Long Quan

Most existing studies on learning local features focus on the patch-based descriptions of individual keypoints, whereas neglecting the spatial relations established from their keypoint locations.

Geometric Matching

Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inference

1 code implementation CVPR 2019 Yao Yao, Zixin Luo, Shiwei Li, Tianwei Shen, Tian Fang, Long Quan

However, one major limitation of current learned MVS approaches is the scalability: the memory-consuming cost volume regularization makes the learned MVS hard to be applied to high-resolution scenes.

Vocal Bursts Intensity Prediction

Beyond Photometric Loss for Self-Supervised Ego-Motion Estimation

1 code implementation25 Feb 2019 Tianwei Shen, Zixin Luo, Lei Zhou, Hanyu Deng, Runze Zhang, Tian Fang, Long Quan

Accurate relative pose is one of the key components in visual odometry (VO) and simultaneous localization and mapping (SLAM).

Motion Estimation Self-Supervised Learning +2

Matchable Image Retrieval by Learning from Surface Reconstruction

1 code implementation26 Nov 2018 Tianwei Shen, Zixin Luo, Lei Zhou, Runze Zhang, Siyu Zhu, Tian Fang, Long Quan

Convolutional Neural Networks (CNNs) have achieved superior performance on object image retrieval, while Bag-of-Words (BoW) models with handcrafted local features still dominate the retrieval of overlapping images in 3D reconstruction.

3D Reconstruction Image Retrieval +2

GeoDesc: Learning Local Descriptors by Integrating Geometry Constraints

1 code implementation ECCV 2018 Zixin Luo, Tianwei Shen, Lei Zhou, Siyu Zhu, Runze Zhang, Yao Yao, Tian Fang, Long Quan

Learned local descriptors based on Convolutional Neural Networks (CNNs) have achieved significant improvements on patch-based benchmarks, whereas not having demonstrated strong generalization ability on recent benchmarks of image-based 3D reconstruction.

3D Reconstruction

Learning and Matching Multi-View Descriptors for Registration of Point Clouds

no code implementations ECCV 2018 Lei Zhou, Siyu Zhu, Zixin Luo, Tianwei Shen, Runze Zhang, Mingmin Zhen, Tian Fang, Long Quan

Critical to the registration of point clouds is the establishment of a set of accurate correspondences between points in 3D space.

Very Large-Scale Global SfM by Distributed Motion Averaging

no code implementations CVPR 2018 Siyu Zhu, Runze Zhang, Lei Zhou, Tianwei Shen, Tian Fang, Ping Tan, Long Quan

This work proposes a divide-and-conquer framework to solve very large global SfM at the scale of millions of images.

Progressive Large Scale-Invariant Image Matching in Scale Space

no code implementations ICCV 2017 Lei Zhou, Siyu Zhu, Tianwei Shen, Jinglu Wang, Tian Fang, Long Quan

In this paper, we propose a scale-invariant image matching approach to tackling the very large scale variation of views.

Image Retrieval Retrieval

Parallel Structure from Motion from Local Increment to Global Averaging

no code implementations28 Feb 2017 Siyu Zhu, Tianwei Shen, Lei Zhou, Runze Zhang, Jinglu Wang, Tian Fang, Long Quan

In this paper, we tackle the accurate and consistent Structure from Motion (SfM) problem, in particular camera registration, far exceeding the memory of a single computer in parallel.

Clustering

Cannot find the paper you are looking for? You can Submit a new open access paper.