no code implementations • 25 Mar 2024 • Florian Hahlbohm, Linus Franke, Moritz Kappel, Susana Castillo, Marc Stamminger, Marcus Magnor
We introduce a new approach for reconstruction and novel-view synthesis of unbounded real-world scenes.
no code implementations • 16 Mar 2024 • Vanessa Wirth, Johanna Bräunig, Danti Khouri, Florian Gutsche, Martin Vossiek, Tim Weyrich, Marc Stamminger
In contrast, we propose a novel, joint calibration approach for optical RGB-D sensors and MIMO radars that is designed to operate in the radar's near-field range, within decimeters from the sensors.
1 code implementation • 11 Jan 2024 • Linus Franke, Darius Rückert, Laura Fink, Marc Stamminger
In this paper, we present TRIPS (Trilinear Point Splatting), an approach that combines ideas from both Gaussian Splatting and ADOP.
no code implementations • 4 Jan 2024 • Lukas Meyer, Floris Erich, Yusuke Yoshiyasu, Marc Stamminger, Noriaki Ando, Yukiyasu Domae
We introduce Physically Enhanced Gaussian Splatting Simulation System (PEGASUS) for 6DOF object pose dataset generation, a versatile dataset generator based on 3D Gaussian Splatting.
1 code implementation • 28 Nov 2023 • Laura Fink, Darius Rückert, Linus Franke, Joachim Keinert, Marc Stamminger
Based on the RGB-D input stream, novel views are rendered by projecting neural features into the target view via a densely fused depth map and aggregating the features in image-space to a target feature map.
no code implementations • 26 Nov 2023 • Richard Marcus, Felix Gabel, Niklas Knoop, Marc Stamminger
Second, we test the performance of the LiDAR simulation by testing how well an object detection network generalizes between real and synthetic point clouds to enable evaluation without ground truth point clouds.
1 code implementation • 8 Nov 2023 • Linus Franke, Darius Rückert, Laura Fink, Matthias Innmann, Marc Stamminger
In our results, we show that our approach can improve the quality of a point cloud obtained by structure from motion and thus increase novel view synthesis quality significantly.
no code implementations • 13 Sep 2023 • Christian Herglotz, David Müller, Andreas Weinlich, Frank Bauer, Michael Ortner, Marc Stamminger, André Kaup
This paper shows that motion vectors representing the true motion of an object in a scene can be exploited to improve the encoding process of computer generated video sequences.
no code implementations • 28 Jul 2023 • Johanna Bräunig, Christian Schüßler, Vanessa Wirth, Marc Stamminger, Ingrid Ullmann, Martin Vossiek
With the increasing popularity of human-computer interaction applications, there is also growing interest in generating sufficiently large and diverse data sets for automatic radar-based recognition of hand poses and gestures.
no code implementations • 23 May 2023 • Christian Schüßler, Marcel Hoffmann, Vanessa Wirth, Björn Eskofier, Tim Weyrich, Marc Stamminger, Martin Vossiek
This approach allows not only almost perfect annotations possible, but also allows the annotation of exotic effects, such as multi-path effects or to label signal parts originating from different parts of an object.
1 code implementation • 10 Apr 2023 • Lukas Meyer, Andreas Gilson, Oliver Scholz, Marc Stamminger
Therefore, we present CherryPicker, an automatic pipeline that reconstructs photo-metric point clouds of trees, performs semantic segmentation and extracts their topological structure in form of a skeleton.
no code implementations • 17 Mar 2023 • Vanessa Wirth, Anna-Maria Liphardt, Birte Coppers, Johanna Bräunig, Simon Heinrich, Sigrid Leyendecker, Arnd Kleyer, Georg Schett, Martin Vossiek, Bernhard Egger, Marc Stamminger
Therefore, we propose ShaRPy, the first RGB-D Shape Reconstruction and hand Pose tracking system, which provides uncertainty estimates of the computed pose, e. g., when a finger is hidden or its estimate is inconsistent with the observations in the input, to guide clinical decision-making.
no code implementations • 5 Aug 2022 • Richard Marcus, Niklas Knoop, Bernhard Egger, Marc Stamminger
Virtual testing is a crucial task to ensure safety in autonomous driving, and sensor simulation is an important task in this domain.
2 code implementations • 13 Oct 2021 • Darius Rückert, Linus Franke, Marc Stamminger
Like other neural renderers, our system takes as input calibrated camera images and a proxy geometry of the scene, in our case a point cloud.
2 code implementations • CVPR 2016 • Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner
Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.
no code implementations • ICLR 2020 • Justus Thies, Michael Zollhöfer, Christian Theobalt, Marc Stamminger, Matthias Nießner
Based on this 3D proxy, the appearance of a captured view can be warped into a new target view as in classical image-based rendering.
1 code implementation • 9 Mar 2019 • Laura Fink, Sing Chun Lee, Jie Ying Wu, Xingtong Liu, Tianyu Song, Yordanka Stoyanova, Marc Stamminger, Nassir Navab, Mathias Unberath
With the increasing computational power of today's workstations, real-time physically-based rendering is within reach, rapidly gaining attention across a variety of domains.
no code implementations • 12 Jan 2019 • Matthias Innmann, Kihwan Kim, Jinwei Gu, Matthias Niessner, Charles Loop, Marc Stamminger, Jan Kautz
We show that creating a dense 4D structure from a few RGB images with non-rigid changes is possible, and demonstrate that our method can be used to interpolate novel deformed scenes from various combinations of these deformation estimates derived from the sparse views.
no code implementations • 26 Nov 2018 • Justus Thies, Michael Zollhöfer, Christian Theobalt, Marc Stamminger, Matthias Nießner
Based on this 3D proxy, the appearance of a captured view can be warped into a new target view as in classical image-based rendering.
no code implementations • 29 May 2018 • Justus Thies, Michael Zollhöfer, Christian Theobalt, Marc Stamminger, Matthias Nießner
We propose HeadOn, the first real-time source-to-target reenactment approach for complete human portrait videos that enables transfer of torso and head motion, face expression, and eye gaze.
no code implementations • 11 Oct 2016 • Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner
Based on reenactment of a prerecorded stereo video of the person without the HMD, FaceVR incorporates photo-realistic re-rendering in real time, thus allowing artificial modifications of face and eye appearances.
no code implementations • 27 Mar 2016 • Matthias Innmann, Michael Zollhöfer, Matthias Nießner, Christian Theobalt, Marc Stamminger
We cast finding the optimal deformation of space as a non-linear regularized variational optimization problem by enforcing local smoothness and proximity to the input constraints.