Mixed Reality Communication for Medical Procedures: Teaching the Placement of a Central Venous Catheter

no code implementations • 14 Dec 2023 • Manuel Rebol, Krzysztof Pietroszek, Claudia Ranniger, Colton Hood, Adam Rutenberg, Neal Sikka, David Li, Christian Gütl

RGBD cameras capture a volumetric view of the local scene including the patient, the operator, and the medical equipment.

Medical Procedure Mixed Reality

Real-time Gesture Animation Generation from Speech for Virtual Human Interaction

1 code implementation • 5 Aug 2022 • Manuel Rebol, Christian Gütl, Krzysztof Pietroszek

We propose a real-time system for synthesizing gestures directly from speech.

Passing a Non-verbal Turing Test: Evaluating Gesture Animations Generated from Speech

1 code implementation • 1 Jul 2021 • Manuel Rebol, Christian Gütl, Krzysztof Pietroszek

Our approach is based on the application of Generative Adversarial Neural Networks (GANs) to model the correlation rather than causation between speech and gestures.

Frame-To-Frame Consistent Semantic Segmentation

1 code implementation • 3 Aug 2020 • Manuel Rebol, Patrick Knöbelreiter

In this work, we aim for temporally consistent semantic segmentation throughout frames in a video.

Segmentation Semantic Segmentation