Teaching Arm and Head Gestures to a Humanoid Robot through Interactive Demonstration and Spoken Instruction

no code implementations • ACL (mmsr, IWCS) 2021 • Michael Brady, Han Du

We describe work in progress for training a humanoid robot to produce iconic arm and head gestures as part of task-oriented dialogue interaction.

Gesture Recognition

Digital Life Project: Autonomous 3D Characters with Social Intelligence

no code implementations • 7 Dec 2023 • Zhongang Cai, Jianping Jiang, Zhongfei Qing, Xinying Guo, Mingyuan Zhang, Zhengyu Lin, Haiyi Mei, Chen Wei, Ruisi Wang, Wanqi Yin, Xiangyu Fan, Han Du, Liang Pan, Peng Gao, Zhitao Yang, Yang Gao, Jiaqi Li, Tianxiang Ren, Yukun Wei, Xiaogang Wang, Chen Change Loy, Lei Yang, Ziwei Liu

In this work, we present Digital Life Project, a framework utilizing language as the universal medium to build autonomous 3D characters, who are capable of engaging in social interactions and expressing with articulated body motions, thereby simulating life in a digital environment.

Motion Captioning Motion Synthesis

Fine-Grained Semantic Segmentation of Motion Capture Data using Dilated Temporal Fully-Convolutional Networks

no code implementations • 2 Mar 2019 • Noshaba Cheema, Somayeh Hosseini, Janis Sprenger, Erik Herrmann, Han Du, Klaus Fischer, Philipp Slusallek

Human motion capture data has been widely used in data-driven character animation.

Action Segmentation Image Segmentation +4

Dilated Temporal Fully-Convolutional Network for Semantic Segmentation of Motion Capture Data

no code implementations • 24 Jun 2018 • Noshaba Cheema, Somayeh Hosseini, Janis Sprenger, Erik Herrmann, Han Du, Klaus Fischer, Philipp Slusallek

Semantic segmentation of motion capture sequences plays a key part in many data-driven motion synthesis frameworks.

Action Segmentation Motion Synthesis +2