2 code implementations • 9 Mar 2024 • Hao Lu, Xuesong Niu, Jiyao Wang, Yin Wang, Qingyong Hu, Jiaqi Tang, Yuting Zhang, Kaishen Yuan, Bin Huang, Zitong Yu, Dengbo He, Shuiguang Deng, Hao Chen, Yingcong Chen, Shiguang Shan
In conclusion, this paper provides valuable insights into the potential applications and challenges of MLLMs in human-centric computing.
no code implementations • 17 Jan 2024 • Baoxiong Jia, Yixin Chen, Huangyue Yu, Yan Wang, Xuesong Niu, Tengyu Liu, Qing Li, Siyuan Huang
In comparison to recent advancements in the 2D domain, grounding language in 3D scenes faces several significant challenges: (i) the inherent complexity of 3D scenes due to the diverse object configurations, their rich attributes, and intricate relationships; (ii) the scarcity of paired 3D vision-language data to support grounded learning; and (iii) the absence of a unified learning framework to distill knowledge from grounded 3D data.
2 code implementations • 15 Aug 2023 • Xin Liu, Kaishen Yuan, Xuesong Niu, Jingang Shi, Zitong Yu, Huanjing Yue, Jingyu Yang
Anatomically, there are innumerable correlations between AUs, which contain rich information and are vital for AU detection.
Ranked #2 on Facial Action Unit Detection on DISFA
1 code implementation • CVPR 2023 • Hao Lu, Zitong Yu, Xuesong Niu, Yingcong Chen
We show that most domain generalization methods do not work well in this problem, as domain labels are ambiguous in complicated environmental changes.
1 code implementation • ECCV 2020 • Xuesong Niu, Zitong Yu, Hu Han, Xiaobai Li, Shiguang Shan, Guoying Zhao
Remote physiological measurements, e. g., remote photoplethysmography (rPPG) based heart rate (HR), heart rate variability (HRV) and respiration frequency (RF) measuring, are playing more and more important roles under the application scenarios where contact measurement is inconvenient or impossible.
no code implementations • ECCV 2020 • Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, Guoying Zhao
In this paper we rephrase face anti-spoofing as a material recognition problem and combine it with classical human material perception [1], intending to extract discriminative and robust features for FAS.
no code implementations • 26 Apr 2020 • Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, Guoying Zhao
Remote photoplethysmography (rPPG), which aims at measuring heart activities without any contact, has great potential in many applications (e. g., remote healthcare).
no code implementations • 26 Mar 2020 • Xiaobai Li, Hu Han, Hao Lu, Xuesong Niu, Zitong Yu, Antitza Dantcheva, Guoying Zhao, Shiguang Shan
Remote measurement of physiological signals from videos is an emerging topic.
no code implementations • 25 Oct 2019 • Xuesong Niu, Shiguang Shan, Hu Han, Xilin Chen
Recently, some methods have been proposed for remote HR estimation from face videos; however, most of them focus on well-controlled scenarios, their generalization ability into less-constrained scenarios (e. g., with head movement, and bad illumination) are not known.
1 code implementation • NeurIPS 2019 • Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen
In this work, we propose a semi-supervised approach for AU recognition utilizing a large number of web face images without AU labels and a relatively small face dataset with AU annotations inspired by the co-training methods.
no code implementations • CVPR 2019 • Xuesong Niu, Hu Han, Songfan Yang, Yan Huang, Shiguang Shan
Encoding individual facial expressions via action units (AUs) coded by the Facial Action Coding System (FACS) has been found to be an effective approach in resolving the ambiguity issue among different expressions.
1 code implementation • 11 Oct 2018 • Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen
We also learn a deep HR estimator (named as RhythmNet) with the proposed spatial-temporal representation, which achieves promising results on both the public-domain and our VIPL-HR HR estimation databases.