Search Results for author: Xucong Zhang

Found 22 papers, 13 papers with code

GazeHTA: End-to-end Gaze Target Detection with Head-Target Association

no code implementations16 Apr 2024 Zhi-Yi Lin, Jouh Yeong Chew, Jan van Gemert, Xucong Zhang

We propose an end-to-end approach for gaze target detection: predicting a head-target connection between individuals and the target image regions they are looking at.

3D Kinematics Estimation from Video with a Biomechanical Model and Synthetic Training Data

no code implementations20 Feb 2024 Zhi-Yi Lin, Bofan Lyu, Judith Cueto Fernandez, Eline van der Kruk, Ajay Seth, Xucong Zhang

Accurate 3D kinematics estimation of human body is crucial in various applications for human health and mobility, such as rehabilitation, injury prevention, and diagnosis, as it helps to understand the biomechanical loading experienced during movement.

Keypoint Detection Markerless Motion Capture

Unsupervised Gaze-aware Contrastive Learning with Subject-specific Condition

no code implementations8 Sep 2023 Lingyu Du, Xucong Zhang, Guohao Lan

Appearance-based gaze estimation has shown great promise in many applications by using a single general-purpose camera as the input device.

Contrastive Learning Data Augmentation +2

Investigation of Architectures and Receptive Fields for Appearance-based Gaze Estimation

1 code implementation18 Aug 2023 Yunhan Wang, Xiangwei Shi, Shalini De Mello, Hyung Jin Chang, Xucong Zhang

With the rapid development of deep learning technology in the past decade, appearance-based gaze estimation has attracted great attention from both computer vision and human-computer interaction research communities.

Contrastive Learning Disentanglement +2

Domain-Adaptive Full-Face Gaze Estimation via Novel-View-Synthesis and Feature Disentanglement

no code implementations25 May 2023 Jiawei Qin, Takuru Shimoyama, Xucong Zhang, Yusuke Sugano

To bridge the inevitable gap between synthetic and real images, we further propose an unsupervised domain adaptation method suitable for synthetic full-face data.

3D Reconstruction Disentanglement +3

EFE: End-to-end Frame-to-Gaze Estimation

no code implementations9 May 2023 Haldun Balim, Seonwook Park, Xi Wang, Xucong Zhang, Otmar Hilliges

In this paper, we propose a frame-to-gaze network that directly predicts both 3D gaze origin and 3D gaze direction from the raw frame out of the camera without any face or eye cropping.

Gaze Estimation

Towards Single Camera Human 3D-Kinematics

1 code implementation13 Jan 2023 Marian Bittner, Wei-Tse Yang, Xucong Zhang, Ajay Seth, Jan van Gemert, Frans C. T. van der Helm

Markerless estimation of 3D Kinematics has the great potential to clinically diagnose and monitor movement disorders without referrals to expensive motion capture labs; however, current approaches are limited by performing multiple de-coupled steps to estimate the kinematics of a person from videos.

Markerless Motion Capture

PeCLR: Self-Supervised 3D Hand Pose Estimation from monocular RGB via Equivariant Contrastive Learning

1 code implementation ICCV 2021 Adrian Spurr, Aneesh Dahiya, Xi Wang, Xucong Zhang, Otmar Hilliges

Encouraged by the success of contrastive learning on image classification tasks, we propose a new self-supervised method for the structured regression task of 3D hand pose estimation.

3D Hand Pose Estimation Contrastive Learning +3

Self-Learning Transformations for Improving Gaze and Head Redirection

2 code implementations NeurIPS 2020 Yufeng Zheng, Seonwook Park, Xucong Zhang, Shalini De Mello, Otmar Hilliges

Furthermore, we show that in the presence of limited amounts of real-world training data, our method allows for improvements in the downstream task of semi-supervised cross-dataset gaze estimation.

Disentanglement Gaze Estimation +1

ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation

1 code implementation ECCV 2020 Xucong Zhang, Seonwook Park, Thabo Beeler, Derek Bradley, Siyu Tang, Otmar Hilliges

We show that our dataset can significantly improve the robustness of gaze estimation methods across different head poses and gaze angles.

 Ranked #1 on Gaze Estimation on ETH-XGaze (using extra training data)

Gaze Estimation

Towards End-to-end Video-based Eye-Tracking

1 code implementation ECCV 2020 Seonwook Park, Emre Aksan, Xucong Zhang, Otmar Hilliges

Estimating eye-gaze from images alone is a challenging task, in large parts due to un-observable person-specific factors.

Content-Consistent Generation of Realistic Eyes with Style

1 code implementation8 Nov 2019 Marcel Bühler, Seonwook Park, Shalini De Mello, Xucong Zhang, Otmar Hilliges

Accurately labeled real-world training data can be scarce, and hence recent works adapt, modify or generate images to boost target datasets.

Semantic Segmentation

Photo-Realistic Monocular Gaze Redirection Using Generative Adversarial Networks

1 code implementation ICCV 2019 Zhe He, Adrian Spurr, Xucong Zhang, Otmar Hilliges

In this work, we present a novel method to alleviate this problem by leveraging generative adversarial training to synthesize an eye image conditioned on a target gaze direction.

Gaze Estimation gaze redirection

Appearance-Based Gaze Estimation via Evaluation-Guided Asymmetric Regression

no code implementations ECCV 2018 Yihua Cheng, Feng Lu, Xucong Zhang

Inspired by this, we design the multi-stream ARE-Net; one asymmetric regression network (AR-Net) predicts 3D gaze directions for both eyes with a novel asymmetric strategy, and the evaluation network (E-Net) adaptively adjusts the strategy by evaluating the two eyes in terms of their performance during optimization.

Gaze Estimation regression

Learning to Find Eye Region Landmarks for Remote Gaze Estimation in Unconstrained Settings

2 code implementations12 May 2018 Seonwook Park, Xucong Zhang, Andreas Bulling, Otmar Hilliges

Conventional feature-based and model-based gaze estimation methods have proven to perform well in settings with controlled illumination and specialized cameras.

Gaze Estimation

MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation

6 code implementations24 Nov 2017 Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling

Second, we present an extensive evaluation of state-of-the-art gaze estimation methods on three current datasets, including MPIIGaze.

Gaze Estimation

Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environments

no code implementations18 Nov 2015 Marc Tonsen, Xucong Zhang, Yusuke Sugano, Andreas Bulling

We further study the influence of image resolution, vision aids, as well as recording location (indoor, outdoor) on pupil detection performance.

Pupil Detection

Appearance-Based Gaze Estimation in the Wild

6 code implementations CVPR 2015 Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling

Appearance-based gaze estimation is believed to work well in real-world settings, but existing datasets have been collected under controlled laboratory conditions and methods have been not evaluated across multiple datasets.

Gaze Estimation

Robust Multi-resolution Pedestrian Detection in Traffic Scenes

no code implementations CVPR 2013 Junjie Yan, Xucong Zhang, Zhen Lei, Shengcai Liao, Stan Z. Li

The model contains resolution aware transformations to map pedestrians in different resolutions to a common space, where a shared detector is constructed to distinguish pedestrians from background.

Pedestrian Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.