Gaze Estimation
74 papers with code • 9 benchmarks • 16 datasets
Gaze Estimation is a task to predict where a person is looking at given the person’s full face. The task contains two directions: 3-D gaze vector and 2-D gaze position estimation. 3-D gaze vector estimation is to predict the gaze vector, which is usually used in the automotive safety. 2-D gaze position estimation is to predict the horizontal and vertical coordinates on a 2-D screen, which allows utilizing gaze point to control a cursor for human-machine interaction.
Source: A Generalized and Robust Method Towards Practical Gaze Estimation on Smart Phone
Benchmarks
These leaderboards are used to track progress in Gaze Estimation
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
AVA
MPIIGaze
Gaze360
GazeCapture
EYEDIAP
ETH-XGaze
OpenEDS
Most implemented papers
Learning to Zoom: a Saliency-Based Sampling Layer for Neural Networks
recasens/Saliency-Sampler
•
•
ECCV 2018
We introduce a saliency-based distortion layer for convolutional neural networks that helps to improve the spatial sampling of input data for a given task.
Hybrid coarse-fine classification for head pose estimation
haofanwang/accurate-head-pose
•
•
In this paper, to do the estimation without facial landmarks, we combine the coarse and fine regression output together for a deep network.
Photo-Realistic Monocular Gaze Redirection Using Generative Adversarial Networks
HzDmS/gaze_redirection
•
•
ICCV 2019
In this work, we present a novel method to alleviate this problem by leveraging generative adversarial training to synthesize an eye image conditioned on a target gaze direction.
Unsupervised Learning of Eye Gaze Representation from the Web
Automatic eye gaze estimation has interested researchers for a while now.
Few-Shot Adaptive Gaze Estimation
NVlabs/few_shot_gaze
•
•
ICCV 2019
Inter-personal anatomical differences limit the accuracy of person-independent gaze estimation networks.
Mixed Effects Neural Networks (MeNets) With Applications to Gaze Estimation
nature of this data suggests better estimation may be possible if the model explicitly made use of such "repeated measurements" from each user as is commonly done in classical statistical analysis using so-called mixed effects models.
Gaze360: Physically Unconstrained Gaze Estimation in the Wild
erkil1452/gaze360
•
•
ICCV 2019
Finally, we demonstrate an application of our model for estimating customer attention in a supermarket setting.
RT-BENE: A Dataset and Baselines for Real-Time Blink Estimation in Natural Environments
Tobias-Fischer/rt_gene
•
•
IEEE International Conference on Computer Vision Workshops 2019
We further incorporate our proposed RT-BENE baselines in the recently presented RT-GENE gaze estimation framework where it provides a real-time inference of the openness of the eyes.
Gaze Preserving CycleGANs for Eyeglass Removal & Persistent Gaze Estimation
GPCycleGAN is based on the well-known CycleGAN approach - with the addition of a gaze classifier and a gaze consistency loss for additional supervision.
ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation
xucong-zhang/ETH-XGaze
•
•
ECCV 2020
We show that our dataset can significantly improve the robustness of gaze estimation methods across different head poses and gaze angles.
