Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks

11 Apr 2016  ·  Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li, Yu Qiao ·

Face detection and alignment in unconstrained environment are challenging due to various poses, illuminations and occlusions. Recent studies show that deep learning approaches can achieve impressive performance on these two tasks. In this paper, we propose a deep cascaded multi-task framework which exploits the inherent correlation between them to boost up their performance. In particular, our framework adopts a cascaded structure with three stages of carefully designed deep convolutional networks that predict face and landmark location in a coarse-to-fine manner. In addition, in the learning process, we propose a new online hard sample mining strategy that can improve the performance automatically without manual sample selection. Our method achieves superior accuracy over the state-of-the-art techniques on the challenging FDDB and WIDER FACE benchmark for face detection, and AFLW benchmark for face alignment, while keeps real time performance.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Face Detection WIDER Face (Easy) Multitask Cascade CNN AP 0.851 # 27
Face Detection WIDER Face (Hard) Multitask Cascade CNN AP 0.607 # 35
Face Detection WIDER Face (Medium) Multitask Cascade CNN AP 0.820 # 32

Methods


No methods listed for this paper. Add relevant methods here