3FabRec: Fast Few-Shot Face Alignment by Reconstruction

Bjorn Browatzki, Christian Wallraven

    Research output: Contribution to journalConference articlepeer-review

    64 Citations (Scopus)

    Abstract

    Current supervised methods for facial landmark detection require a large amount of training data and may suffer from overfitting to specific datasets due to the massive number of parameters. We introduce a semi-supervised method in which the crucial idea is to first generate implicit face knowledge from the large amounts of unlabeled images of faces available today. In a first, completely unsupervised stage, we train an adversarial autoencoder to reconstruct faces via a low-dimensional face embedding. In a second, supervised stage, we interleave the decoder with transfer layers to retask the generation of color images to the prediction of landmark heatmaps. Our framework (3FabRec) achieves state-of-the-art performance on several common benchmarks and, most importantly, is able to maintain impressive accuracy on extremely small training sets down to as few as 10 images. As the interleaved layers only add a low amount of parameters to the decoder, inference runs at several hundred FPS on a GPU.

    Original languageEnglish
    Article number9157661
    Pages (from-to)6109-6119
    Number of pages11
    JournalProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
    DOIs
    Publication statusPublished - 2020
    Event2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020 - Virtual, Online, United States
    Duration: 2020 Jun 142020 Jun 19

    Bibliographical note

    Funding Information:
    Acknowledgements This work was supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korean government (MSIT) (No. 2019-0-00079, Department of Artificial Intelligence, Korea University)

    Funding Information:
    This work was supported by Institute of Information &Communications Technology Planning &Evaluation (IITP) grant funded by the Korean government (MSIT) (No. 2019-0-00079, Department of Artificial Intelligence, Korea University)

    Publisher Copyright:
    © 2020 IEEE.

    ASJC Scopus subject areas

    • Software
    • Computer Vision and Pattern Recognition

    Fingerprint

    Dive into the research topics of '3FabRec: Fast Few-Shot Face Alignment by Reconstruction'. Together they form a unique fingerprint.

    Cite this