Semantic 3D motion retargeting for facial animation

Cristóbal Curio, Martin Breidt, Mario Kleiner, Quoc C. Vuong, Martin A. Giese, Heinrich H. Bülthoff

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    42 Citations (Scopus)

    Abstract

    We present a system for realistic facial animation that decomposes facial motion capture data into semantically meaningful motion channels based on the Facial Action Coding System. A captured performance is retargeted onto a morphable 3D face model based on a semantic correspondence between motion capture and 3D scan data. The resulting facial animation reveals a high level of realism by combining the high spatial resolution of a 3D scanner with the high temporal accuracy of motion capture data that accounts for subtle facial movements with sparse measurements. Such an animation system allows us to systematically investigate human perception of moving faces. It offers control over many aspects of the appearance of a dynamic face, while utilizing as much measured data as possible to avoid artistic biases. Using our animation system, we report results of an experiment that investigates the perceived naturalness of facial motion in a preference task. For expressions with small amounts of head motion, we find a benefit for our part-based generative animation system over an example-based approach that deforms the whole face at once.

    Original languageEnglish
    Title of host publicationProceedings - APGV 2006
    Subtitle of host publicationSymposium on Applied Perception in Graphics and Visualization
    Pages77-84
    Number of pages8
    DOIs
    Publication statusPublished - 2006
    Event3rd Symposium on Applied Perception in Graphics and Visualization, APGV 2006 - Boston, MA, United States
    Duration: 2006 Jul 282006 Jul 29

    Publication series

    NameProceedings - APGV 2006: Symposium on Applied Perception in Graphics and Visualization

    Other

    Other3rd Symposium on Applied Perception in Graphics and Visualization, APGV 2006
    Country/TerritoryUnited States
    CityBoston, MA
    Period06/7/2806/7/29

    Keywords

    • Facial animation
    • Facial motion
    • Human perception
    • Motion retargeting
    • Performance capture

    ASJC Scopus subject areas

    • Computer Graphics and Computer-Aided Design
    • Computer Science Applications
    • Computer Vision and Pattern Recognition
    • Software

    Fingerprint

    Dive into the research topics of 'Semantic 3D motion retargeting for facial animation'. Together they form a unique fingerprint.

    Cite this