Real-Time Facial Animation Generation on Face Mask

Bin Han, Gerard Jounghyun Kim, Jae In Hwang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)


In light of the COVID-19 pandemic, wearing a mask is crucial to avoid contracting infectious diseases. However, wearing a mask is known to impair communication functions. This study aims to address the communication difficulties caused by wearing a mask and provide a strategy for aiding in understanding the speaker's speech through facial animation. Facial animation is generated in real-time, and upper facial information is processed to detect the speaker's emotions, generating a lower facial expression. In addition, the system detects the mask's shape and enables accurate registration in the proper position. This technology can improve communication and alleviate challenges associated with communication between persons wearing face masks.

Original languageEnglish
Title of host publicationProceedings - SIGGRAPH Asia 2022 Posters
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450394628
Publication statusPublished - 2022 Dec 26
Externally publishedYes
EventSIGGRAPH Asia 2022 - Computer Graphics and Interactive Techniques Conference - Asia, SA 2022 - Daegu, Korea, Republic of
Duration: 2022 Dec 62022 Dec 9

Publication series

NameProceedings - SIGGRAPH Asia 2022 Posters


ConferenceSIGGRAPH Asia 2022 - Computer Graphics and Interactive Techniques Conference - Asia, SA 2022
Country/TerritoryKorea, Republic of

Bibliographical note

Publisher Copyright:
© 2022 Owner/Author.


  • face detection
  • facial animation
  • lip-sync animation

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Real-Time Facial Animation Generation on Face Mask'. Together they form a unique fingerprint.

Cite this