Towards Brain-based Interface for Communication and Control by Skin Touch

Myoung Ki Kim, Jeong Hyun Cho, Hye Bin Shin, Seong Whan Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Metaverse is a platform that can extend human interaction beyond a limited real space and into an infinite space using virtual reality and augmented reality. Simple and intuitive wearable interfaces suitable for metaverse environments are a significant challenge. Non-invasive brain-computer interfaces (BCIs) are potential alternatives. In this paper, we introduce a novel brain-based interface system based on tactile and sensory perception. It is a preliminary study for the development of next-generation neurohaptic interface technology that enables communication and control in the metaverse by skin touch. We designed a novel experimental environment to acquire brain signals generated during skin touch. Through the experiment, we collected the electroencephalogram (EEG) signals with respect to different input classes by combining commonly used touch gestures and body parts. Twelve subjects were recruited for the experiment and evaluated classification performances using machine learning and deep learning approaches to decode the user's intentional skin touch. Hence, we could confirm the feasibility of decoding skin touch-related EEG signals to develop the proposed on-skin interface technology.

Original languageEnglish
Title of host publication11th International Winter Conference on Brain-Computer Interface, BCI 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665464444
Publication statusPublished - 2023
Event11th International Winter Conference on Brain-Computer Interface, BCI 2023 - Virtual, Online, Korea, Republic of
Duration: 2023 Feb 202023 Feb 22

Publication series

NameInternational Winter Conference on Brain-Computer Interface, BCI
ISSN (Print)2572-7672


Conference11th International Winter Conference on Brain-Computer Interface, BCI 2023
Country/TerritoryKorea, Republic of
CityVirtual, Online

Bibliographical note

Funding Information:
This work was partly supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00432, Development of NonInvasive Integrated BCI SW Platform to Control Home Appliances and External Devices by User’s Thought via AR/VR Interface; No. 2019-0-00079, Artificial Intelligence Graduate School Program, Korea University) and the National Research Foundation of Korea (NRF) grant funded by the MSIT (No.2022-2-00975, MetaSkin: Developing Next-generation Neurohaptic Interface Techonology that enables Communication and Control in Metaverse by Skin Touch).

Publisher Copyright:
© 2023 IEEE.


  • brain-computer interface
  • deep learning
  • human-computer interaction
  • touch and gestural inputs

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Signal Processing


Dive into the research topics of 'Towards Brain-based Interface for Communication and Control by Skin Touch'. Together they form a unique fingerprint.

Cite this