Towards Brain-based Interface for Communication and Control by Skin Touch

Myoung Ki Kim; Jeong Hyun Cho; Hye Bin Shin; Seong Whan Lee

doi:10.1109/BCI57258.2023.10078458

Towards Brain-based Interface for Communication and Control by Skin Touch

Myoung Ki Kim, Jeong Hyun Cho, Hye Bin Shin, Seong Whan Lee

Department of Artificial Intelligence

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Metaverse is a platform that can extend human interaction beyond a limited real space and into an infinite space using virtual reality and augmented reality. Simple and intuitive wearable interfaces suitable for metaverse environments are a significant challenge. Non-invasive brain-computer interfaces (BCIs) are potential alternatives. In this paper, we introduce a novel brain-based interface system based on tactile and sensory perception. It is a preliminary study for the development of next-generation neurohaptic interface technology that enables communication and control in the metaverse by skin touch. We designed a novel experimental environment to acquire brain signals generated during skin touch. Through the experiment, we collected the electroencephalogram (EEG) signals with respect to different input classes by combining commonly used touch gestures and body parts. Twelve subjects were recruited for the experiment and evaluated classification performances using machine learning and deep learning approaches to decode the user's intentional skin touch. Hence, we could confirm the feasibility of decoding skin touch-related EEG signals to develop the proposed on-skin interface technology.

Original language	English
Title of host publication	11th International Winter Conference on Brain-Computer Interface, BCI 2023
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781665464444
DOIs	https://doi.org/10.1109/BCI57258.2023.10078458
Publication status	Published - 2023
Event	11th International Winter Conference on Brain-Computer Interface, BCI 2023 - Virtual, Online, Korea, Republic of Duration: 2023 Feb 20 → 2023 Feb 22

Publication series

Name	International Winter Conference on Brain-Computer Interface, BCI
Volume	2023-February
ISSN (Print)	2572-7672

Conference

Conference	11th International Winter Conference on Brain-Computer Interface, BCI 2023
Country/Territory	Korea, Republic of
City	Virtual, Online
Period	23/2/20 → 23/2/22

Bibliographical note

Funding Information:
This work was partly supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00432, Development of NonInvasive Integrated BCI SW Platform to Control Home Appliances and External Devices by User’s Thought via AR/VR Interface; No. 2019-0-00079, Artificial Intelligence Graduate School Program, Korea University) and the National Research Foundation of Korea (NRF) grant funded by the MSIT (No.2022-2-00975, MetaSkin: Developing Next-generation Neurohaptic Interface Techonology that enables Communication and Control in Metaverse by Skin Touch).

Publisher Copyright:
© 2023 IEEE.

Keywords

brain-computer interface
deep learning
human-computer interaction
touch and gestural inputs

ASJC Scopus subject areas

Artificial Intelligence
Human-Computer Interaction
Signal Processing

Access to Document

10.1109/BCI57258.2023.10078458

Cite this

Kim, M. K., Cho, J. H., Shin, H. B., & Lee, S. W. (2023). Towards Brain-based Interface for Communication and Control by Skin Touch. In 11th International Winter Conference on Brain-Computer Interface, BCI 2023 (International Winter Conference on Brain-Computer Interface, BCI; Vol. 2023-February). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BCI57258.2023.10078458

Towards Brain-based Interface for Communication and Control by Skin Touch. / Kim, Myoung Ki; Cho, Jeong Hyun; Shin, Hye Bin et al.
11th International Winter Conference on Brain-Computer Interface, BCI 2023. Institute of Electrical and Electronics Engineers Inc., 2023. (International Winter Conference on Brain-Computer Interface, BCI; Vol. 2023-February).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Kim, MK, Cho, JH, Shin, HB & Lee, SW 2023, Towards Brain-based Interface for Communication and Control by Skin Touch. in 11th International Winter Conference on Brain-Computer Interface, BCI 2023. International Winter Conference on Brain-Computer Interface, BCI, vol. 2023-February, Institute of Electrical and Electronics Engineers Inc., 11th International Winter Conference on Brain-Computer Interface, BCI 2023, Virtual, Online, Korea, Republic of, 23/2/20. https://doi.org/10.1109/BCI57258.2023.10078458

@inproceedings{88fd2ea90fdc4e20870d2347043e67d1,

title = "Towards Brain-based Interface for Communication and Control by Skin Touch",

abstract = "Metaverse is a platform that can extend human interaction beyond a limited real space and into an infinite space using virtual reality and augmented reality. Simple and intuitive wearable interfaces suitable for metaverse environments are a significant challenge. Non-invasive brain-computer interfaces (BCIs) are potential alternatives. In this paper, we introduce a novel brain-based interface system based on tactile and sensory perception. It is a preliminary study for the development of next-generation neurohaptic interface technology that enables communication and control in the metaverse by skin touch. We designed a novel experimental environment to acquire brain signals generated during skin touch. Through the experiment, we collected the electroencephalogram (EEG) signals with respect to different input classes by combining commonly used touch gestures and body parts. Twelve subjects were recruited for the experiment and evaluated classification performances using machine learning and deep learning approaches to decode the user's intentional skin touch. Hence, we could confirm the feasibility of decoding skin touch-related EEG signals to develop the proposed on-skin interface technology.",

keywords = "brain-computer interface, deep learning, human-computer interaction, touch and gestural inputs",

author = "Kim, {Myoung Ki} and Cho, {Jeong Hyun} and Shin, {Hye Bin} and Lee, {Seong Whan}",

note = "Funding Information: This work was partly supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00432, Development of NonInvasive Integrated BCI SW Platform to Control Home Appliances and External Devices by User{\textquoteright}s Thought via AR/VR Interface; No. 2019-0-00079, Artificial Intelligence Graduate School Program, Korea University) and the National Research Foundation of Korea (NRF) grant funded by the MSIT (No.2022-2-00975, MetaSkin: Developing Next-generation Neurohaptic Interface Techonology that enables Communication and Control in Metaverse by Skin Touch). Publisher Copyright: {\textcopyright} 2023 IEEE.; 11th International Winter Conference on Brain-Computer Interface, BCI 2023 ; Conference date: 20-02-2023 Through 22-02-2023",

year = "2023",

doi = "10.1109/BCI57258.2023.10078458",

language = "English",

series = "International Winter Conference on Brain-Computer Interface, BCI",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "11th International Winter Conference on Brain-Computer Interface, BCI 2023",

}

TY - GEN

T1 - Towards Brain-based Interface for Communication and Control by Skin Touch

AU - Kim, Myoung Ki

AU - Cho, Jeong Hyun

AU - Shin, Hye Bin

AU - Lee, Seong Whan

N1 - Funding Information: This work was partly supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00432, Development of NonInvasive Integrated BCI SW Platform to Control Home Appliances and External Devices by User’s Thought via AR/VR Interface; No. 2019-0-00079, Artificial Intelligence Graduate School Program, Korea University) and the National Research Foundation of Korea (NRF) grant funded by the MSIT (No.2022-2-00975, MetaSkin: Developing Next-generation Neurohaptic Interface Techonology that enables Communication and Control in Metaverse by Skin Touch). Publisher Copyright: © 2023 IEEE.

PY - 2023

Y1 - 2023

N2 - Metaverse is a platform that can extend human interaction beyond a limited real space and into an infinite space using virtual reality and augmented reality. Simple and intuitive wearable interfaces suitable for metaverse environments are a significant challenge. Non-invasive brain-computer interfaces (BCIs) are potential alternatives. In this paper, we introduce a novel brain-based interface system based on tactile and sensory perception. It is a preliminary study for the development of next-generation neurohaptic interface technology that enables communication and control in the metaverse by skin touch. We designed a novel experimental environment to acquire brain signals generated during skin touch. Through the experiment, we collected the electroencephalogram (EEG) signals with respect to different input classes by combining commonly used touch gestures and body parts. Twelve subjects were recruited for the experiment and evaluated classification performances using machine learning and deep learning approaches to decode the user's intentional skin touch. Hence, we could confirm the feasibility of decoding skin touch-related EEG signals to develop the proposed on-skin interface technology.

AB - Metaverse is a platform that can extend human interaction beyond a limited real space and into an infinite space using virtual reality and augmented reality. Simple and intuitive wearable interfaces suitable for metaverse environments are a significant challenge. Non-invasive brain-computer interfaces (BCIs) are potential alternatives. In this paper, we introduce a novel brain-based interface system based on tactile and sensory perception. It is a preliminary study for the development of next-generation neurohaptic interface technology that enables communication and control in the metaverse by skin touch. We designed a novel experimental environment to acquire brain signals generated during skin touch. Through the experiment, we collected the electroencephalogram (EEG) signals with respect to different input classes by combining commonly used touch gestures and body parts. Twelve subjects were recruited for the experiment and evaluated classification performances using machine learning and deep learning approaches to decode the user's intentional skin touch. Hence, we could confirm the feasibility of decoding skin touch-related EEG signals to develop the proposed on-skin interface technology.

KW - brain-computer interface

KW - deep learning

KW - human-computer interaction

KW - touch and gestural inputs

UR - http://www.scopus.com/inward/record.url?scp=85152202833&partnerID=8YFLogxK

U2 - 10.1109/BCI57258.2023.10078458

DO - 10.1109/BCI57258.2023.10078458

M3 - Conference contribution

AN - SCOPUS:85152202833

T3 - International Winter Conference on Brain-Computer Interface, BCI

BT - 11th International Winter Conference on Brain-Computer Interface, BCI 2023

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 11th International Winter Conference on Brain-Computer Interface, BCI 2023

Y2 - 20 February 2023 through 22 February 2023

ER -

Towards Brain-based Interface for Communication and Control by Skin Touch

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this