Towards Neurohaptics: Brain-Computer Interfaces for Decoding Intuitive Sense of Touch

Jeong Hyun Cho; Ji Hoon Jeong; Myoung Ki Kim; Seong Whan Lee

doi:10.1109/BCI51272.2021.9385331

Towards Neurohaptics: Brain-Computer Interfaces for Decoding Intuitive Sense of Touch

Jeong Hyun Cho, Ji Hoon Jeong, Myoung Ki Kim, Seong Whan Lee

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

7 Citations (Scopus)

Abstract

Noninvasive brain-computer interface (BCI) is widely used to recognize users' intentions. Especially, BCI related to tactile and sensation decoding could provide various effects on many industrial fields such as manufacturing advanced touch displays, controlling robotic devices, and more immersive virtual reality or augmented reality. In this paper, we introduce haptic and sensory perception-based BCI systems called neurohaptics. It is a preliminary study for a variety of scenarios using actual touch and touch imagery paradigms. We designed a novel experimental environment and a device that could acquire brain signals under touching designated materials to generate natural touch and texture sensations. Through the experiment, we collected the electroencephalogram (EEG) signals with respect to four different texture objects. Seven subjects were recruited for the experiment and evaluated classification performances using machine learning and deep learning approaches. Hence, we could confirm the feasibility of decoding actual touch and touch imagery on EEG signals to develop practical neurohaptics.

Original language	English
Title of host publication	9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781728184852
DOIs	https://doi.org/10.1109/BCI51272.2021.9385331
Publication status	Published - 2021 Feb 22
Event	9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021 - Gangwon, Korea, Republic of Duration: 2021 Feb 22 → 2021 Feb 24

Publication series

Name	9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021

Conference

Conference	9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021
Country/Territory	Korea, Republic of
City	Gangwon
Period	21/2/22 → 21/2/24

Bibliographical note

Funding Information:
This work was partly supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00432, Development of NonInvasive Integrated BCI SW Platform to Control Home Appliances and External Devices by User’s Thought via AR/VR Interface; No. 2017-0-00451, Development of BCI based Brain and Cognitive Computing Technology for Recognizing User’s Intentions using Deep Learning; No. 2019-0-00079, Artificial Intelligence Graduate School Program (Korea University)).

Publisher Copyright:
© 2021 IEEE.

Keywords

brain-computer interface
electroencephalogram
haptic sensation analysis
tactile information
touch imagery

ASJC Scopus subject areas

Artificial Intelligence
Human-Computer Interaction
Signal Processing

Access to Document

10.1109/BCI51272.2021.9385331

Cite this

Cho, J. H., Jeong, J. H., Kim, M. K., & Lee, S. W. (2021). Towards Neurohaptics: Brain-Computer Interfaces for Decoding Intuitive Sense of Touch. In 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021 Article 9385331 (9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BCI51272.2021.9385331

Towards Neurohaptics: Brain-Computer Interfaces for Decoding Intuitive Sense of Touch. / Cho, Jeong Hyun; Jeong, Ji Hoon; Kim, Myoung Ki et al.
9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021. Institute of Electrical and Electronics Engineers Inc., 2021. 9385331 (9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Cho, JH, Jeong, JH, Kim, MK & Lee, SW 2021, Towards Neurohaptics: Brain-Computer Interfaces for Decoding Intuitive Sense of Touch. in 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021., 9385331, 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021, Institute of Electrical and Electronics Engineers Inc., 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021, Gangwon, Korea, Republic of, 21/2/22. https://doi.org/10.1109/BCI51272.2021.9385331

Cho JH, Jeong JH, Kim MK, Lee SW. Towards Neurohaptics: Brain-Computer Interfaces for Decoding Intuitive Sense of Touch. In 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021. Institute of Electrical and Electronics Engineers Inc. 2021. 9385331. (9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021). doi: 10.1109/BCI51272.2021.9385331

Cho, Jeong Hyun ; Jeong, Ji Hoon ; Kim, Myoung Ki et al. / Towards Neurohaptics : Brain-Computer Interfaces for Decoding Intuitive Sense of Touch. 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021. Institute of Electrical and Electronics Engineers Inc., 2021. (9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021).

@inproceedings{c51c08c7e34645d7a741181c55c8bbf2,

title = "Towards Neurohaptics: Brain-Computer Interfaces for Decoding Intuitive Sense of Touch",

abstract = "Noninvasive brain-computer interface (BCI) is widely used to recognize users' intentions. Especially, BCI related to tactile and sensation decoding could provide various effects on many industrial fields such as manufacturing advanced touch displays, controlling robotic devices, and more immersive virtual reality or augmented reality. In this paper, we introduce haptic and sensory perception-based BCI systems called neurohaptics. It is a preliminary study for a variety of scenarios using actual touch and touch imagery paradigms. We designed a novel experimental environment and a device that could acquire brain signals under touching designated materials to generate natural touch and texture sensations. Through the experiment, we collected the electroencephalogram (EEG) signals with respect to four different texture objects. Seven subjects were recruited for the experiment and evaluated classification performances using machine learning and deep learning approaches. Hence, we could confirm the feasibility of decoding actual touch and touch imagery on EEG signals to develop practical neurohaptics. ",

keywords = "brain-computer interface, electroencephalogram, haptic sensation analysis, tactile information, touch imagery",

author = "Cho, {Jeong Hyun} and Jeong, {Ji Hoon} and Kim, {Myoung Ki} and Lee, {Seong Whan}",

note = "Funding Information: This work was partly supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00432, Development of NonInvasive Integrated BCI SW Platform to Control Home Appliances and External Devices by User{\textquoteright}s Thought via AR/VR Interface; No. 2017-0-00451, Development of BCI based Brain and Cognitive Computing Technology for Recognizing User{\textquoteright}s Intentions using Deep Learning; No. 2019-0-00079, Artificial Intelligence Graduate School Program (Korea University)). Publisher Copyright: {\textcopyright} 2021 IEEE.; 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021 ; Conference date: 22-02-2021 Through 24-02-2021",

year = "2021",

month = feb,

day = "22",

doi = "10.1109/BCI51272.2021.9385331",

language = "English",

series = "9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021",

}

TY - GEN

T1 - Towards Neurohaptics

T2 - 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021

AU - Cho, Jeong Hyun

AU - Jeong, Ji Hoon

AU - Kim, Myoung Ki

AU - Lee, Seong Whan

N1 - Funding Information: This work was partly supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00432, Development of NonInvasive Integrated BCI SW Platform to Control Home Appliances and External Devices by User’s Thought via AR/VR Interface; No. 2017-0-00451, Development of BCI based Brain and Cognitive Computing Technology for Recognizing User’s Intentions using Deep Learning; No. 2019-0-00079, Artificial Intelligence Graduate School Program (Korea University)). Publisher Copyright: © 2021 IEEE.

PY - 2021/2/22

Y1 - 2021/2/22

N2 - Noninvasive brain-computer interface (BCI) is widely used to recognize users' intentions. Especially, BCI related to tactile and sensation decoding could provide various effects on many industrial fields such as manufacturing advanced touch displays, controlling robotic devices, and more immersive virtual reality or augmented reality. In this paper, we introduce haptic and sensory perception-based BCI systems called neurohaptics. It is a preliminary study for a variety of scenarios using actual touch and touch imagery paradigms. We designed a novel experimental environment and a device that could acquire brain signals under touching designated materials to generate natural touch and texture sensations. Through the experiment, we collected the electroencephalogram (EEG) signals with respect to four different texture objects. Seven subjects were recruited for the experiment and evaluated classification performances using machine learning and deep learning approaches. Hence, we could confirm the feasibility of decoding actual touch and touch imagery on EEG signals to develop practical neurohaptics.

AB - Noninvasive brain-computer interface (BCI) is widely used to recognize users' intentions. Especially, BCI related to tactile and sensation decoding could provide various effects on many industrial fields such as manufacturing advanced touch displays, controlling robotic devices, and more immersive virtual reality or augmented reality. In this paper, we introduce haptic and sensory perception-based BCI systems called neurohaptics. It is a preliminary study for a variety of scenarios using actual touch and touch imagery paradigms. We designed a novel experimental environment and a device that could acquire brain signals under touching designated materials to generate natural touch and texture sensations. Through the experiment, we collected the electroencephalogram (EEG) signals with respect to four different texture objects. Seven subjects were recruited for the experiment and evaluated classification performances using machine learning and deep learning approaches. Hence, we could confirm the feasibility of decoding actual touch and touch imagery on EEG signals to develop practical neurohaptics.

KW - brain-computer interface

KW - electroencephalogram

KW - haptic sensation analysis

KW - tactile information

KW - touch imagery

UR - http://www.scopus.com/inward/record.url?scp=85104825490&partnerID=8YFLogxK

U2 - 10.1109/BCI51272.2021.9385331

DO - 10.1109/BCI51272.2021.9385331

M3 - Conference contribution

AN - SCOPUS:85104825490

T3 - 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021

BT - 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 22 February 2021 through 24 February 2021

ER -

Towards Neurohaptics: Brain-Computer Interfaces for Decoding Intuitive Sense of Touch

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this