Recognition of Pilot's Cognitive States based on Combination of Physiological Signals

Soo Yeon Han; Jeong Woo Kim; Seong Whan Lee

doi:10.1109/IWW-BCI.2019.8737317

Recognition of Pilot's Cognitive States based on Combination of Physiological Signals

Soo Yeon Han, Jeong Woo Kim, Seong Whan Lee

Department of Artificial Intelligence

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

6 Citations (Scopus)

Abstract

Pilot's cognitive states induced by mental fatigue, distraction, and workload could be a cause of catastrophic accidents. Therefore, many methods for the detection of pilot cognitive states have been proposed in previous studies. Especially, neuro-and peripheral physiological measures (PPMs) such as electroencephalogram (EEG), electrocardiogram (ECG), respiration, and electrodermal activity (EDA) were employed to develop the novel flight assistant technologies for assurance of pilot's safety. However, each study investigated only one kind of state. Also, they did not consider the feature optimization for each subject. In this paper, we propose a method for the recognition of pilot's diversified mental states during simulated flight. The method selects the most fitted features for each subject based on the statistical analysis. The results show that the proposed method is superior to previous methods. Consequently, it shows that the pilot assistant system based on human-computer interaction (HCI) technologies could be facilitated in real-world.

Original language	English
Title of host publication	7th International Winter Conference on Brain-Computer Interface, BCI 2019
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781538681169
DOIs	https://doi.org/10.1109/IWW-BCI.2019.8737317
Publication status	Published - 2019 Feb
Event	7th International Winter Conference on Brain-Computer Interface, BCI 2019 - Gangwon, Korea, Republic of Duration: 2019 Feb 18 → 2019 Feb 20

Publication series

Name	7th International Winter Conference on Brain-Computer Interface, BCI 2019

Conference

Conference	7th International Winter Conference on Brain-Computer Interface, BCI 2019
Country/Territory	Korea, Republic of
City	Gangwon
Period	19/2/18 → 19/2/20

Bibliographical note

Funding Information:
The fatigue state commonly occurs after a prolonged period of engaging in a cognitive task, especially a boring or repetitive task [5]. According to the British airline pilots’ Association (BALPA), 56 percent of 500 commercial pilots admitted to being asleep while on the flight deck and, of those, nearly one in three said that they had woken up to find their co-pilot also asleep. Also, distraction occurs when pilots divert their attention away from the flight task. Civil aviation authority (CAA) of New Zealand said that interruptions and distractions during critical phases of flight are the major causes of errors leading to accidents and incidents. In case of the mental workload, it is defined as the kind of required mental cost to accomplish the given task [6]. From the pilot’s point of view, task difficulty and mental workload could be influenced by This work was supported by Defense Acquisition Program Administration (DAPA) and Agency for Defense Development (ADD) of Korea (06-201-305-001, A Study on Human-Computer Interaction Technology for the Pilot Status Recognition).

Publisher Copyright:
© 2019 IEEE.

Keywords

electroencephalography
passive brain computer interface
peripheral physiological meausrescomponent
pilot inattention
pilot safety
pilot's mental states

ASJC Scopus subject areas

Artificial Intelligence
Human-Computer Interaction
Signal Processing
Neuroscience (miscellaneous)

Access to Document

10.1109/IWW-BCI.2019.8737317

Cite this

Han, S. Y., Kim, J. W., & Lee, S. W. (2019). Recognition of Pilot's Cognitive States based on Combination of Physiological Signals. In 7th International Winter Conference on Brain-Computer Interface, BCI 2019 Article 8737317 (7th International Winter Conference on Brain-Computer Interface, BCI 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IWW-BCI.2019.8737317

Recognition of Pilot's Cognitive States based on Combination of Physiological Signals. / Han, Soo Yeon; Kim, Jeong Woo; Lee, Seong Whan.
7th International Winter Conference on Brain-Computer Interface, BCI 2019. Institute of Electrical and Electronics Engineers Inc., 2019. 8737317 (7th International Winter Conference on Brain-Computer Interface, BCI 2019).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Han, SY, Kim, JW & Lee, SW 2019, Recognition of Pilot's Cognitive States based on Combination of Physiological Signals. in 7th International Winter Conference on Brain-Computer Interface, BCI 2019., 8737317, 7th International Winter Conference on Brain-Computer Interface, BCI 2019, Institute of Electrical and Electronics Engineers Inc., 7th International Winter Conference on Brain-Computer Interface, BCI 2019, Gangwon, Korea, Republic of, 19/2/18. https://doi.org/10.1109/IWW-BCI.2019.8737317

@inproceedings{a13b47cecec34937a7e94e8f8d9cdecc,

title = "Recognition of Pilot's Cognitive States based on Combination of Physiological Signals",

abstract = "Pilot's cognitive states induced by mental fatigue, distraction, and workload could be a cause of catastrophic accidents. Therefore, many methods for the detection of pilot cognitive states have been proposed in previous studies. Especially, neuro-and peripheral physiological measures (PPMs) such as electroencephalogram (EEG), electrocardiogram (ECG), respiration, and electrodermal activity (EDA) were employed to develop the novel flight assistant technologies for assurance of pilot's safety. However, each study investigated only one kind of state. Also, they did not consider the feature optimization for each subject. In this paper, we propose a method for the recognition of pilot's diversified mental states during simulated flight. The method selects the most fitted features for each subject based on the statistical analysis. The results show that the proposed method is superior to previous methods. Consequently, it shows that the pilot assistant system based on human-computer interaction (HCI) technologies could be facilitated in real-world.",

keywords = "electroencephalography, passive brain computer interface, peripheral physiological meausrescomponent, pilot inattention, pilot safety, pilot's mental states",

author = "Han, {Soo Yeon} and Kim, {Jeong Woo} and Lee, {Seong Whan}",

note = "Funding Information: The fatigue state commonly occurs after a prolonged period of engaging in a cognitive task, especially a boring or repetitive task [5]. According to the British airline pilots{\textquoteright} Association (BALPA), 56 percent of 500 commercial pilots admitted to being asleep while on the flight deck and, of those, nearly one in three said that they had woken up to find their co-pilot also asleep. Also, distraction occurs when pilots divert their attention away from the flight task. Civil aviation authority (CAA) of New Zealand said that interruptions and distractions during critical phases of flight are the major causes of errors leading to accidents and incidents. In case of the mental workload, it is defined as the kind of required mental cost to accomplish the given task [6]. From the pilot{\textquoteright}s point of view, task difficulty and mental workload could be influenced by This work was supported by Defense Acquisition Program Administration (DAPA) and Agency for Defense Development (ADD) of Korea (06-201-305-001, A Study on Human-Computer Interaction Technology for the Pilot Status Recognition). Publisher Copyright: {\textcopyright} 2019 IEEE.; 7th International Winter Conference on Brain-Computer Interface, BCI 2019 ; Conference date: 18-02-2019 Through 20-02-2019",

year = "2019",

month = feb,

doi = "10.1109/IWW-BCI.2019.8737317",

language = "English",

series = "7th International Winter Conference on Brain-Computer Interface, BCI 2019",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "7th International Winter Conference on Brain-Computer Interface, BCI 2019",

}

TY - GEN

T1 - Recognition of Pilot's Cognitive States based on Combination of Physiological Signals

AU - Han, Soo Yeon

AU - Kim, Jeong Woo

AU - Lee, Seong Whan

N1 - Funding Information: The fatigue state commonly occurs after a prolonged period of engaging in a cognitive task, especially a boring or repetitive task [5]. According to the British airline pilots’ Association (BALPA), 56 percent of 500 commercial pilots admitted to being asleep while on the flight deck and, of those, nearly one in three said that they had woken up to find their co-pilot also asleep. Also, distraction occurs when pilots divert their attention away from the flight task. Civil aviation authority (CAA) of New Zealand said that interruptions and distractions during critical phases of flight are the major causes of errors leading to accidents and incidents. In case of the mental workload, it is defined as the kind of required mental cost to accomplish the given task [6]. From the pilot’s point of view, task difficulty and mental workload could be influenced by This work was supported by Defense Acquisition Program Administration (DAPA) and Agency for Defense Development (ADD) of Korea (06-201-305-001, A Study on Human-Computer Interaction Technology for the Pilot Status Recognition). Publisher Copyright: © 2019 IEEE.

PY - 2019/2

Y1 - 2019/2

N2 - Pilot's cognitive states induced by mental fatigue, distraction, and workload could be a cause of catastrophic accidents. Therefore, many methods for the detection of pilot cognitive states have been proposed in previous studies. Especially, neuro-and peripheral physiological measures (PPMs) such as electroencephalogram (EEG), electrocardiogram (ECG), respiration, and electrodermal activity (EDA) were employed to develop the novel flight assistant technologies for assurance of pilot's safety. However, each study investigated only one kind of state. Also, they did not consider the feature optimization for each subject. In this paper, we propose a method for the recognition of pilot's diversified mental states during simulated flight. The method selects the most fitted features for each subject based on the statistical analysis. The results show that the proposed method is superior to previous methods. Consequently, it shows that the pilot assistant system based on human-computer interaction (HCI) technologies could be facilitated in real-world.

AB - Pilot's cognitive states induced by mental fatigue, distraction, and workload could be a cause of catastrophic accidents. Therefore, many methods for the detection of pilot cognitive states have been proposed in previous studies. Especially, neuro-and peripheral physiological measures (PPMs) such as electroencephalogram (EEG), electrocardiogram (ECG), respiration, and electrodermal activity (EDA) were employed to develop the novel flight assistant technologies for assurance of pilot's safety. However, each study investigated only one kind of state. Also, they did not consider the feature optimization for each subject. In this paper, we propose a method for the recognition of pilot's diversified mental states during simulated flight. The method selects the most fitted features for each subject based on the statistical analysis. The results show that the proposed method is superior to previous methods. Consequently, it shows that the pilot assistant system based on human-computer interaction (HCI) technologies could be facilitated in real-world.

KW - electroencephalography

KW - passive brain computer interface

KW - peripheral physiological meausrescomponent

KW - pilot inattention

KW - pilot safety

KW - pilot's mental states

UR - http://www.scopus.com/inward/record.url?scp=85068344963&partnerID=8YFLogxK

U2 - 10.1109/IWW-BCI.2019.8737317

DO - 10.1109/IWW-BCI.2019.8737317

M3 - Conference contribution

AN - SCOPUS:85068344963

T3 - 7th International Winter Conference on Brain-Computer Interface, BCI 2019

BT - 7th International Winter Conference on Brain-Computer Interface, BCI 2019

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 7th International Winter Conference on Brain-Computer Interface, BCI 2019

Y2 - 18 February 2019 through 20 February 2019

ER -

Recognition of Pilot's Cognitive States based on Combination of Physiological Signals

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this