Driver assistance systems are a major focus of the automotive industry. Although technological functions that help drivers are improving, themonitoring of driver state functions receives less attention. In this respect, the human heart rate (HR) is one of themost important bio-signals, and it can be detected remotely using consumer-grade cameras. Based on this, a video-based driver state monitoring system using HR signals is proposed in this paper. In a practical automotive environment, monitoring the HR is very challenging due to changes in illumination, vibrations, and human motion. In order to overcome these problems, source separation strategies were employed using joint blind source separation, and feature combination was adopted tomaximize HR variation. Noise-assisted data analysis was then adopted using ensemble empiricalmode decomposition to extract the pure HR. Finally, power spectral density analysis was conducted in the frequency domain, and a post-processing smoothing filter was applied. The performance of the proposed approach was tested based on commonly employedmetrics using the MAHNOB-HCI public dataset and compared with recently proposed competing methods. The experimental results proved that ourmethod is robust for a variety of driving conditions based on testing using a driving dataset and static indoor environments.
Bibliographical noteFunding Information:
This work was funded by Hyundai Autron Co., Ltd. and was technically supported by the Application SW Development Team and the R&D Innovation Team.
© 2019 by the authors.
- Blind source separation
- Cardiac signal
- Heart rate
- Remote photoplethysmography
ASJC Scopus subject areas
- Materials Science(all)
- Process Chemistry and Technology
- Computer Science Applications
- Fluid Flow and Transfer Processes