Video-based contactless heart-rate detection and counting via joint blind source separation with adaptive noise canceller

Kanghyu Lee, Junmuk Lee, Changwoo Ha, Minseok Han, Hanseok Ko

Research output: Contribution to journalArticlepeer-review

10 Citations (Scopus)


Driver assistance systems are a major focus of the automotive industry. Although technological functions that help drivers are improving, themonitoring of driver state functions receives less attention. In this respect, the human heart rate (HR) is one of themost important bio-signals, and it can be detected remotely using consumer-grade cameras. Based on this, a video-based driver state monitoring system using HR signals is proposed in this paper. In a practical automotive environment, monitoring the HR is very challenging due to changes in illumination, vibrations, and human motion. In order to overcome these problems, source separation strategies were employed using joint blind source separation, and feature combination was adopted tomaximize HR variation. Noise-assisted data analysis was then adopted using ensemble empiricalmode decomposition to extract the pure HR. Finally, power spectral density analysis was conducted in the frequency domain, and a post-processing smoothing filter was applied. The performance of the proposed approach was tested based on commonly employedmetrics using the MAHNOB-HCI public dataset and compared with recently proposed competing methods. The experimental results proved that ourmethod is robust for a variety of driving conditions based on testing using a driving dataset and static indoor environments.

Original languageEnglish
Article number4349
JournalApplied Sciences (Switzerland)
Issue number20
Publication statusPublished - 2019 Oct 1

Bibliographical note

Funding Information:
This work was funded by Hyundai Autron Co., Ltd. and was technically supported by the Application SW Development Team and the R&D Innovation Team.

Publisher Copyright:
© 2019 by the authors.


  • Blind source separation
  • Cardiac signal
  • Heart rate
  • Remote photoplethysmography

ASJC Scopus subject areas

  • Materials Science(all)
  • Instrumentation
  • Engineering(all)
  • Process Chemistry and Technology
  • Computer Science Applications
  • Fluid Flow and Transfer Processes


Dive into the research topics of 'Video-based contactless heart-rate detection and counting via joint blind source separation with adaptive noise canceller'. Together they form a unique fingerprint.

Cite this