TransSleep: Transitioning-Aware Attention-Based Deep Neural Network for Sleep Staging

Jaeun Phyo, Wonjun Ko, Eunjin Jeon, Heung Il Suk

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)


Sleep staging is essential for sleep assessment and plays a vital role as a health indicator. Many recent studies have devised various machine/deep learning methods for sleep staging. However, two key challenges hinder the practical use of those methods: 1) effectively capturing salient waveforms in sleep signals and 2) correctly classifying confusing stages in transitioning epochs. In this study, we propose a novel deep neural-network structure, TransSleep, that captures distinctive local temporal patterns and distinguishes confusing stages using two auxiliary tasks. In particular, TransSleep captures salient waveforms in sleep signals by an attention-based multiscale feature extractor and correctly classifies confusing stages in transitioning epochs, while modeling contextual relationships with two auxiliary tasks. Results show that TransSleep achieves promising performance in automatic sleep staging. The validity of TransSleep is demonstrated by its state-of-the-art performance on two publicly available datasets: 1) Sleep-EDF and 2) MASS. Furthermore, we performed ablations to analyze our results from different perspectives. Based on our overall results, we believe that TransSleep has immense potential to provide new insights into deep-learning-based sleep staging.

Original languageEnglish
Pages (from-to)1-11
Number of pages11
JournalIEEE Transactions on Cybernetics
Publication statusAccepted/In press - 2022


  • Attention mechanism
  • auxiliary task
  • Brain modeling
  • deep learning
  • Deep learning
  • Electroencephalography
  • electroencephalography (EEG)
  • Feature extraction
  • Hidden Markov models
  • Sleep
  • sleep staging
  • Task analysis

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Information Systems
  • Human-Computer Interaction
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'TransSleep: Transitioning-Aware Attention-Based Deep Neural Network for Sleep Staging'. Together they form a unique fingerprint.

Cite this