EEG-based classification of video quality perception using steady state visual evoked potentials (SSVEPs)

Laura Acqualagna, Sebastian Bosse, Anne K. Porbadnigk, Gabriel Curio, Klaus Robert Müller, Thomas Wiegand, Benjamin Blankertz

    Research output: Contribution to journalArticlepeer-review

    51 Citations (Scopus)

    Abstract

    Objective. Recent studies exploit the neural signal recorded via electroencephalography (EEG) to get a more objective measurement of perceived video quality. Most of these studies capitalize on the event-related potential component P3. We follow an alternative approach to the measurement problem investigating steady state visual evoked potentials (SSVEPs) as EEG correlates of quality changes. Unlike the P3, SSVEPs are directly linked to the sensory processing of the stimuli and do not require long experimental sessions to get a sufficient signal-to-noise ratio. Furthermore, we investigate the correlation of the EEG-based measures with the outcome of the standard behavioral assessment. Approach. As stimulus material, we used six gray-level natural images in six levels of degradation that were created by coding the images with the HM10.0 test model of the high efficiency video coding (H.265/MPEG-HEVC) using six different compression rates. The degraded images were presented in rapid alternation with the original images. In this setting, the presence of SSVEPs is a neural marker that objectively indicates the neural processing of the quality changes that are induced by the video coding. We tested two different machine learning methods to classify such potentials based on the modulation of the brain rhythm and on time-locked components, respectively. Main results. Results show high accuracies in classification of the neural signal over the threshold of the perception of the quality changes. Accuracies significantly correlate with the mean opinion scores given by the participants in the standardized degradation category rating quality assessment of the same group of images. Significance. The results show that neural assessment of video quality based on SSVEPs is a viable complement of the behavioral one and a significantly fast alternative to methods based on the P3 component.

    Original languageEnglish
    Article number026012
    JournalJournal of Neural Engineering
    Volume12
    Issue number2
    DOIs
    Publication statusPublished - 2015 Apr 1

    Bibliographical note

    Publisher Copyright:
    © 2015 IOP Publishing Ltd.

    Keywords

    • EEG
    • MOS
    • SSVEPs
    • classification
    • video quality assessment

    ASJC Scopus subject areas

    • Biomedical Engineering
    • Cellular and Molecular Neuroscience

    Fingerprint

    Dive into the research topics of 'EEG-based classification of video quality perception using steady state visual evoked potentials (SSVEPs)'. Together they form a unique fingerprint.

    Cite this