Doubly supervised embedding based on class labels and intrinsic clusters for high-dimensional data visualization

Hannah Kim, Jaegul Choo, Chandan K. Reddy, Haesun Park

    Research output: Contribution to journalArticlepeer-review

    9 Citations (Scopus)

    Abstract

    Visualization of data can assist decision-making processes by presenting the underlying information in a perceptible manner. Many dimension reduction techniques have been proposed to generate faithful visualization snapshots given high-dimensional data. When class labels associated with the data are already provided, supervised dimension reduction methods, which utilize such pre-given label information as well as the data, have been effective in revealing the overall structure of data with respect to their pre-given class labels. However, the main principle of most of these supervised methods has been to enhance class separability, which generally leads to significant distortion of original relationships. To compensate for such distortion, we propose a novel doubly supervised dimension reduction approach that highlights both natural groupings conforming to original relationships and classes determined by pre-given labels. Our method imposes minimal supervision on the pre-given class information depending on their original distributions while imposing additional supervision on natural groupings to better preserve them in reduced feature space. Specifically, we apply the notion of doubly supervised dimension reduction to a state-of-the-art method called t-distributed stochastic neighbor embedding and present a new formulation and an algorithm. By performing both quantitative and qualitative analyses, we demonstrate the effectiveness of our method using various visualization examples on real-world data. Our results show that, compared to other existing methods, the proposed method better preserves the original high-dimensional relationships while simultaneously maintaining class separability and preserving cluster structures. In addition, due to the characteristics of preserving natural groupings, the visualization results generated by our method reveal interesting sub-groups that cohesively preserve the original relationships in the data.

    Original languageEnglish
    Pages (from-to)570-582
    Number of pages13
    JournalNeurocomputing
    Volume150
    Issue numberPB
    DOIs
    Publication statusPublished - 2015

    Bibliographical note

    Publisher Copyright:
    © 2014 Elsevier B.V.

    Keywords

    • Clustering
    • Multidimensional projection
    • Scatter plot
    • Supervised dimension reduction
    • T-distributed stochastic neighbor embedding
    • Visualization

    ASJC Scopus subject areas

    • Computer Science Applications
    • Cognitive Neuroscience
    • Artificial Intelligence

    Fingerprint

    Dive into the research topics of 'Doubly supervised embedding based on class labels and intrinsic clusters for high-dimensional data visualization'. Together they form a unique fingerprint.

    Cite this