Controllable generative adversarial network

Minhyeok Lee, Junhee Seok

    Research output: Contribution to journalArticlepeer-review

    68 Citations (Scopus)

    Abstract

    Recently introduced generative adversarial networks (GANs) have been shown numerous promising results to generate realistic samples. In the last couple of years, it has been studied to control features in synthetic samples generated by the GAN. Auxiliary classifier GAN (ACGAN), a conventional method to generate conditional samples, employs a classification layer in discriminator to solve the problem. However, in this paper, we demonstrate that the auxiliary classifier can hardly provide good guidance for training of the generator, where the classifier suffers from overfitting. Since the generator learns from classification loss, such a problem has a chance to hinder the training. To overcome this limitation, here, we propose a controllable GAN (ControlGAN) structure. By separating a feature classifier from the discriminator, the classifier can be trained with data augmentation technique, which can support to make a fine classifier. Evaluated with the CIFAR-10 dataset, ControlGAN outperforms AC-WGAN-GP which is an improved version of the ACGAN, where Inception score of the ControlGAN is 8.61 ± 0.10. Furthermore, we demonstrate that the ControlGAN can generate intermediate features and opposite features for interpolated input and extrapolated input labels that are not used in the training process. It implies that the ControlGAN can significantly contribute to the variety of generated samples.

    Original languageEnglish
    Article number8641270
    Pages (from-to)28158-28169
    Number of pages12
    JournalIEEE Access
    Volume7
    DOIs
    Publication statusPublished - 2019

    Bibliographical note

    Funding Information:
    This work was supported by grants from the National Research Foundation of Korea (NRF-2016R1D1A1B03931077), Korea University (K1822271), and Mirae Asset Global Investments as well as a grant from the Institute for Information and Communications Technology Promotion (No.2017-0-00053, A Technology Development of Artificial Intelligence Doctors for Cardiovascular Disease).

    Publisher Copyright:
    © 2019 IEEE.

    Keywords

    • Artificial neural network
    • generative adversarial networks
    • generative model
    • sample generation

    ASJC Scopus subject areas

    • General Computer Science
    • General Materials Science
    • General Engineering
    • Electrical and Electronic Engineering

    Fingerprint

    Dive into the research topics of 'Controllable generative adversarial network'. Together they form a unique fingerprint.

    Cite this