Multipath-DenseNet: A Supervised ensemble architecture of densely connected convolutional networks

Bilal Lodhi, Jaewoo Kang

    Research output: Contribution to journalArticlepeer-review

    31 Citations (Scopus)


    Deep networks with skip-connections such as ResNets have achieved great results in recent years. DenseNet exploits the ResNet skip-connections by connecting each layer in convolution neural network to all preceding layers and achieves state-of-the-art accuracy. It is well-known that deeper networks are more efficient and easier to train than shallow or wider networks. Despite the high performance of very deep networks, they are limited in terms of vanishing gradient, diminishing forward flow, and slower training time. In this paper, we propose to combine the benefits of the depth and width of networks. We train supervised independent shallow networks on the same input in a block fashion. We use a state-of-the-art DenseNet block to increase the number of paths for gradient flow. Our proposed architecture has several advantages over other deeper networks including DenseNet; our architecture which we call Multipath-DenseNet is deeper as well as wider, reduces training time, and uses a smaller number of parameters. We evaluate our proposed architecture on the following four object recognition datasets: CIFAR-10, CIFAR-100, SVHN, and ImageNet. The evaluation results show that Multipath-DenseNet achieves significant improvement in performance over DenseNet on the benchmark datasets.

    Original languageEnglish
    Pages (from-to)63-72
    Number of pages10
    JournalInformation Sciences
    Publication statusPublished - 2019 May

    Bibliographical note

    Funding Information:
    This research was supported by the National Research Foundation of Korea (No. 2017R1A2A1A17069645 ).

    Publisher Copyright:
    © 2019 Elsevier Inc.


    • Deep-learning
    • Image classification
    • Neural network

    ASJC Scopus subject areas

    • Software
    • Control and Systems Engineering
    • Theoretical Computer Science
    • Computer Science Applications
    • Information Systems and Management
    • Artificial Intelligence


    Dive into the research topics of 'Multipath-DenseNet: A Supervised ensemble architecture of densely connected convolutional networks'. Together they form a unique fingerprint.

    Cite this