Randomly shuffled convolution for self-supervised representation learning

Youngjin Oh, Minkyu Jeon, Dohwan Ko, Hyunwoo J. Kim

Research output: Contribution to journalArticlepeer-review

Abstract

Many self-supervised representation learning methods have achieved high performance in image classification tasks. However, these methods have limited performance on localization tasks such as object detection or semantic segmentation. Most self-supervised representation learning methods are optimized with only one global representation, which does not pay much attention to the spatial information in an image. We propose a simple and effective method that uses the positional relationships between the entities in an image by shuffling the convolution kernels. Our method extends current self-supervised learning and calculates the pixel-wise (dis) similarities between the output of the standard convolution kernels and that of the randomly shuffled convolution kernels. Our proposed method achieves higher performance on object detection, instance segmentation, and semantic segmentation when attached to recent self-supervised learning methods.

Original languageEnglish
Pages (from-to)206-219
Number of pages14
JournalInformation Sciences
Volume623
DOIs
Publication statusPublished - 2023 Apr

Bibliographical note

Funding Information:
This study was partly supported by a grant from the Korea Health Technology R&D Project, through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health and Welfare, Republic of Korea (Grant No., HR20C0021); the ICT Creative Consilience program (IITP-2022-2020-0-01819) supervised by the IITP; and an IITP grant funded by the Korea government (MSIT) (No.2019–0-00533, Research on CPU vulnerability detection and validation).

Publisher Copyright:
© 2022 The Author(s)

Keywords

  • Deep learning
  • Machine learning
  • Representation learning
  • Self-supervised learning
  • Unsupervised learning

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Theoretical Computer Science
  • Computer Science Applications
  • Information Systems and Management
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Randomly shuffled convolution for self-supervised representation learning'. Together they form a unique fingerprint.

Cite this