Many self-supervised representation learning methods have achieved high performance in image classification tasks. However, these methods have limited performance on localization tasks such as object detection or semantic segmentation. Most self-supervised representation learning methods are optimized with only one global representation, which does not pay much attention to the spatial information in an image. We propose a simple and effective method that uses the positional relationships between the entities in an image by shuffling the convolution kernels. Our method extends current self-supervised learning and calculates the pixel-wise (dis) similarities between the output of the standard convolution kernels and that of the randomly shuffled convolution kernels. Our proposed method achieves higher performance on object detection, instance segmentation, and semantic segmentation when attached to recent self-supervised learning methods.
Bibliographical noteFunding Information:
This study was partly supported by a grant from the Korea Health Technology R&D Project, through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health and Welfare, Republic of Korea (Grant No., HR20C0021); the ICT Creative Consilience program (IITP-2022-2020-0-01819) supervised by the IITP; and an IITP grant funded by the Korea government (MSIT) (No.2019–0-00533, Research on CPU vulnerability detection and validation).
© 2022 The Author(s)
- Deep learning
- Machine learning
- Representation learning
- Self-supervised learning
- Unsupervised learning
ASJC Scopus subject areas
- Control and Systems Engineering
- Theoretical Computer Science
- Computer Science Applications
- Information Systems and Management
- Artificial Intelligence