A deep interactive segmentation method with user interaction-based attention module and polar transformation

Jee Young Sun, Sang Won Lee, Ye Won Kim, Bo Sang Kim, Sung Jea Ko

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Interactive segmentation that extracts a specific foreground selected by the user input is widely employed in many user-interactive applications such as image editing and ground-truth labeling. In general, most interactive segmentation methods iteratively refine the previously obtained result using additional user interactions because they often produce unsatisfactory results with a single user input. A recently developed convolutional neural network (CNN)-based interactive segmentation method called deep interactive object selection has achieved high segmentation accuracy with fewer user interactions than earlier non-CNN-based approaches. However, the computational efficiency of deep interactive object selection deteriorates due to the repetitive feature extraction stage for each user interaction. Furthermore, the deep interactive object selection requires graph cut as a post-processing step to refine the boundary segments. To solve this problem, this paper presents a deep CNN-based interactive segmentation method employing an effective and simple user interaction-based attention module that does not require the repetitive feature extraction. In addition, we adopt Cartesian to polar coordinate transformation to further improve the segmentation performance. Experimental results demonstrate that the proposed interactive segmentation method is superior to the conventional ones in terms of segmentation accuracy and computational efficiency.

Original languageEnglish
Title of host publication12th International Conference on Machine Vision, ICMV 2019
EditorsWolfgang Osten, Dmitry Nikolaev, Jianhong Zhou
ISBN (Electronic)9781510636439
Publication statusPublished - 2020
Event12th International Conference on Machine Vision, ICMV 2019 - Amsterdam, Netherlands
Duration: 2019 Nov 162019 Nov 18

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X


Conference12th International Conference on Machine Vision, ICMV 2019

Bibliographical note

Funding Information:
This work was supported by the Technology Innovation Program (or Industrial Strategic Technology Development Program)(10082585, Development of deep learning-based open EV platform technology capable of autonomous driving) funded By the Ministry of Trade, Industry & Energy (MOTIE, Korea).

Publisher Copyright:
© 2020 SPIE.


  • Cartesian to polar coordinate transformation
  • Convolutional neural network
  • Interactive segmentation
  • User interaction
  • User interaction-based attention module

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'A deep interactive segmentation method with user interaction-based attention module and polar transformation'. Together they form a unique fingerprint.

Cite this