Image aesthetic assessment based on pairwise comparison - A unified approach to score regression, binary classification, and personalization

Jun Tae Lee; Chang Su Kim

doi:10.1109/ICCV.2019.00128

Image aesthetic assessment based on pairwise comparison - A unified approach to score regression, binary classification, and personalization

Jun Tae Lee, Chang Su Kim

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

48 Citations (Scopus)

Abstract

We propose a unified approach to three tasks of aesthetic score regression, binary aesthetic classification, and personalized aesthetics. First, we develop a comparator to estimate the ratio of aesthetic scores for two images. Then, we construct a pairwise comparison matrix for multiple reference images and an input image, and predict the aesthetic score of the input via the eigenvalue decomposition of the matrix. By varying the reference images, the proposed algorithm can be used for binary aesthetic classification and personalized aesthetics, as well as generic score regression. Experimental results demonstrate that the proposed unified algorithm provides the state-of-the-art performances in all three tasks of image aesthetics.

Original language	English
Title of host publication	Proceedings - 2019 International Conference on Computer Vision, ICCV 2019
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1191-1200
Number of pages	10
ISBN (Electronic)	9781728148038
DOIs	https://doi.org/10.1109/ICCV.2019.00128
Publication status	Published - 2019 Oct
Event	17th IEEE/CVF International Conference on Computer Vision, ICCV 2019 - Seoul, Korea, Republic of Duration: 2019 Oct 27 → 2019 Nov 2

Publication series

Name	Proceedings of the IEEE International Conference on Computer Vision
ISSN (Print)	1550-5499

Conference

Conference	17th IEEE/CVF International Conference on Computer Vision, ICCV 2019
Country/Territory	Korea, Republic of
City	Seoul
Period	19/10/27 → 19/11/2

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

ASJC Scopus subject areas

Software
Computer Vision and Pattern Recognition

Access to Document

10.1109/ICCV.2019.00128

Cite this

Lee, J. T., & Kim, C. S. (2019). Image aesthetic assessment based on pairwise comparison - A unified approach to score regression, binary classification, and personalization. In Proceedings - 2019 International Conference on Computer Vision, ICCV 2019 (pp. 1191-1200). Article 9009059 (Proceedings of the IEEE International Conference on Computer Vision). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCV.2019.00128

Image aesthetic assessment based on pairwise comparison - A unified approach to score regression, binary classification, and personalization. / Lee, Jun Tae; Kim, Chang Su.
Proceedings - 2019 International Conference on Computer Vision, ICCV 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 1191-1200 9009059 (Proceedings of the IEEE International Conference on Computer Vision).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Lee, JT & Kim, CS 2019, Image aesthetic assessment based on pairwise comparison - A unified approach to score regression, binary classification, and personalization. in Proceedings - 2019 International Conference on Computer Vision, ICCV 2019., 9009059, Proceedings of the IEEE International Conference on Computer Vision, Institute of Electrical and Electronics Engineers Inc., pp. 1191-1200, 17th IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea, Republic of, 19/10/27. https://doi.org/10.1109/ICCV.2019.00128

Lee JT, Kim CS. Image aesthetic assessment based on pairwise comparison - A unified approach to score regression, binary classification, and personalization. In Proceedings - 2019 International Conference on Computer Vision, ICCV 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 1191-1200. 9009059. (Proceedings of the IEEE International Conference on Computer Vision). doi: 10.1109/ICCV.2019.00128

Lee, Jun Tae ; Kim, Chang Su. / Image aesthetic assessment based on pairwise comparison - A unified approach to score regression, binary classification, and personalization. Proceedings - 2019 International Conference on Computer Vision, ICCV 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 1191-1200 (Proceedings of the IEEE International Conference on Computer Vision).

@inproceedings{69e8c56e9efd4b8c836502011b75028d,

title = "Image aesthetic assessment based on pairwise comparison - A unified approach to score regression, binary classification, and personalization",

abstract = "We propose a unified approach to three tasks of aesthetic score regression, binary aesthetic classification, and personalized aesthetics. First, we develop a comparator to estimate the ratio of aesthetic scores for two images. Then, we construct a pairwise comparison matrix for multiple reference images and an input image, and predict the aesthetic score of the input via the eigenvalue decomposition of the matrix. By varying the reference images, the proposed algorithm can be used for binary aesthetic classification and personalized aesthetics, as well as generic score regression. Experimental results demonstrate that the proposed unified algorithm provides the state-of-the-art performances in all three tasks of image aesthetics.",

author = "Lee, {Jun Tae} and Kim, {Chang Su}",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 17th IEEE/CVF International Conference on Computer Vision, ICCV 2019 ; Conference date: 27-10-2019 Through 02-11-2019",

year = "2019",

month = oct,

doi = "10.1109/ICCV.2019.00128",

language = "English",

series = "Proceedings of the IEEE International Conference on Computer Vision",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1191--1200",

booktitle = "Proceedings - 2019 International Conference on Computer Vision, ICCV 2019",

}

TY - GEN

T1 - Image aesthetic assessment based on pairwise comparison - A unified approach to score regression, binary classification, and personalization

AU - Lee, Jun Tae

AU - Kim, Chang Su

PY - 2019/10

Y1 - 2019/10

N2 - We propose a unified approach to three tasks of aesthetic score regression, binary aesthetic classification, and personalized aesthetics. First, we develop a comparator to estimate the ratio of aesthetic scores for two images. Then, we construct a pairwise comparison matrix for multiple reference images and an input image, and predict the aesthetic score of the input via the eigenvalue decomposition of the matrix. By varying the reference images, the proposed algorithm can be used for binary aesthetic classification and personalized aesthetics, as well as generic score regression. Experimental results demonstrate that the proposed unified algorithm provides the state-of-the-art performances in all three tasks of image aesthetics.

AB - We propose a unified approach to three tasks of aesthetic score regression, binary aesthetic classification, and personalized aesthetics. First, we develop a comparator to estimate the ratio of aesthetic scores for two images. Then, we construct a pairwise comparison matrix for multiple reference images and an input image, and predict the aesthetic score of the input via the eigenvalue decomposition of the matrix. By varying the reference images, the proposed algorithm can be used for binary aesthetic classification and personalized aesthetics, as well as generic score regression. Experimental results demonstrate that the proposed unified algorithm provides the state-of-the-art performances in all three tasks of image aesthetics.

UR - http://www.scopus.com/inward/record.url?scp=85081938182&partnerID=8YFLogxK

U2 - 10.1109/ICCV.2019.00128

DO - 10.1109/ICCV.2019.00128

M3 - Conference contribution

AN - SCOPUS:85081938182

T3 - Proceedings of the IEEE International Conference on Computer Vision

SP - 1191

EP - 1200

BT - Proceedings - 2019 International Conference on Computer Vision, ICCV 2019

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 17th IEEE/CVF International Conference on Computer Vision, ICCV 2019

Y2 - 27 October 2019 through 2 November 2019

ER -

Image aesthetic assessment based on pairwise comparison - A unified approach to score regression, binary classification, and personalization

Abstract

Publication series

Conference

Bibliographical note

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this