Super-Resolution Imaging Using a Focus Pixel Sensor

Sung Min Woo; Jeong Won Ha; Jong Ok Kim

Super-Resolution Imaging Using a Focus Pixel Sensor

Sung Min Woo, Jeong Won Ha, Jong Ok Kim

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Modern camera sensors are equipped with a focus pixel, a special type of pixel that can collect separate light rays from the left (L) and right (R) directions. The phase difference between the corresponding L/R pixels is utilized to facilitate quick auto-focusing. In this study, we expand the usability of the special pixels to super-resolve an image. We design a neural net to best fuse multiple low-resolution focus pixel images with a normal image based on repetitive channel and spatial attention layer structures. Empirical results show that focus pixel images contribute to the creation of fine details by providing additional information to super-resolve an image, especially for ured areas and that the proposed neural net-based method enhances the state-of-the-art super-resolution methods that do not use focus pixels in quantitative and qualitative measures.

Original language	English
Title of host publication	2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1698-1702
Number of pages	5
ISBN (Electronic)	9789881476890
Publication status	Published - 2021
Event	2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Tokyo, Japan Duration: 2021 Dec 14 → 2021 Dec 17

Publication series

Name	2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings

Conference

Conference	2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021
Country/Territory	Japan
City	Tokyo
Period	21/12/14 → 21/12/17

Bibliographical note

Funding Information:
This work is supported by the National Research Foundation of Korea(NRF) grant funded by the Koreagovernment (MSIT) (No. 2019R1A2C1005834) and the MSIT(Ministry of Science and ICT), Korea, under the ITRC(Information Technology Research Center) support program(IITP-2021-2020-0-01749) supervised by the IITP(Institute of Information & Communications TechnologyPlanning & Evaluation)

Publisher Copyright:
© 2021 APSIPA.

ASJC Scopus subject areas

Artificial Intelligence
Computer Vision and Pattern Recognition
Signal Processing
Instrumentation

Cite this

Woo, S. M., Ha, J. W., & Kim, J. O. (2021). Super-Resolution Imaging Using a Focus Pixel Sensor. In 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings (pp. 1698-1702). (2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings). Institute of Electrical and Electronics Engineers Inc..

Super-Resolution Imaging Using a Focus Pixel Sensor. / Woo, Sung Min; Ha, Jeong Won; Kim, Jong Ok.
2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2021. p. 1698-1702 (2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Woo, SM, Ha, JW & Kim, JO 2021, Super-Resolution Imaging Using a Focus Pixel Sensor. in 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings. 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings, Institute of Electrical and Electronics Engineers Inc., pp. 1698-1702, 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021, Tokyo, Japan, 21/12/14.

Woo SM, Ha JW, Kim JO. Super-Resolution Imaging Using a Focus Pixel Sensor. In 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2021. p. 1698-1702. (2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings).

Woo, Sung Min ; Ha, Jeong Won ; Kim, Jong Ok. / Super-Resolution Imaging Using a Focus Pixel Sensor. 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2021. pp. 1698-1702 (2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings).

@inproceedings{b1f59460c1cc438d971cffea66669aa3,

title = "Super-Resolution Imaging Using a Focus Pixel Sensor",

abstract = "Modern camera sensors are equipped with a focus pixel, a special type of pixel that can collect separate light rays from the left (L) and right (R) directions. The phase difference between the corresponding L/R pixels is utilized to facilitate quick auto-focusing. In this study, we expand the usability of the special pixels to super-resolve an image. We design a neural net to best fuse multiple low-resolution focus pixel images with a normal image based on repetitive channel and spatial attention layer structures. Empirical results show that focus pixel images contribute to the creation of fine details by providing additional information to super-resolve an image, especially for ured areas and that the proposed neural net-based method enhances the state-of-the-art super-resolution methods that do not use focus pixels in quantitative and qualitative measures. ",

author = "Woo, {Sung Min} and Ha, {Jeong Won} and Kim, {Jong Ok}",

note = "Funding Information: This work is supported by the National Research Foundation of Korea(NRF) grant funded by the Koreagovernment (MSIT) (No. 2019R1A2C1005834) and the MSIT(Ministry of Science and ICT), Korea, under the ITRC(Information Technology Research Center) support program(IITP-2021-2020-0-01749) supervised by the IITP(Institute of Information & Communications TechnologyPlanning & Evaluation) Publisher Copyright: {\textcopyright} 2021 APSIPA.; 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 ; Conference date: 14-12-2021 Through 17-12-2021",

year = "2021",

language = "English",

series = "2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1698--1702",

booktitle = "2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings",

}

TY - GEN

T1 - Super-Resolution Imaging Using a Focus Pixel Sensor

AU - Woo, Sung Min

AU - Ha, Jeong Won

AU - Kim, Jong Ok

N1 - Funding Information: This work is supported by the National Research Foundation of Korea(NRF) grant funded by the Koreagovernment (MSIT) (No. 2019R1A2C1005834) and the MSIT(Ministry of Science and ICT), Korea, under the ITRC(Information Technology Research Center) support program(IITP-2021-2020-0-01749) supervised by the IITP(Institute of Information & Communications TechnologyPlanning & Evaluation) Publisher Copyright: © 2021 APSIPA.

PY - 2021

Y1 - 2021

N2 - Modern camera sensors are equipped with a focus pixel, a special type of pixel that can collect separate light rays from the left (L) and right (R) directions. The phase difference between the corresponding L/R pixels is utilized to facilitate quick auto-focusing. In this study, we expand the usability of the special pixels to super-resolve an image. We design a neural net to best fuse multiple low-resolution focus pixel images with a normal image based on repetitive channel and spatial attention layer structures. Empirical results show that focus pixel images contribute to the creation of fine details by providing additional information to super-resolve an image, especially for ured areas and that the proposed neural net-based method enhances the state-of-the-art super-resolution methods that do not use focus pixels in quantitative and qualitative measures.

AB - Modern camera sensors are equipped with a focus pixel, a special type of pixel that can collect separate light rays from the left (L) and right (R) directions. The phase difference between the corresponding L/R pixels is utilized to facilitate quick auto-focusing. In this study, we expand the usability of the special pixels to super-resolve an image. We design a neural net to best fuse multiple low-resolution focus pixel images with a normal image based on repetitive channel and spatial attention layer structures. Empirical results show that focus pixel images contribute to the creation of fine details by providing additional information to super-resolve an image, especially for ured areas and that the proposed neural net-based method enhances the state-of-the-art super-resolution methods that do not use focus pixels in quantitative and qualitative measures.

UR - http://www.scopus.com/inward/record.url?scp=85126693112&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85126693112

T3 - 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings

SP - 1698

EP - 1702

BT - 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021

Y2 - 14 December 2021 through 17 December 2021

ER -

Super-Resolution Imaging Using a Focus Pixel Sensor

Abstract

Publication series

Conference

Bibliographical note

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this