Super-Resolution Imaging Using a Focus Pixel Sensor

Sung Min Woo, Jeong Won Ha, Jong Ok Kim

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Modern camera sensors are equipped with a focus pixel, a special type of pixel that can collect separate light rays from the left (L) and right (R) directions. The phase difference between the corresponding L/R pixels is utilized to facilitate quick auto-focusing. In this study, we expand the usability of the special pixels to super-resolve an image. We design a neural net to best fuse multiple low-resolution focus pixel images with a normal image based on repetitive channel and spatial attention layer structures. Empirical results show that focus pixel images contribute to the creation of fine details by providing additional information to super-resolve an image, especially for ured areas and that the proposed neural net-based method enhances the state-of-the-art super-resolution methods that do not use focus pixels in quantitative and qualitative measures.

    Original languageEnglish
    Title of host publication2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages1698-1702
    Number of pages5
    ISBN (Electronic)9789881476890
    Publication statusPublished - 2021
    Event2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Tokyo, Japan
    Duration: 2021 Dec 142021 Dec 17

    Publication series

    Name2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021 - Proceedings

    Conference

    Conference2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021
    Country/TerritoryJapan
    CityTokyo
    Period21/12/1421/12/17

    Bibliographical note

    Funding Information:
    This work is supported by the National Research Foundation of Korea(NRF) grant funded by the Koreagovernment (MSIT) (No. 2019R1A2C1005834) and the MSIT(Ministry of Science and ICT), Korea, under the ITRC(Information Technology Research Center) support program(IITP-2021-2020-0-01749) supervised by the IITP(Institute of Information & Communications TechnologyPlanning & Evaluation)

    Publisher Copyright:
    © 2021 APSIPA.

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Vision and Pattern Recognition
    • Signal Processing
    • Instrumentation

    Fingerprint

    Dive into the research topics of 'Super-Resolution Imaging Using a Focus Pixel Sensor'. Together they form a unique fingerprint.

    Cite this