Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing

  • Hojin Jang*
  • , Frank Tong
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Although convolutional neural networks (CNNs) provide a promising model for understanding human vision, most CNNs lack robustness to challenging viewing conditions, such as image blur, whereas human vision is much more reliable. Might robustness to blur be attributable to vision during infancy, given that acuity is initially poor but improves considerably over the first several months of life? Here, we evaluated the potential consequences of such early experiences by training CNN models on face and object recognition tasks while gradually reducing the amount of blur applied to the training images. For CNNs trained on blurry to clear faces, we observed sustained robustness to blur, consistent with a recent report by Vogelsang and colleagues (2018). By contrast, CNNs trained with blurry to clear objects failed to retain robustness to blur. Further analyses revealed that the spatial frequency tuning of the two CNNs was profoundly different. The blurry to clear face-trained network successfully retained a preference for low spatial frequencies, whereas the blurry to clear object-trained CNN exhibited a progressive shift toward higher spatial frequencies. Our findings provide novel computational evidence showing how face recognition, unlike object recognition, allows for more holistic processing. Moreover, our results suggest that blurry vision during infancy is insufficient to account for the robustness of adult vision to blurry objects.

Original languageEnglish
Pages (from-to)1-18
Number of pages18
JournalJournal of Vision
Volume21
Issue number12
DOIs
Publication statusPublished - 2021
Externally publishedYes

Bibliographical note

Publisher Copyright:
© Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Keywords

  • deep learning
  • face perception
  • visual development

ASJC Scopus subject areas

  • Ophthalmology
  • Sensory Systems

Fingerprint

Dive into the research topics of 'Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing'. Together they form a unique fingerprint.

Cite this