A two-stream symmetric network with bidirectional ensemble for aerial image matching

Jae Hyun Park, Woo Jeoung Nam, Seong Whan Lee

Research output: Contribution to journalArticlepeer-review

30 Citations (Scopus)


In this paper, we propose a novel method to precisely match two aerial images that were obtained in different environments via a two-stream deep network. By internally augmenting the target image, the network considers the two-stream with the three input images and reflects the additional augmented pair in the training. As a result, the training process of the deep network is regularized and the network becomes robust for the variance of aerial images. Furthermore, we introduce an ensemble method that is based on the bidirectional network, which is motivated by the isomorphic nature of the geometric transformation. We obtain two global transformation parameters without any additional network or parameters, which alleviate asymmetric matching results and enable significant improvement in performance by fusing two outcomes. For the experiment, we adopt aerial images from Google Earth and the International Society for Photogrammetry and Remote Sensing (ISPRS). To quantitatively assess our result, we apply the probability of correct keypoints (PCK) metric, which measures the degree of matching. The qualitative and quantitative results show the sizable gap of performance compared to the conventional methods for matching the aerial images. All code and our trained model, as well as the dataset are available online.

Original languageEnglish
Article number465
JournalRemote Sensing
Issue number3
Publication statusPublished - 2020 Feb 1

Bibliographical note

Funding Information:
This work was supported by the Agency for Defense Development (ADD) and the Defense Acquisition Program Administration (DAPA) of Korea (UC160016FD). The authors would like to thank the anonymous reviewers for their valuable suggestions to improve the quality of this paper.

Publisher Copyright:
© 2020 by the authors.


  • Aerial image
  • End-to-end trainable network
  • Ensemble
  • Gemetric transformation
  • Image matching
  • Image registration

ASJC Scopus subject areas

  • General Earth and Planetary Sciences


Dive into the research topics of 'A two-stream symmetric network with bidirectional ensemble for aerial image matching'. Together they form a unique fingerprint.

Cite this