Automatic Localization of Landmarks in Craniomaxillofacial CBCT Images Using a Local Attention-Based Graph Convolution Network

Yankun Lang, Chunfeng Lian, Deqiang Xiao, Hannah Deng, Peng Yuan, Jaime Gateno, Steve G.F. Shen, David M. Alfi, Pew Thian Yap, James J. Xia, Dinggang Shen

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    16 Citations (Scopus)

    Abstract

    Landmark localization is an important step in quantifying craniomaxillofacial (CMF) deformities and designing treatment plans of reconstructive surgery. However, due to the severity of deformities and defects (partially missing anatomy), it is difficult to automatically and accurately localize a large set of landmarks simultaneously. In this work, we propose two cascaded networks for digitizing 60 anatomical CMF landmarks in cone-beam computed tomography (CBCT) images. The first network is a U-Net that outputs heatmaps for landmark locations and landmark features extracted with a local attention mechanism. The second network is a graph convolution network that takes the features extracted by the first network as input and determines whether each landmark exists via binary classification. We evaluated our approach on 50 sets of CBCT scans of patients with CMF deformities and compared them with state-of-the-art methods. The results indicate that our approach can achieve an average detection error of 1.47 mm with a false positive rate of 19%, outperforming related methods.

    Original languageEnglish
    Title of host publicationMedical Image Computing and Computer Assisted Intervention – MICCAI 2020 - 23rd International Conference, Proceedings
    EditorsAnne L. Martel, Purang Abolmaesumi, Danail Stoyanov, Diana Mateus, Maria A. Zuluaga, S. Kevin Zhou, Daniel Racoceanu, Leo Joskowicz
    PublisherSpringer Science and Business Media Deutschland GmbH
    Pages817-826
    Number of pages10
    ISBN (Print)9783030597184
    DOIs
    Publication statusPublished - 2020
    Event23rd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2020 - Lima, Peru
    Duration: 2020 Oct 42020 Oct 8

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume12264 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference23rd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2020
    Country/TerritoryPeru
    CityLima
    Period20/10/420/10/8

    Bibliographical note

    Publisher Copyright:
    © 2020, Springer Nature Switzerland AG.

    Keywords

    • Craniomaxillofacial (CMF) surgery
    • Deep learning
    • GCN
    • Landmark localization

    ASJC Scopus subject areas

    • Theoretical Computer Science
    • General Computer Science

    Fingerprint

    Dive into the research topics of 'Automatic Localization of Landmarks in Craniomaxillofacial CBCT Images Using a Local Attention-Based Graph Convolution Network'. Together they form a unique fingerprint.

    Cite this