Learn-Explain-Reinforce: Counterfactual Reasoning and its Guidance to Reinforce an Alzheimer's Disease Diagnosis Model

Kwanseok Oh, Jee Seok Yoon, Heung Il Suk

    Research output: Contribution to journalArticlepeer-review

    14 Citations (Scopus)

    Abstract

    Existing studies on disease diagnostic models focus either on diagnostic model learning for performance improvement or on the visual explanation of a trained diagnostic model. We propose a novel learn-explain-reinforce (LEAR) framework that unifies diagnostic model learning, visual explanation generation (explanation unit), and trained diagnostic model reinforcement (reinforcement unit) guided by the visual explanation. For the visual explanation, we generate a counterfactual map that transforms an input sample to be identified as an intended target label. For example, a counterfactual map can localize hypothetical abnormalities within a normal brain image that may cause it to be diagnosed with Alzheimer's disease (AD). We believe that the generated counterfactual maps represent data-driven knowledge about a target task, i.e., AD diagnosis using structural MRI, which can be a vital source of information to reinforce the generalization of the trained diagnostic model. To this end, we devise an attention-based feature refinement module with the guidance of the counterfactual maps. The explanation and reinforcement units are reciprocal and can be operated iteratively. Our proposed approach was validated via qualitative and quantitative analysis on the ADNI dataset. Its comprehensibility and fidelity were demonstrated through ablation studies and comparisons with existing methods.

    Original languageEnglish
    Pages (from-to)4843-4857
    Number of pages15
    JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
    Volume45
    Issue number4
    DOIs
    Publication statusPublished - 2023 Apr 1

    Bibliographical note

    Publisher Copyright:
    © 1979-2012 IEEE.

    Keywords

    • Alzheimer's disease
    • Visual explanation
    • counterfactual reasoning
    • deep learning
    • explainable AI (XAI)
    • explanation-guided attention
    • representation reinforcement
    • structural magnetic resonance imaging

    ASJC Scopus subject areas

    • Software
    • Artificial Intelligence
    • Applied Mathematics
    • Computer Vision and Pattern Recognition
    • Computational Theory and Mathematics

    Fingerprint

    Dive into the research topics of 'Learn-Explain-Reinforce: Counterfactual Reasoning and its Guidance to Reinforce an Alzheimer's Disease Diagnosis Model'. Together they form a unique fingerprint.

    Cite this