Solving Blind Inverse Problem in Microscopy: Diffusion-based Zero-shot Isotropic Reconstruction

Hyun Jung Lee, Eunjung Jo, Minjoo Lim, Ji Hye Oh, Tae Eui Kam

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Volumetric fluorescence microscopy is crucial for non-invasive three-dimension (3D) visualization of biological systems but faces challenges due to anisotropic blurring caused by the point spread function (PSF). Previous methods have struggled with adapting to the diverse PSFs and have not effectively addressed their overall impacts of PSF. We propose Isotropic Diffusion Posterior Sampling (IsotropicDPS), solving isotropic reconstruction as a blind inverse problem. Our method employs two specialized score-based diffusion models, each trained on high-resolution lateral images and a diverse set of blurring PSFs. This approach enables the joint estimation of both the clean axial images and the PSF through a conditional posterior sampling strategy with a parallel reverse diffusion process. Remarkably, IsotropicDPS achieves zero-shot reconstruction and PSF estimation without requiring axial images during training. We validated our method through experiments on synthetic and real data, demonstrating superior performance and adaptability to varying PSF scenarios compared to existing methods.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024
EditorsMario Cannataro, Huiru Zheng, Lin Gao, Jianlin Cheng, Joao Luis de Miranda, Ester Zumpano, Xiaohua Hu, Young-Rae Cho, Taesung Park
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3384-3387
Number of pages4
ISBN (Electronic)9798350386226
DOIs
Publication statusPublished - 2024
Event2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024 - Lisbon, Portugal
Duration: 2024 Dec 32024 Dec 6

Publication series

NameProceedings - 2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024

Conference

Conference2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024
Country/TerritoryPortugal
CityLisbon
Period24/12/324/12/6

Bibliographical note

Publisher Copyright:
© 2024 IEEE.

Keywords

  • Blind Inverse Problem
  • Diffusion Models
  • Isotropic Reconstruction
  • PSF

ASJC Scopus subject areas

  • Artificial Intelligence
  • Biomedical Engineering
  • Modelling and Simulation
  • Medicine (miscellaneous)
  • Computer Vision and Pattern Recognition
  • Health Informatics
  • Radiology Nuclear Medicine and imaging

Fingerprint

Dive into the research topics of 'Solving Blind Inverse Problem in Microscopy: Diffusion-based Zero-shot Isotropic Reconstruction'. Together they form a unique fingerprint.

Cite this