Back

Physics-Informed Ellipsoidal Coordinate Encoding Implicit Neural Representation for high-resolution volumetric wide-field microscopy

Zhou, Y.; Xu, C.; Jin, Z.; Chen, Y.; Zheng, B.; Wang, M.; Xiong, B.; Cao, X.; Gu, N.

2024-10-17 cell biology
10.1101/2024.10.17.618813 bioRxiv
Show abstract

Wide-field fluorescence microscopy through axial scanning provides a simple way for volumetric imaging of cellular and intracellular activities, but the optical transfer function (OTF) of wide-field microscopy suffers from axial frequency deficiencies, leading to strong interference from out-of-focus fluorescence signals and reduced imaging quality. Richardson-Lucy (RL) deconvolution and its variants are commonly employed to reduce inter-plane signal interference of wide-field microscopy. However, these methods are still affected by the "missing cone" issue inherent in the OTF, compromising both the axial resolution and optical sectioning capability. Existing deep learning methods could realize high-fidelity 3D image stack restoration, but relying on high-quality paired datasets or specific assumptions about sample distributions. Here, we propose a novel method named physics-informed ellipsoidal coordinate encoding implicit neural representation (PIECE-INR), to tackle the challenges of background signal interference and resolution loss in axial scanning image stacks using the wide-field microscopy. In PIECE-INR, we integrate the wide-field fluorescence imaging model with the self-supervised INR network for high-fidelity reconstruction of 3D fluorescence data without the need of additional ground truth data for training. We further design a novel ellipsoidal coordinate encoding based on the systems OTF constraints and incorporate implicit priors derived from the physical model as the loss function into the reconstruction process. Our approach enables block-wise reconstruction of large-scale images by using localized physical information. We demonstrate state-of-the-art performance of our PIECE-INR method in volumetric imaging of live HeLa cells, large-volume C. elegans whole-embryo, and mitochondrial dynamics.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
Nature Communications
5641 papers in training set
Top 9%
18.4%
2
Light: Science & Applications
16 papers in training set
Top 0.1%
12.6%
3
Nature Methods
385 papers in training set
Top 0.9%
10.9%
4
Optica
27 papers in training set
Top 0.1%
5.1%
5
Communications Biology
993 papers in training set
Top 3%
4.3%
50% of probability mass above
6
Scientific Reports
3612 papers in training set
Top 27%
4.0%
7
Advanced Science
286 papers in training set
Top 2%
3.4%
8
Journal of Microscopy
20 papers in training set
Top 0.1%
3.4%
9
npj Imaging
12 papers in training set
Top 0.1%
3.2%
10
Optics Express
26 papers in training set
Top 0.1%
3.2%
11
Biomedical Optics Express
95 papers in training set
Top 0.5%
2.4%
12
Journal of Cell Biology
392 papers in training set
Top 2%
2.1%
13
Science Advances
1243 papers in training set
Top 18%
1.9%
14
Nature Machine Intelligence
70 papers in training set
Top 1%
1.9%
15
Bioinformatics
1204 papers in training set
Top 7%
1.7%
16
eLife
5828 papers in training set
Top 49%
1.7%
17
Biophysical Journal
631 papers in training set
Top 4%
1.1%
18
Cell Reports Methods
165 papers in training set
Top 3%
1.1%
19
Nature Biotechnology
172 papers in training set
Top 3%
1.1%
20
Patterns
78 papers in training set
Top 2%
1.1%
21
Small Methods
29 papers in training set
Top 0.6%
1.0%
22
Journal of Structural Biology
64 papers in training set
Top 0.6%
1.0%
23
Proceedings of the National Academy of Sciences
2444 papers in training set
Top 42%
0.8%
24
Biophysical Reports
37 papers in training set
Top 0.6%
0.6%
25
Journal of Structural Biology: X
17 papers in training set
Top 0.3%
0.6%
26
PLOS Computational Biology
1863 papers in training set
Top 22%
0.6%