Back

Deep learning-based aberration compensation improves contrast and resolution in fluorescence microscopy

Guo, M.; Wu, Y.; Su, Y.; Qian, S.; Krueger, E.; Christensen, R.; Kroeschell, G.; Bui, J.; Chaw, M.; Zhang, L.; Liu, J.; Hou, X.; Han, X.; Ma, X.; Zhovmer, A.; Combs, C.; Moyle, M.; Yemini, E.; Liu, H.; Liu, Z.; La Riviere, P.; Colon-Ramos, D.; Shroff, H.

2023-10-18 bioengineering
10.1101/2023.10.15.562439 bioRxiv
Show abstract

Optical aberrations hinder fluorescence microscopy of thick samples, reducing image signal, contrast, and resolution. Here we introduce a deep learning-based strategy for aberration compensation, improving image quality without slowing image acquisition, applying additional dose, or introducing more optics into the imaging path. Our method (i) introduces synthetic aberrations to images acquired on the shallow side of image stacks, making them resemble those acquired deeper into the volume and (ii) trains neural networks to reverse the effect of these aberrations. We use simulations and experiments to show that applying the trained de-aberration networks outperforms alternative methods, providing restoration on par with adaptive optics techniques; and subsequently apply the networks to diverse datasets captured with confocal, light-sheet, multi-photon, and super-resolution microscopy. In all cases, the improved quality of the restored data facilitates qualitative image inspection and improves downstream image quantitation, including orientational analysis of blood vessels in mouse tissue and improved membrane and nuclear segmentation in C. elegans embryos.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
Optica
25 papers in training set
Top 0.1%
12.4%
2
Nature Communications
4913 papers in training set
Top 17%
10.3%
3
Light: Science & Applications
16 papers in training set
Top 0.1%
10.0%
4
ACS Photonics
13 papers in training set
Top 0.1%
9.0%
5
Nature Methods
336 papers in training set
Top 2%
6.2%
6
Optics Express
23 papers in training set
Top 0.1%
6.2%
50% of probability mass above
7
Scientific Reports
3102 papers in training set
Top 32%
3.9%
8
Biomedical Optics Express
84 papers in training set
Top 0.4%
3.9%
9
Communications Biology
886 papers in training set
Top 3%
3.2%
10
ACS Nano
99 papers in training set
Top 1%
2.8%
11
PLOS ONE
4510 papers in training set
Top 49%
2.1%
12
IEEE Transactions on Medical Imaging
18 papers in training set
Top 0.2%
2.1%
13
Advanced Science
249 papers in training set
Top 9%
2.1%
14
Bioinformatics
1061 papers in training set
Top 7%
2.1%
15
Nano Letters
63 papers in training set
Top 1%
1.9%
16
Journal of Microscopy
18 papers in training set
Top 0.2%
1.9%
17
Optics Letters
13 papers in training set
Top 0.2%
1.3%
18
Cell Systems
167 papers in training set
Top 9%
1.2%
19
Science
429 papers in training set
Top 17%
1.2%
20
Science Advances
1098 papers in training set
Top 24%
1.1%
21
Journal of Cell Biology
333 papers in training set
Top 3%
0.9%
22
Proceedings of the National Academy of Sciences
2130 papers in training set
Top 40%
0.9%
23
PLOS Computational Biology
1633 papers in training set
Top 24%
0.8%
24
Nature Biotechnology
147 papers in training set
Top 7%
0.7%
25
HardwareX
16 papers in training set
Top 0.4%
0.6%
26
BMC Methods
11 papers in training set
Top 0.2%
0.6%