Back

PA-SfM: Tracker-free differentiable acoustic radiation for freehand 3D photoacoustic imaging

Li, S.; Gao, J.; Kim, C.; Choi, S.; Chen, Q.; Wang, Y.; Wu, S.; Zhang, Y.; Huang, T.; Zhou, Y.; Yao, B.; Yao, Y.; Li, C.

2026-04-08 bioengineering
10.64898/2026.04.06.716718 bioRxiv
Show abstract

Three-dimensional (3D) handheld photoacoustic tomography typically relies on bulky and expensive external positioning trackers to correct motion artifacts, which severely limits its clinical flexibility and accessibility. To address this challenge, we present PA-SfM, a tracker-free framework that leverages exclusively single-modality photoacoustic data for both sensor pose recovery and high-fidelity 3D reconstruction via differentiable acoustic radiation modeling. Unlike traditional Structure-from-Motion (SfM) methods that formulate pose estimation as a geometry-driven optimization over visual features, PA-SfM integrates the acoustic wave equation into a differentiable programming pipeline. By leveraging a high-performance, GPU-accelerated acoustic radiation kernel, the framework simultaneously optimizes the 3D photoacoustic source distribution and the sensor array pose via gradient descent. To ensure robust convergence in freehand scenarios, we introduce a coarse-to-fine optimization strategy that incorporates geometric consistency checks and rigid-body constraints to eliminate motion outliers. We validated the proposed method through both numerical simulations and in-vivo rat experiments. The results demonstrate that PA-SfM achieves sub-millimeter positioning accuracy and restores high-resolution 3D vascular structures comparable to ground-truth benchmarks, offering a low-cost, softwaredefined solution for clinical freehand photoacoustic imaging. The source code is publicly available at https://github.com/JaegerCQ/PA-SfM.

Matching journals

The top 1 journal accounts for 50% of the predicted probability mass.

1
IEEE Transactions on Medical Imaging
18 papers in training set
Top 0.1%
50.8%
50% of probability mass above
2
Nature Biomedical Engineering
42 papers in training set
Top 0.2%
4.8%
3
Photoacoustics
11 papers in training set
Top 0.1%
3.9%
4
Nature Communications
4913 papers in training set
Top 41%
3.5%
5
IEEE Transactions on Biomedical Engineering
38 papers in training set
Top 0.3%
3.0%
6
Nature Methods
336 papers in training set
Top 3%
3.0%
7
Advanced Science
249 papers in training set
Top 7%
2.6%
8
Optics Letters
13 papers in training set
Top 0.1%
2.1%
9
Biomedical Optics Express
84 papers in training set
Top 0.6%
1.9%
10
PLOS ONE
4510 papers in training set
Top 55%
1.7%
11
Light: Science & Applications
16 papers in training set
Top 0.4%
1.5%
12
NeuroImage
813 papers in training set
Top 5%
1.3%
13
Science Advances
1098 papers in training set
Top 23%
1.2%
14
Communications Biology
886 papers in training set
Top 15%
1.2%
15
Optica
25 papers in training set
Top 0.6%
1.2%
16
Proceedings of the National Academy of Sciences
2130 papers in training set
Top 41%
0.9%
17
ACS Photonics
13 papers in training set
Top 0.4%
0.9%
18
Scientific Reports
3102 papers in training set
Top 72%
0.9%
19
Human Brain Mapping
295 papers in training set
Top 4%
0.8%
20
PLOS Computational Biology
1633 papers in training set
Top 24%
0.8%
21
eLife
5422 papers in training set
Top 56%
0.8%
22
Journal of Biophotonics
16 papers in training set
Top 0.7%
0.7%
23
Bioengineering
24 papers in training set
Top 2%
0.7%
24
Cancer Research
116 papers in training set
Top 4%
0.6%