Back

Embodied Intelligence Unlocks Autonomous Microscopy

Huang, G.; Zhang, Z.; Zhuang, S.; Wu, Y.; Lu, Z.; Tong, M.; Gao, H.

2025-08-18 bioengineering
10.1101/2025.08.13.670210 bioRxiv
Show abstract

Advanced microscopy is a cornerstone of modern science, yet its potential is constrained by a reliance on manual operation, which struggles with the complexity and reproducibility of long-term experiments protocols. While scripting offers a degree of automation, it lacks the generalizability to adapt to new samples or dynamic biological events. A fundamental challenge is the absence of an intelligent system that can interpret high-level scientific intent and ground it in the physical actions of the microscope. To bridge this gap, we introduce an Embodied Intelligent Microscope System (EIMS) with hierarchical reasoning structure that reimagines the microscope autonomous control. This system leverages the advanced reasoning of large models to interpret complex user commands and decompose them into actionable steps. To solve the critical grounding problem, we constrain the models output to the feasible action space, effectively serving as the models "hands and eyes" in the physical world. We demonstrate that our system achieves zero-shot generalization on complex, multi-step protocols and successfully automates challenging biological missions requiring expert-level judgment, such as capturing the sparse spatiotemporal events of cell mitosis and locating scatteredly distributed organoids. This work establishes a new paradigm for scientific instrumentation--fusing high-level intent understanding with grounded, dynamic execution--and provides a generalizable framework for deploying embodied intelligence to accelerate autonomous scientific discovery.

Matching journals

The top 3 journals account for 50% of the predicted probability mass.

1
Nature Methods
385 papers in training set
Top 0.1%
30.9%
2
Nature Communications
5641 papers in training set
Top 12%
15.0%
3
Cell Systems
201 papers in training set
Top 0.4%
7.8%
50% of probability mass above
4
Advanced Intelligent Systems
11 papers in training set
Top 0.1%
6.7%
5
Science
477 papers in training set
Top 3%
2.6%
6
Nature Biotechnology
172 papers in training set
Top 2%
2.6%
7
Science Advances
1243 papers in training set
Top 15%
2.4%
8
Advanced Science
286 papers in training set
Top 3%
2.4%
9
Nature Biomedical Engineering
47 papers in training set
Top 0.5%
2.1%
10
Light: Science & Applications
16 papers in training set
Top 0.1%
2.1%
11
Cell
431 papers in training set
Top 6%
1.7%
12
npj Imaging
12 papers in training set
Top 0.1%
1.7%
13
Nature Machine Intelligence
70 papers in training set
Top 2%
1.4%
14
Proceedings of the National Academy of Sciences
2444 papers in training set
Top 31%
1.4%
15
PLOS Computational Biology
1863 papers in training set
Top 16%
1.3%
16
Journal of Cell Biology
392 papers in training set
Top 3%
1.1%
17
Optica
27 papers in training set
Top 0.2%
1.1%
18
eLife
5828 papers in training set
Top 58%
1.1%
19
ACS Nano
113 papers in training set
Top 2%
1.0%
20
Communications Biology
993 papers in training set
Top 30%
0.8%
21
Scientific Reports
3612 papers in training set
Top 74%
0.8%
22
iScience
1154 papers in training set
Top 35%
0.8%
23
Neuron
337 papers in training set
Top 5%
0.8%
24
ACS Photonics
13 papers in training set
Top 0.3%
0.6%
25
Nature Photonics
10 papers in training set
Top 0.2%
0.6%