Optica

Image scanning microscopy (ISM) is emerging as the natural evolution of confocal laser-scanning microscopy, combining optical sectioning and a two-fold improvement in lateral resolution with high signal-to-noise ratio. Single-photon avalanche diode (SPAD) array detectors enable an effective implementation of ISM by recording a micro-image at each scan position with single-photon sensitivity, negligible readout noise, and without the fixed frame-readout constraints of conventional cameras. Nevertheless, SPAD array-based ISM remains largely confined to laboratories with expertise in microscope development. Here, we present BrightEyes-Scope, a reference implementation of a SPAD array-based ISM system. We provide step-by-step guidelines for optical design, system construction, alignment, calibration, data acquisition, and image reconstruction. Presented as a complete ISM microscope, BrightEyes-Scope also serves as a reference for upgrading existing laser-scanning microscopes. We anticipate that it will accelerate the adoption of ISM for quantitative super-resolution imaging.

The Transport-of-Intensity Equation (TIE) and polarization differential phase contrast (pDPC) exhibit transfer characteristics that limit their use as standalone quantitative phase imaging modalities. TIE provides stable recovery of low spatial frequencies but attenuates fine structure, while pDPC enhances phase gradients but is intrinsically insensitive near zero frequency. We present a hybrid reconstruction framework that combines a single-shot pDPC measurement with an in-focus-defocused TIE image pair and fuses the resulting phase estimates in the Fourier domain using frequency-selective weighting. The illumination geometry is co-designed to enforce angular separation between modalities, enabling high-frequency phase-gradient acquisition in a single exposure while preserving low-frequency sensitivity through low-numerical-aperture symmetric illumination. The proposed method requires three intensity measurements without requiring interferometric stability or sequential asymmetric illumination. Experimental results demonstrate improved phase fidelity across spatial frequencies, reduced halo artifacts, and enhanced recovery of both smooth and fine structural features. This approach provides a compact and robust method that moves towards extended spatial-frequency phase imaging for dynamic and resource-constrained applications.

Expansion microscopy (ExM) physically magnifies preserved biological specimens by using a specimen-permeating hydrogel to pull biomolecules, such as proteins, apart from each other. ExM protocols exhibit a tension between the need to initially fix proteins to each other during sample preservation, to retain proteins and their nanoscale organization, and the need to separate proteins from each other isotropically, to achieve physical magnification. We here propose to address this tension by fixing proteins directly to the hydrogel network itself, which then serves as a common substrate for both initial fixation and final separation. We equip proteins with chemical handles, then form a specimen-permeating hydrogel that binds the handles, in a ~15-minute chemical process conducted entirely at -20oC. This network fixation ExM (nfExM) procedure enables excellent epitope retention and nanoscale organization preservation, in cultured cells. nfExM may help support ultrastructural investigations of protein complexes and interactions.

Capturing fast hemodynamics in deep organs is essential for understanding microvascular regulation of organ responses to physiological demands and pathological stress. However, non-invasive three-dimensional (3D) imaging of these microscale processes remains challenging due to trade-offs between spatial resolution, imaging speed, and penetration depth. Here, we present fluctuation-based high-order super-resolution acoustic microscope (FLAME), a tracking-free 3D ultrasound imaging technology capable of fast microvascular angiography and flow measurement. Using as few as 30 volumes, FLAME improves 3D ultrasound resolution by 8-fold (~50 m) and shortens data acquisition time by over two orders of magnitude, from tens of seconds to tens of milliseconds, compared with conventional tracking-based super-resolution approaches1-6. This high-throughput capability supports high-fidelity imaging of tissue functions under flexible experimental settings. FLAME achieves an unprecedented 3D super-resolution frame rate of ~40 Hz, capturing transient hemodynamic responses to various physiological and pathological stimuli in different mouse organs, from the microvascular level to the whole-body scale. With open-sourced implementation, FLAME provides an accessible platform for real-time, in-depth hemodynamic monitoring across diverse biomedical applications and clinical translation.

Raman spectroscopy (RS) has been shown to differentiate various disease states in tissue samples, yet the impact of sample substrate on spectral quality and downstream machine-learning (ML) performance is under-explored. We collected 960 spectra from 36 formalin-fixed, paraffin-embedded colonic specimens mounted in parallel on calcium fluoride (CaF2) and mirrored stainless-steel (SS) slides. Raw SS spectra were more intense than CaF2, and routine dewaxing left prominent paraffin peaks on CaF2 that were largely absent on SS. Extending CaF2 xylene immersion to 48 h reduced key paraffin peaks by 11 to 23%, aligning its biochemical profile with SS. Nested cross-validated classifiers were built to distinguish true disease (T1) from epithelial misplacement (EM). The highest accuracies were observed on SS (0.65 - 0.66), while CaF2 improved from 0.41 - 0.57 to 0.65 - 0.69 after extended dewaxing, chiefly via gains in recall. Although optimal dewaxing renders CaF2 diagnostically non-inferior, SS still offers superior accuracy, faster preparation, at approximately 4% of the cost, supporting its integration into scalable, AI-enabled RS pathology workflows.

Microlasers based on whispering-gallery modes (WGMs) provide bright, spectrally narrow emission, making them ideal optical probes for high-resolution cellular tagging, single-cell tracking, and biosensing. To reproducibly apply WGM microlasers in biomedical or tissue-engineering contexts, control over the number of lasers in a cell population is highly desirable. Here we use a commercial instrument for flow cytometry-based cell sorting to obtain HEK293T cell populations with a controlled number of polystyrene laser particles (LPs). By modifying the particle surface with poly(ethyleneimine) (PEI) or lipofectamine, we enhance LP-association to cells. We demonstrate that our sorting procedure yields viable cells showing unchanged proliferation rates. Manufacturer-dependent differences in particle-cell interactions were observed and investigated by scanning and transmission electron microscopy (SEM/TEM) and flow cytometry. Finally, we show that the same sorting approach enables the generation of multi-cellular spheroids with a defined ratio of LP-containing and LP-free cells. This work lays the foundation for larger tissue engineering studies with defined LP populations and control over LP-placement with respect to the cell.

Fluorescence microscopy is routinely used in the quantitative analysis of Giant Unilamellar Vesicles (GUVs) because it makes GUVs visible and easy to detect. Nonetheless, it requires fluorescence-equipped microscopes and, especially, the addition of tagged molecules that may introduce undesired and unaccounted variations compared to the pristine formulation. Alternatively, phase-contrast microscopy can be used to observe GUVs without labelling, yet the automatic detection of GUVs in phase-contrast images by standard image processing techniques is difficult. To overcome this limitation, we developed a framework for the automated detection and size characterization of label-free GUVs based on YOLOv11 model, a state-of-art lightweight Convolutional Neural Network (CNN) for object detection. Trained on 164 phase-contrast microscope images containing 4666 manually annotated vesicles, the model enables robust detection under low contrast-to-noise ratio and heterogeneous illumination. The trained model is implemented in a stand-alone desktop application supporting multiple analysis in a single run, pixel-to-micrometer calibration, and automated size distribution analysis. This approach achieves high detection accuracy and competitive cross-microscope generalization using YOLOv11 nano on greyscale image. Retraining scripts compatible with standard hardware are also provided to enhance adaptability. This tool enables fast and reliable analysis of GUVs without altering their composition, supporting experimental reproducibility.

Small numbers of cells can determine the fate of an entire organism. For example, metastatic cancer cells seed distant organs, therapy-resistant clones repopulate tumors, and T cells infiltrate and expand in tissues with matching antigens. Visualizing the activity of such cells in living organisms requires highly sensitive, specific and repeatable imaging in optically opaque tissues. Here we introduce cell chirp, an ultrasound imaging method for real-time imaging of single cells in living organs inaccessible to light. Cell chirp exploits the harmonic response of genetically encoded gas vesicles to frequency-coded ultrasound to sensitively and specifically visualize single cells in scattering background. We first develop this method in tissue-mimicking phantoms, demonstrating the ability to quantitatively detect single cells as validated by optical cell counts. We then establish the ability of cell chirp to image thousands of genetically labeled cells within a million-cell background tissue, track reporter gene expression over days, and suppress background signals by more than two orders of magnitude. Finally, we use cell chirp to track the fate of antigen-positive or antigen-negative tumor-cell minorities during weeks-long T-cell engager treatments. Cell chirp reveals the dynamics of sparsely distributed, genetically defined cells in opaque tissues.

Volumetric imaging is increasingly important in fields such as neuroscience, where quantifying structure and mapping features are inherently three-dimensional problems. Block-face serial two-photon tomography (STPT) has emerged as a powerful approach for high-resolution, whole-organ volumetric imaging. STPT avoids complex sample preparation and balances image quality, speed, and scalability. However, STPT remains niche, in part because of the absence of flexible, general-purpose control software. Here we present BakingTray, an open-source software platform for STPT that extends ScanImage. BakingTrays modular framework accommodates diverse hardware configurations and allows users to build systems customised to their needs. Twelve such systems, which we call BrainSaws, have been constructed worldwide since 2016, with more under construction, and have so far contributed to 35 research papers. The three systems at the Sainsbury Wellcome Centre alone have acquired over 7,000 samples in a busy multi-user facility. We demonstrate the platform across its core neuroscience applications: electrode track localisation, brain-wide cell counting, and bulk projection mapping. Beyond these, we map the cell-type-specific synaptic output of inhibitory neurons in the ventral lateral geniculate nucleus and, with whole-mount staining, amyloid plaques brain-wide in a mouse model of Alzheimers disease. BakingTray is a mature platform for groups or facilities needing a customised volumetric imaging solution, whether built new or converted cheaply from an existing two-photon microscope.

Cardiac amyloidosis is caused by deposits of misfolded proteins in the heart and can lead to heart failure. Histological confirmation typically involves staining tissue sections with Congo red and examining them under polarized light for apple-green birefringence; however, achieving an interpretable, label-free, and observer-independent assessment remains challenging. Here we show that Pearson kurtosis of channel intensities within the amide I window provides an interpretable, fitting-free contrast for cardiac amyloid in unstained human cardiac tissue sections from ten participants imaged by ultrabroadband multiplex coherent anti-Stokes Raman scattering (CARS). In a discovery participant, high-kurtosis regions corresponded with Congo red-positive tissue in two CARS-histology pairs of adjacent sections (descriptive spatial AUCs, 0.79 and 0.73). Across 15 fields from nine additional participants, field-level kurtosis values did not overlap between severe-deposition and Congo red-negative tissue fields. Among the descriptors examined, kurtosis showed the largest standardized participant-level separation. Exploratory multivariate curve resolution yielded a deposit-associated component with aromatic-residue features shared with reagent transthyretin. In one field from the discovery participant, the second harmonic generation (SHG) signal, acquired simultaneously with CARS, showed a broadly inverse spatial pattern relative to the amide I kurtosis map, revealing distinct tissue-architectural contrast. Together, these findings support a potential label-free approach to detecting cardiac amyloid deposits that combines amide I kurtosis derived from broadband CARS with SHG-derived architectural contrast.

Optical coherence tomography angiography (OCTA) has been extensively explored for the detection of pathological retinal changes arising in various ophthalmological diseases. Due to phase instability of conventional systems, most OCTA signal processing methods to date have relied on intensity-based averaging, despite the resulting lower contrast and dynamic range compared to coherent averaging approaches. In this work, we (1) present a novel computation pipeline that enables fully-coherent processing in any phase-stable or phase-unstable system, and (2) demonstrate the first angiography metric with integrated signal-to-noise ratio (SNR) correction and coherent spatiotemporal ensemble averaging effective in any OCT system. Our method does not rely on 2D en face projections or binarization to produce high-contrast en face views and it significantly enhances the contrast-to-noise ratio of computed OCTA volumes, particularly in regions with reduced SNR levels. Our OCTA volumes also have high cross-sectional quality, enabling the use of single-depth en face views and the localization of capillary paths in the axial dimension. We can now identify capillaries below the retinal pigment epithelium, near the lamina cribrosa in the optic cup, which was not previously possible due to low SNR. We also conducted an analysis of strategies for bias reduction in OCTA and developed the optimal method utilizing coherent spatiotemporal ensemble averaging. Because our method leverages coherent averaging across all dimensions, it provides flexibility in shaping the averaging kernel to target specific workflows. The value of this additional degree of freedom is illustrated in our vessel tracing investigations, in which the depth resolution was maximized by limiting coherent ensemble averaging to the two lateral dimensions even in presence of strong phase noise, enabling the identification of 3D features such as overlapping capillary paths.

In this paper, we introduce Nagini3D, a 3D biological image segmentation method that hybridizes two high-performing yet highly complementary segmentation paradigms: deep learning-based approaches and snake-based methods. Our approach leverages both the high efficiency of data-driven techniques and the convenient shape representation provided by active surfaces, which proves highly practical for incorporating a priori knowledge as well as for the post-analysis of segmented objects. By considering a complete 3D volume, our method ensures segmentation consistency across all three dimensions, unlike many approaches that handle volumes in a slice-by-slice manner. Additionally, it theoretically enables the representation of any object with spherical topology, overcoming the limitations of common 3D methods that rely on object convexity assumptions. Furthermore, the continuous representation of objects allows for a resolution-independent description, facilitating the extraction of various geometric features of interest (e.g., local curvature, principal deformations). We demonstrate both the quality of the segmentation produced by our method and the richness of the accessible geometric features through an extensive set of experiments conducted on multiple real and simulated datasets, including objects with challenging geometries.

Nuclear segmentation in 3D microscopy remains challenging, particularly for low signal-to-noise ratio (SNR) data from timelapse imaging, in vivo experiments, or dense tissue samples. Yet accurate 3D nuclear segmentation is a prerequisite for quantitative single-cell analysis, making this a key bottleneck for high-throughput study of challenging datasets. We present NucLogic, a fast and robust 3D nuclear segmentation algorithm that combines the maturity of 2D segmentation with geometric stitching rules based on nuclear shape, orientation, and intensity, to reconstruct accurate 3D volumes. NucLogic reliably segments challenging datasets including long-term timelapse imaging of organoids, and large dense structures such as the zebrafish brain. Benchmarked against other state-of-the-art segmentation tools, NucLogic matches F1 scores at high SNR, with increasing outperformance as SNR decreases. Importantly, segmentation completes at 20-50% of the computation time, with greater speed gains on larger images. Beyond segmentation, NucLogic includes an intuitive graphical user interface allowing non-experts to segment, quantify, and visualize 3D and 4D data. This enables easy quantification of cell numbers and integration of a variety of both cell-intrinsic properties, such as phenotype, morphology, and local environment metrics, including density and spatial interactions. Together, NucLogic makes quantitative 3D nuclear analysis of previously unmanageable datasets accessible to a broad research community.

Fluorescence microscopy is a central tool in biomedical image analysis, but its practical use is often constrained by incomplete and heterogeneous data. This is especially true in rare disease research, where patient cohorts are small, biological material is limited, and complex study designs frequently yield images with missing, degraded, or low-quality channels. We introduce Reliability-Mask-Conditioned DDPM (RM-DDPM), a conditional diffusion model that formulates multichannel image generation, missing-channel imputation, and degraded-channel restoration as a single reliability-guided inference problem. The model is trained on a curated subset of complete, high-quality multichannel images using a self-supervised masking objective to learn rich cross-channel dependencies from the available channels. At inference time, reliable observations condition the reverse diffusion process, allowing the same trained model to solve multiple reconstruction tasks without task-specific retraining. We evaluate RM-DDPM against task-specific baselines on one public and two in-house fluorescence microscopy datasets, comprising a rare-disease preclinical model study and a clinical patient cohort. Across these settings, RM-DDPM matches the specialized baselines in reconstruction quality, hallucinates fewer false structures, and remains more robust as degradation severity increases, while repeated sampling provides per-pixel uncertainty maps that flag unreliable reconstructions.

Serial-sectioning electron microscopy allows the exploration of the 3D ultrastructure of cells, tissues or whole organisms. Sample preparation is a critical step for this technique, which determines the quality of downstream imaging and analysis. Here we optimize a high-pressure freezing sample-preparation workflow for larvae of the marine annelid Platynereis dumerilii. We tested several fixation and staining methods and screened a large number of specimens by synchrotron X-ray imaging to evaluate specimen integrity and contrast. We further evaluated selected blocks by array tomography SEM to select the best performing protocols. Our protocols and robust workflow could be adapted to similar marine planktonic organisms including ciliated invertebrate larvae.

Significance: Fluorescence imaging remains largely qualitative and device-specific, limiting reproducibility and intersystem comparisons. SI-traceable radiometric characterization requires calibrated sources suitable for transferring known radiance to imaging systems. Aim: Establish and evaluate a compact, calibrated solid-state radiometric emitter target (RET) for SI-traceable radiance transfer, and assess methods for evaluating radiance invariance, imager responsivity, and extension of radiance transfer to digitally defined regions of interest (ROIs). Approach: The radiance invariance of an LED-based RET was evaluated by measuring its radiance across varying source-to-aperture distances and collection apertures. A previously described radiance-transfer formalism based on calibrated source radiance and collection geometry was implemented to determine imager responsivity (R{lambda}), which was evaluated across varying working distances and lens apertures. Grubbs and MAD outlier tests and one-way ANOVA were used to assess radiance and responsivity invariance. Finally, responsivity obtained using digitally defined ROIs was compared with matched physical apertures to assess ROI-based radiance transfer. Results: The measured RET radiance remained invariant across the tested source-to-aperture distances and collection apertures, with no significant differences observed across distance (p = 0.88) or aperture (p = 0.15). Imager responsivity remained stable across working distances for both tested lens configurations (p = 0.48 and p > 0.99). Responsivity was also invariant across lens apertures, except for deviations at f/11 that were consistent with practical aperture tolerances. Digitally defined ROIs reproduced responsivity values obtained using matched physical apertures, demonstrating that the radiance-transfer approach can be extended to image-defined regions. Conclusions: The presented methods provide an approach for evaluating compact LED-based sources for invariant-radiance emission and suitability for SI-traceable radiance transfer. The characterized RET supported stable imager responsivity across changes in imaging geometry and extension to digitally defined ROIs. These methods can be adapted to other LED-based sources, with further angular characterization and uncertainty analysis needed to establish broader applicability.

Extracellular signal-regulated kinase (ERK) governs many cellular processes, and its spatiotemporal activity dynamics are important for downstream signaling specificity. Existing fluorescent ERK activity biosensors, however, fall short in enabling spectrally multiplexed, spatially resolved, or deep tissue measurements. Here, we introduce a chemigenetic, single-fluorophore biosensor, WHaloEKAR, that reports ERK activities through changes in fluorescence lifetime. WHaloEKAR combines large lifetime changes (-0.81 ns) with the spectral versatility of the self-labeling protein HaloTag giving access to orange, red, and far-red ERK biosensors. The latter enabled the investigation of heterogeneous ERK activity at distinct subcellular locations in cultured cell lines and primary cortical rat neurons via fluorescence lifetime imaging microscopy (FLIM). Moreover, multiplexed FLIM measurements allowed to study ERK activity in parallel to the second messengers calcium and cyclic adenosine monophosphate. Finally, WHaloEKAR enabled the investigation of ERK activity in 3D samples as well as in live animals.

Perovskite quantum dots (PQDs) are exceptionally promising next-generation optical materials for bioimaging applications. This paper presents an optical PQDs nanocomposite method to identify bacterial species associated with breast cancer, employing a LSTM deep learning model. The results indicate that the developed PQD-based nano-sensor offers impressive sensitivity, selectivity, and practical application. The four bacterial species identified in the study, Pseudomonas aeruginosa, Vibrio parvula, Acinetobacter baumannii, and Streptococcus vestibularis, were considered the most relevant indicators of breast cancer. With rapid detection, an intuitive design, and improved reliability, the PQD sensor could be an excellent breast cancer diagnostic tool for a point-of-care application. Furthermore, it has the potential to be integrated into healthcare systems, specifically in resource-limited settings, thereby improving the accessibility and efficiency of early breast cancer detection.

Background and Objective: High-speed and high-resolution retinal imaging using adaptive optics line confocal ophthalmoscopy (AOLCO) resolves individual red blood cells (erythrocytes) flowing through the smallest retinal capillaries, but quantifying their velocity first requires removing linear and nonlinear distortions caused by eye motion that may result in a displacement of tens to hundreds of pixels between frames. We present a computational pipeline that stabilizes AOLCO capillary video and measures erythrocyte velocity in true physical units, delivered as an interactive 3D Slicer extension and a batch command-line tool sharing one analysis core. Methods: Our video analysis pipeline has four stages: preprocessing, registration, postprocessing, and velocity measurement. During preprocessing, illumination is corrected, and closed-eye frames are identified. During registration, each frame is aligned to a reference frame using affine and, when needed, B-Spline registration, initialized by our robust and fast (GPU-based) translation-registration algorithm to accommodate large eye movements (e.g., microsaccades). During postprocessing, adjacent registered frames are differenced to suppress stationary structures, and a 2D projection of the frame-difference video reveals the capillary network. During velocity measurement, an operator manually identifies capillary segments on the 2D projection image. Spatiotemporal images are then generated along these segments from the frame-difference video, and blood-flow velocity curves are obtained from these images using the Radon transform. Results: We validate the velocimetry of the pipeline against synthetic ground-truth flow data, and the experiments show that the velocimetry recovers the speed within an error of 4% The GPU-based translation registration algorithm aligns the large eye motions (~90 um per frame on average) and runs about 3.6 x (100 Hz) to 38 x (400 Hz) faster than the baseline method. Across the full cohort (2344 videos, 57 subjects, 30 Hz to 400 Hz), our registration approach improves structural similarity (SSIM) of the video frames on every acquisition from 0.73 to 0.86. The recovered blood flow velocities are physiologically plausible, of the same order as published AO measurements. Conclusions: Our computational pipeline enables AOLCO velocimetry on the capillary-level.

Two-photon calcium imaging enables measurements of neural activity from individual neurons and their subcellular processes in awake animals. Axial brain motion can change measured fluorescence independently of neural activity and move small structures out of the imaging plane, confounding two-photon calcium measurements in behaving animals. We developed two complementary post-acquisition methods, selected according to whether the imaged structure remains detectable across the encountered depth range. When it does, z-stack correction estimates imaging depth from a separately acquired reference z-stack and uses an axial fluorescence profile specific to each neural structure to rescale fluorescence to a common reference depth. When a structure can leave a single imaging plane, volume-based z-registration reconstructs a common-depth movie from repeated acquisitions of closely spaced planes. In awake mice, both methods tracked experimentally imposed axial displacements within the sampled range, with depth-estimation root mean squared errors (RMSEs) below 1 m for z-stack correction and 0.69-1.03 m for volume-based z-registration. Correction changed fluorescence substantially for a subset of somata, with larger effects in axonal boutons. Both methods are implemented in suite2p-in-depth, a Python package that integrates with Suite2p and provides diagnostics for depth estimation, correction quality and data reliability. Together, these methods enable axial-motion artifacts to be assessed and corrected within established Suite2p workflows.