Interactive delineation and quantification of anatomical structure with virtual reality

BackgroundFull tissue segmentation is laborious, especially for non-model organisms, whereas accurate and reliable delineation still requires much firsthand visual inspection. A virtual environment can be equipped with suitable data representations, interaction techniques, and method interfaces as to enable the interactive delineation and quantification of anatomical structure. Situated in such an environment, analysts can benefit from reduced pre-processing, but also from in-situ learning and collaboration. ResultsTherefore, we apply virtual reality as a method to visualise and derive higher-level anatomical features from low-level descriptors. Following voxel-size calibration, scalable delineations and measurements are performed in virtual reality. The data representation for delineation is volume visualisation: a volume rendering or an isosurface mesh. Two delineation techniques are proposed for the placement and editing of points and segments in virtual reality. For quantification, different measures and metrics can be computed for each delineated region. To mitigate some of the fundamental challenges of virtual reality, e. g., mid-air interaction affecting precision at a distance, different virtual-reality affordances were considered as part of the design. As a result, we present Brainacle, a virtual reality application, and make its usage freely available. We incorporate Brainacle in a synchrotron tomography reconstruction pipeline to delineate and quantify the gross brain regions of 20 individuals from six species of African cichlid fish. ConclusionBrainacle, an editor for the interactive delineation and quantification of anatomical structures in virtual reality, is applicable to different biological pipelines and workflows. In particular, Brainacle can be used to quickly gain an overview of structure, ease repetitive delineation and measurement, and visually inspect and communicate findings.