Segmentation of Tissues and Proliferating Cells in Light-Sheet Microscopy Images using Convolutional Neural Networks

Background and ObjectiveA variety of genetic mutations are known to affect cell proliferation and apoptosis during organism development, leading to structural birth defects such as facial clefting. Yet, the mechanisms how these alterations influence the development of the face remain unclear. Cell proliferation and its relation to shape variation can be studied in high detail using Light-Sheet Microscopy (LSM) imaging across a range of developmental time points. However, the large number of LSM images captured at cellular resolution precludes manual analysis. Thus, the aim of this work was to develop and evaluate automatic methods to segment tissues and proliferating cells in these images in an accurate and efficient way. MethodsWe developed, trained, and evaluated convolutional neural networks (CNNs) for segmenting tissues, cells, and specifically proliferating cells in LSM datasets. We compared the automatically extracted tissue and cell annotations to corresponding manual segmentations for three specific applications: (i) tissue segmentation (neural ectoderm and mesenchyme) in nuclear-stained LSM images, (ii) cell segmentation in nuclear-stained LSM images, and (iii) segmentation of proliferating cells in Phospho-Histone H3 (PHH3)-stained LSM images. ResultsThe automatic CNN-based tissue segmentation method achieved a macro-average F-score of 0.84 compared to a macro-average F-score of 0.89 comparing corresponding manual segmentations from two observers. The automatic cell segmentation method in nuclear-stained LSM images achieved an F-score of 0.57, while comparing the manual segmentations resulted in an F-score of 0.39. Finally, the automatic segmentation method of proliferating cells in the PHH3-stained LSM datasets achieved an F-score of 0.56 for the automated method, while comparing the manual segmentations resulted in an F-score of 0.45. ConclusionsThe proposed automatic CNN-based framework for tissue and cell segmentation leads to results comparable to the inter-observer agreement, accelerating the LSM image analysis. The trained CNN models can also be applied for shape or morphological analysis of embryos, and more generally in other areas of cell biology.