Measuring chondrocyte viability of articular cartilage based on label-free two-photon microscopy and deep learning image analysis

ObjectiveChondrocyte viability (CV) is an important indicator of articular cartilage health. Two-photon excitation autofluorescence (TPAF) and second harmonic generation (SHG) microscopy provide a label-free method for imaging chondrocytes. In this study, we propose an automated assessment of CV using deep learning cell segmentation and counting based on acquired TPAF/SHG images. DesignLabel-free TPAF/SHG images of cartilage samples from rats and porcine were acquired using both commercial and home-built two-photon microscopes, respectively. TPAF/SHG images were merged to form RGB color images with red, green, and blue channels assigned to TPAF (two channels) and SHG signals, respectively. To make the training datasets for the deep learning networks, individual chondrocyte areas on the RGB color images were manually circled and live or dead chondrocytes were validated by using Calcein-AM and Ethidium homodimer-1 dye labeling. We first built a chondrocyte viability network (MCV-Net) using the Mask R-CNN architecture, which could provide individual segmented cellular areas with live or dead status. Wiener deconvolution preprocessing was added before the input of MCV-Net to improve the accuracy of the CV analysis, forming the Wiener deconvolution CV network (wMCV-Net). ResultsTraining (300 images) and test (120 images) datasets were built for rats and porcine cartilage respectively. Wiener deconvolution could improve the Peak Signal-to-Noise Ratio (PSNR) for 30-40%. We demonstrated that both MCV-Net and wMCV-Net significantly improved the accuracy of the CV measurement. ConclusionA custom desktop TPAF/SHG microscope was used in collaboration with deep learning algorithm wMCV-Net based label-free method to assess the CV and get 95% accuracy with both rats and porcine samples.