Ensembles of temporal models and forward-backward smoothing for surgical phase recognition
Bhattacharyya, K.; Zia, A.; Jarc, A.
Show abstract
Surgical phase recognition from endoscopic video could enable numerous context-aware technologies that impact efficiency and performance of surgeons and minimally invasive care teams. However, surgical phases can vary greatly (from seconds to minutes) due to patient factors and surgeon workflows along with many other reasons. Given this wide range of phase durations, fixed temporal parameters of neural networks and machine learning models constrain surgical phases with different temporal rhythms. To address this problem, we ensemble neural networks and other machine learning models with different architectures and temporal parameters to recognize surgical phases. The probability estimates of the ensemble are then used as priors for forward-backward smoothing to generate posteriors of surgical phases. We demonstrate the performance of this modeling process on three data sets: 1) robot-assisted inguinal hernia (five phases), 2) robot-assisted training in a porcine model (seven phases), and 3) laparoscopic cholecystectomy (Cholec80, seven phases). The results suggest that this novel method to address varying phases in different procedures holds promise for the future of surgical phase recognition.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Expert Surgeons and Deep Learning Models Can Predict the Outcome of Surgical Hemorrhage from One Minute of Video 94%
- On evaluation metrics for medical applications of artificial intelligence 93%
- Development and Validation of Collaborative Robot-assisted Cutting Method for Iliac Crest Flap Raising: Randomized Crossover Trial 92%
Similar papers in this journal
- Development and Validation of ‘Patient Optimizer’ (POP) Algorithms for Predicting Surgical Risk with Machine Learning 94%
- On the predictability of postoperative complications for cancer patients: a Portuguese cohort study 93%
- Towards a Clinically-based Common Coordinate Framework for the Human Gut Cell Atlas - The Gut Models 93%
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.