A time-sequenced approach to machine learning prognostic modelling with implementation on running-related injury prediction
Wu, H.; Brooke-Wavell, K.; Fong, D. T. P.; Barnes, M. R.; Awan, Z.; Mastana, S.; Allen, S.; Blagrove, R. C.
Show abstract
BackgroundThe use of machine learning (ML) methods in medical prognostic modelling is gaining popularity, yet all currently available source models were designed from a general mathematics perspective. These models encounter limitations when embedding discipline-specific information, which restricts model practical interpretability. This study aimed to introduce two novel prognostic ML source models designed with an area-specific approach by testing their performance against commonly used ML methods, and explored their interpretability. MethodsMeasurements associated with multidisciplinary risk factors (genetics, history, neuromuscular capacity, biomechanics, body composition, nutrition, training) were collected on competitive endurance runners, who were subsequently monitored weekly over 12 months for running-related injuries (RRIs). Data was fitted with commonly used ML methods and the novel models using a stratified 10-fold cross validation framework for performance comparisons. Interpretable feature interactions were tested for statistical significance, and extracted feature importance scores were tested for correlation with Shapley Additive Explanation (SHAP) values. Results6,181 valid weekly samples were collected from 142 competitive endurance runners. The novel methods performances (AUC 0{middle dot}736-0{middle dot}753, Accuracy 0{middle dot}822-0{middle dot}849, Sensitivity 0{middle dot}376-0{middle dot}455, Specificity 0{middle dot}859-0{middle dot}896) matched those of commonly used ML methods (AUC 0{middle dot}649-0{middle dot}784, Accuracy 0{middle dot}662-0{middle dot}857, Sensitivity 0{middle dot}337-0{middle dot}568, Specificity 0{middle dot}671-0{middle dot}904). Pairwise feature interactions revealed stable patterns (p<0{middle dot}001). Method-specific computationally efficient feature importance scores moderately correlated with SHAP values (r=0{middle dot}12-0{middle dot}72), showing increases as model parameterization increased. ConclusionThe novel methods showed comparable performance and better interpretability against common ML methods. Interpretability improved with increasing parameterization, suggesting performance may further improve with larger datasets and more features. Future research should perform higher quality validations using larger datasets before these methods can be widely adopted in prognostic modelling research. FundingThis research is supported by the Alan Turing Institute Enrichment Scheme and the China Scholarship Council.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Selecting the most important self-assessed features for predicting conversion to Mild Cognitive Impairment with Random Forest and Permutation-based methods 94%
- Using explainable machine learning to identify patients at risk of reattendance at discharge from emergency departments 94%
- Synthetic data for privacy-preserving clinical risk prediction 93%
Similar papers in this journal
- A machine learning approach to identifying important features for achieving step thresholds in individuals with chronic stroke 95%
- Using a Bayesian network to classify time to return to sport based on football injury epidemiological data 94%
- Development and validation of FootNet; a new kinematic algorithm to improve foot-strike and toe-off detection in treadmill running 94%
Similar papers in this journal
- Predictability and Stability Testing to Assess Clinical Decision Instrument Performance for Children After Blunt Torso Trauma 93%
- Population Analysis Of Mortality Risk: Predictive Models Using Motion Sensors For 100,000 Participants In The UK Biobank National Cohort 92%
- Identification of predictive patient characteristics for assessing the probability of COVID-19 in-hospital mortality 92%
Similar papers in this journal
- Machine Learning Generalizability Across Healthcare Settings: Insights from multi-site COVID-19 screening 93%
- Predicting critical state after COVID-19 diagnosis: Model development using a large US electronic health record dataset 93%
- Continuous-Time and Dynamic Suicide Attempt Risk Prediction with Neural Ordinary Differential Equations 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.