Back

Deep continual multitask severity assessment from changing clinical features

Ferri, P.; Saez, C.; Felix-De Castro, A.; Sanchez-Cuesta, P.; Garcia-Gomez, J. M.

2024-02-22 emergency medicine
10.1101/2024.02.20.24303094 medRxiv
Show abstract

When developing Machine Learning models to support emergency medical triage, it is important to consider how changes over time in the data can negatively affect the models performance. The objective of this study was to assess the effectiveness of novel Deep Continual Learning pipelines in maximizing model performance when input features are subject to change over time, including the emergence of new features and the disappearance of existing ones. The model is designed to identify life-threatening situations, predict its admissible response delay, and determine its institutional jurisdiction. We analyzed a total of 1 414 575 events spanning from 2009 to 2019. Our findings demonstrate important performance improvements, up to 4.9% in life-threatening, 18.5% in response delay and 1.7% in jurisdiction, in absolute F1-score, compared to the current triage protocol, and improvements up to 4.4% in life-threatening and 11% in response delay, in absolute F1-score, respect to non-continual approaches.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
Artificial Intelligence in Medicine
15 papers in training set
Top 0.1%
23.3%
2
Scientific Reports
3102 papers in training set
Top 3%
12.8%
3
BMC Medical Informatics and Decision Making
39 papers in training set
Top 0.5%
5.0%
4
International Journal of Medical Informatics
25 papers in training set
Top 0.2%
5.0%
5
Medical Image Analysis
33 papers in training set
Top 0.3%
3.7%
6
Journal of Medical Internet Research
85 papers in training set
Top 2%
3.0%
50% of probability mass above
7
Heliyon
146 papers in training set
Top 0.6%
2.8%
8
PLOS ONE
4510 papers in training set
Top 43%
2.8%
9
PLOS Digital Health
91 papers in training set
Top 0.9%
2.7%
10
npj Digital Medicine
97 papers in training set
Top 2%
2.2%
11
Nature Machine Intelligence
61 papers in training set
Top 2%
2.0%
12
BioMed Research International
25 papers in training set
Top 1%
2.0%
13
Nature Medicine
117 papers in training set
Top 2%
2.0%
14
Patterns
70 papers in training set
Top 0.8%
1.8%
15
Frontiers in Medicine
113 papers in training set
Top 3%
1.8%
16
Nature Communications
4913 papers in training set
Top 50%
1.7%
17
Proceedings of the National Academy of Sciences
2130 papers in training set
Top 31%
1.7%
18
PLOS Computational Biology
1633 papers in training set
Top 17%
1.5%
19
Frontiers in Public Health
140 papers in training set
Top 6%
1.4%
20
IEEE Access
31 papers in training set
Top 0.5%
1.3%
21
IEEE Journal of Biomedical and Health Informatics
34 papers in training set
Top 1%
1.3%
22
Expert Systems with Applications
11 papers in training set
Top 0.3%
0.9%
23
Informatics in Medicine Unlocked
21 papers in training set
Top 1.0%
0.8%
24
Communications Biology
886 papers in training set
Top 22%
0.8%
25
iScience
1063 papers in training set
Top 32%
0.7%
26
npj Precision Oncology
48 papers in training set
Top 1%
0.7%
27
Database
51 papers in training set
Top 1%
0.7%
28
GigaScience
172 papers in training set
Top 4%
0.7%
29
Biology Methods and Protocols
53 papers in training set
Top 3%
0.7%
30
Computers in Biology and Medicine
120 papers in training set
Top 6%
0.5%