Back

Getting Beyond Interruptive Alerts: Reducing Unintentional Duplicate Orders using a Visual Aid

Horng, S.; Joseph, J.; Calder, S.; Stevens, J. P.; O'Donoghue, A. L.; Safran, C.; Nathanson, L. A.; Leventhal, E.

2019-07-11 bioinformatics
10.1101/640318 bioRxiv
Show abstract

ImportanceElectronic health records (EHRs) allow teams of clinicians to simultaneously care for patients but an unintended consequence could result in duplicate ordering of tests and medications.\n\nObjectiveWe asked if a simple visual aid would reduce duplicate ordering of tests and medications for busy teams of clinicians in our emergency department by placing a red highlight around the checkbox of a computer-based order if previously ordered.\n\nDesignWe performed an interrupted time series to analyze all patient visits 1 year before and 1 year after the intervention. Significance testing was performed using a negative binomial regression with Newey-West standard errors, correcting for patient level variables and environmental variables that might be associated with duplicate orders.\n\nSettingThe emergency department of an academic hospital in Boston, MA with 55,000 visits annually.\n\nParticipants184,722 consecutive emergency department patients.\n\nExposureIf an order had previously been placed during that ED visit, we cue the user by showing a red highlight around the checkbox of that order.\n\nMain OutcomeNumber of unintentional duplicate orders.\n\nResultsAfter deployment of the non-interrupting nudge, the rate of unintentional duplicates for laboratory orders decreased 49% (incidence rate ratio 0.51, 95% CI 0.45-0.59) and for radiology orders decreased with an incidence rate ratio of 0.60 (0.44-0.82). There was no change in unintentional medication duplicate orders. We estimated that the nudge eliminated 17,936 clicks in our EHR.\n\nConclusions and RelevancePassive visual queues that provide just-in-time decision support are effective, not disruptive of workflow, and may decrease alert fatigue in busy clinical environments.\n\nKey PointsO_ST_ABSQuestionC_ST_ABSCan a simple visual aid reduce duplicate ordering in an electronic health record?\n\nFindingsIn this interrupted time series, the rate of unintentional duplicates for laboratory orders decreased 49% and for radiology orders decreased 40%. There was no change in unintentional medication duplicate orders. We estimated that the nudge eliminated 17,936 clicks in our EHR.\n\nMeaningQuality improvement often relies on changing clinician behavior. We believe guiding clinicians to a right action is better than telling the clinician they have already made an error. Our approach will help reduce alert fatigue and lessen clinician complaints about EHRs.

Matching journals

The top 1 journal accounts for 50% of the predicted probability mass.

1
Journal of the American Medical Informatics Association
61 papers in training set
Top 0.1%
55.4%
50% of probability mass above
2
Journal of Medical Internet Research
85 papers in training set
Top 0.6%
6.8%
3
JAMIA Open
37 papers in training set
Top 0.3%
4.2%
4
npj Digital Medicine
97 papers in training set
Top 1%
4.2%
5
PLOS ONE
4510 papers in training set
Top 37%
3.8%
6
JMIR Formative Research
32 papers in training set
Top 0.5%
2.8%
7
BioData Mining
15 papers in training set
Top 0.4%
1.6%
8
JMIR mHealth and uHealth
10 papers in training set
Top 0.3%
1.3%
9
Journal of General Internal Medicine
20 papers in training set
Top 0.6%
1.3%
10
Trials
25 papers in training set
Top 1%
1.0%
11
Nature Communications
4913 papers in training set
Top 58%
0.9%
12
JMIRx Med
31 papers in training set
Top 1%
0.9%
13
PLOS Digital Health
91 papers in training set
Top 2%
0.8%
14
BMJ Open
554 papers in training set
Top 12%
0.8%
15
IEEE Journal of Biomedical and Health Informatics
34 papers in training set
Top 2%
0.8%
16
BMJ Health & Care Informatics
13 papers in training set
Top 0.8%
0.8%
17
Heliyon
146 papers in training set
Top 5%
0.8%
18
International Journal of Medical Informatics
25 papers in training set
Top 1%
0.8%
19
Frontiers in Digital Health
20 papers in training set
Top 1%
0.8%
20
JMIR Medical Informatics
17 papers in training set
Top 1%
0.8%
21
Scientific Reports
3102 papers in training set
Top 74%
0.8%
22
JAMA Network Open
127 papers in training set
Top 5%
0.7%
23
Clinical Infectious Diseases
231 papers in training set
Top 5%
0.5%
24
Journal of Biomedical Informatics
45 papers in training set
Top 2%
0.5%
25
PLOS Biology
408 papers in training set
Top 24%
0.5%
26
Bioinformatics
1061 papers in training set
Top 10%
0.5%
27
BMC Medical Informatics and Decision Making
39 papers in training set
Top 3%
0.5%