Development and validation of an electronic health records-based opioid use disorder algorithm by expert clinical adjudication

BackgroundIn the US, over 200 lives are lost from opioid overdoses each day. Accurate and prompt diagnosis of opioid use disorders (OUD) may contribute substantially to prevention of overdose deaths. However, OUD research is limited, the specificity and sensitivity of OUD ICD codes are unknown, and the ICD codes are known to underestimate OUD prevalence. We developed and validated algorithms to identify OUD from EHR data and examine validity of ICD-based definitions for OUD. MethodsThrough multiple iterations, we developed EHR-based algorithms to identify OUD. These algorithms and ICD-based OUD definition were validated against a total of 169 independent gold standard EHR chart reviews conducted by an expert adjudication panel of eight pain and addiction medicine clinical experts across four large healthcare systems. The experts relied on clinical judgement and current Diagnostic and Statistical Manual of Mental Disorders-5 criteria for making OUD diagnoses. ResultsOf the 169 EHR charts, 81 (48%) were reviewed by more than one expert and exhibited 85% agreement between the reviewing experts. The OUD ICD codes alone had 10% sensitivity and 99% specificity, underscoring the strong potential for OUD underestimation in studies depending on ICD codes alone. In comparison, after four iterations, the algorithms identified OUD with a 23% sensitivity and 98% specificity. Conclusions and RelevanceThis is the first study to evaluate the validity of OUD ICD codes and develop validated EHR-based algorithms to address OUD underestimation. This work has the potential to inform future research on early intervention and prevention of OUD.