Evaluating a Clinical Decision Support System for Chronic Pain Management: A Per-Protocol Analysis

Background: Clinical decision support (CDS) systems may improve chronic pain management by providing guideline-based recommendations within clinical workflows. However, low clinician use can limit their effectiveness. Understanding the association between CDS use and guideline-recommended care may help distinguish implementation challenges from limitations in CDS functionality. Objective: To estimate the association of OneSheet, a CDS system for chronic pain management, and guideline-recommended care when the system was used during patient encounters. Methods: We conducted a per-protocol secondary data analysis of data from a pragmatic randomized clinical trial conducted from October 2020 to May 2022 across 25 primary care clinics at 2 academic health systems in Indiana and North Carolina. The parent trial enrolled 137 primary care clinicians. This analysis included 145511 eligible chronic pain encounters and 15480 long term opioid therapy (LTOT) encounters that occurred after OneSheet implementation. OneSheet use at a patient encounter was the exposure of interest. Propensity score matching was used to create comparable groups of encounters with and without OneSheet use. Outcomes included documentation of pain-related goals, documentation of pain and function using the Pain, Enjoyment of Life and General Activity (PEG) scale, prescription drug monitoring (PDMP) review, urine drug screening (UDS) orders, and naloxone orders. Results: OneSheet was used in 959 of 145511 chronic pain encounters (0.7%) and 582 of 15480 LTOT encounters (4.0%). In matched analyses, OneSheet use was associated with increased documentation of pain-related goals (relative risk (RR)=11.70 (95% CI 4.25-32.50) and PEG score documentation (RR=9.70 (95% CI 4.14-22.31). Among LTOT encounters, OneSheet use was associated with increased UDS ordering (RR=1.52 (95% CI 1.40-1.65) and PDMP review (RR=1.06 (95% CI 1.03-1.09), but decreased naloxone ordering (RR=0.13 (95% CI, 0.02-0.90). Conclusions: OneSheet use was associated with several guideline-recommended chronic pain management actions, suggesting that they system may support care quality when clinicians use it. However, use was rare, indicating that increasing routine use through better workflow integration may be necessary to achieve population-level improvements in chronic pain care.