Chart review and genetic validation of electronic medical record dementia diagnoses in VA: The impact of CMS data

Background: International Classification of Diseases (ICD) codes are often used in epidemiological studies to track disease rates over time. Objective: This evaluation of ICD-code-based algorithms for electronic medical record (EMR) studies of Alzheimers disease (AD) and related dementias (ADRD) examines the impact of incorporating Centers for Medicare and Medicaid (CMS) data as an additional source of diagnostic and treatment information in Department of Veterans Affairs (VA) EMR studies. Methods: We performed a chart review of 100 VA Million Veteran Program (MVP) participants to evaluate algorithm performance. We also assessed genetic associations across algorithms in a large MVP cohort (n=396k). Results: Adding CMS data increased the number of detected cases, sensitivity, and positive predictive value, but decreased specificity and negative predictive value. Genetic analyses showed that broader (ADRD/dementia) algorithms with just VA data performed similarly to narrow (AD-focused) algorithms incorporating both VA and CMS ICD codes. Additionally, narrow AD algorithms based solely on VA data yielded the highest ORs, indicating the largest proportion of late-onset AD cases. Conclusions: We recommend using a broad (ADRD) algorithm without CMS or medication data, particularly for epidemiological studies or a strict AD algorithm including CMS and medication cases for genetic discovery of late-onset AD associations in VA EMR, and a strict AD algorithm without CMS data for applications focused solely on AD and sensitive to misspecification. Careful evaluation of algorithm performance is warranted in different EMR systems, as ICD coding practices vary by institution, as demonstrated by this comparison of VA EMR and CMS data.