Back

Performance-based assessments of cognition are less susceptible to demographic effects than traditional memory tests: Evidence from MindCrowd

Reed, A. M.; Huentelman, M. J.; Hooyman, A.; Ryan, L.; Johnson, M.; De Both, M. D.; Sharma, S.; Chambers, D.; Calamia, M.; Schaefer, S. Y.

2026-03-02 psychiatry and clinical psychology
10.64898/2026.02.26.26347220 medRxiv
Show abstract

ObjectiveDemographic corrections (e.g., sex, education, race, ethnicity) are often applied when assessing cognition in adults; however, these corrections have significant limitations (e.g., using years of education does not capture the quality of, or access to, education). It is therefore critical to develop novel assessment options that are less susceptible to demographic factors. This study compared demographic effects on a verbal memory test and a performance-based test of cognition and daily functioning in older adults. Based on prior work, we hypothesized the performance-based tests would be less susceptible to demographic factors than paired associates learning. MethodData from 1326 participants (mean{+/-}SD age=61.9{+/-}10.9 yrs; Female = 1066, 80%) were collected through the MindCrowd electronic cohort, with 79 (6%) non-White, 109 (8.2%) identifying as Hispanic/Latino ethnicity, and 327 (25%) reporting education as less than a college degree. Paired associates learning is a well-established measure of medial temporal lobe-dependent learning and memory through recall of word-pairs, scored as the number of correct word pairs entered out of 36 possible. The performance-based test involved functional upper-extremity movement, specifically transporting beans to target cups in a repeating sequence (a task also shown to be dependent on the medial temporal lobe), scored as the intraindividual variability (standard deviation) in trial time across four consecutive trials. ResultsAs hypothesized, linear regression analysis showed that PAL was significantly affected by sex, education, race (particularly Black/African American), and ethnicity, whereas the performance-based test was affected only by sex and with a much smaller effect size than that of PAL. ConclusionsPerformance-based assessments may be an equitable approach to evaluating cognition without requiring score corrections, particularly for diverse populations.

Matching journals

The top 7 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.