Back

Performance-based assessments of cognition are less susceptible to demographic effects than traditional memory tests: Evidence from MindCrowd

Reed, A. M.; Huentelman, M. J.; Hooyman, A.; Ryan, L.; Johnson, M.; De Both, M. D.; Sharma, S.; Chambers, D.; Calamia, M.; Schaefer, S. Y.

2026-03-02 psychiatry and clinical psychology
10.64898/2026.02.26.26347220 medRxiv
Show abstract

ObjectiveDemographic corrections (e.g., sex, education, race, ethnicity) are often applied when assessing cognition in adults; however, these corrections have significant limitations (e.g., using years of education does not capture the quality of, or access to, education). It is therefore critical to develop novel assessment options that are less susceptible to demographic factors. This study compared demographic effects on a verbal memory test and a performance-based test of cognition and daily functioning in older adults. Based on prior work, we hypothesized the performance-based tests would be less susceptible to demographic factors than paired associates learning. MethodData from 1326 participants (mean{+/-}SD age=61.9{+/-}10.9 yrs; Female = 1066, 80%) were collected through the MindCrowd electronic cohort, with 79 (6%) non-White, 109 (8.2%) identifying as Hispanic/Latino ethnicity, and 327 (25%) reporting education as less than a college degree. Paired associates learning is a well-established measure of medial temporal lobe-dependent learning and memory through recall of word-pairs, scored as the number of correct word pairs entered out of 36 possible. The performance-based test involved functional upper-extremity movement, specifically transporting beans to target cups in a repeating sequence (a task also shown to be dependent on the medial temporal lobe), scored as the intraindividual variability (standard deviation) in trial time across four consecutive trials. ResultsAs hypothesized, linear regression analysis showed that PAL was significantly affected by sex, education, race (particularly Black/African American), and ethnicity, whereas the performance-based test was affected only by sex and with a much smaller effect size than that of PAL. ConclusionsPerformance-based assessments may be an equitable approach to evaluating cognition without requiring score corrections, particularly for diverse populations.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring
38 papers in training set
Top 0.1%
22.1%
2
PLOS ONE
4510 papers in training set
Top 10%
18.3%
3
Frontiers in Aging Neuroscience
67 papers in training set
Top 0.7%
4.8%
4
Frontiers in Neurology
91 papers in training set
Top 2%
3.6%
5
Journal of the American Medical Directors Association
13 papers in training set
Top 0.1%
3.5%
50% of probability mass above
6
BMJ Open
554 papers in training set
Top 6%
3.5%
7
Journal of Alzheimer's Disease
43 papers in training set
Top 0.5%
3.0%
8
Scientific Reports
3102 papers in training set
Top 44%
2.7%
9
Communications Psychology
20 papers in training set
Top 0.1%
2.6%
10
PLOS Digital Health
91 papers in training set
Top 2%
1.3%
11
Alzheimer's Research & Therapy
52 papers in training set
Top 1%
1.2%
12
Journal of Cognitive Neuroscience
119 papers in training set
Top 1%
1.1%
13
Journal of Alzheimer’s Disease
39 papers in training set
Top 0.9%
0.9%
14
Healthcare
16 papers in training set
Top 1%
0.9%
15
BMC Neurology
12 papers in training set
Top 0.7%
0.9%
16
Experimental Gerontology
11 papers in training set
Top 0.2%
0.9%
17
Social Science & Medicine
15 papers in training set
Top 0.7%
0.9%
18
Age and Ageing
27 papers in training set
Top 0.4%
0.9%
19
Brain Sciences
52 papers in training set
Top 2%
0.9%
20
Frontiers in Psychiatry
83 papers in training set
Top 3%
0.9%
21
JMIR Public Health and Surveillance
45 papers in training set
Top 3%
0.8%
22
Journal of Psychiatric Research
28 papers in training set
Top 0.7%
0.8%
23
Contemporary Clinical Trials Communications
11 papers in training set
Top 0.6%
0.8%
24
JAMA Network Open
127 papers in training set
Top 5%
0.7%
25
Journal of Medical Internet Research
85 papers in training set
Top 5%
0.7%
26
JAMIA Open
37 papers in training set
Top 2%
0.7%
27
Psychiatry and Clinical Neurosciences
11 papers in training set
Top 0.4%
0.7%
28
Frontiers in Artificial Intelligence
18 papers in training set
Top 0.9%
0.7%
29
Brain and Behavior
37 papers in training set
Top 2%
0.7%
30
Frontiers in Psychology
49 papers in training set
Top 1%
0.7%