Is linear regression sufficient for normative psychological assessment? A comparison between OLS, GAM, and GAMLSS across seven public reference datasets
Arbizu Gomez, M.; Rodriguez Royo, P.; Maltseva, E.; Sastre Barrios, C.; M. Corada, J.; Ortea Suarez, C.; Fernandez de Pierola, I.; Rios Lago, M.; Cortes, J. M.
Show abstract
Background: Normative Z-scores are essential for interpreting individual cognitive performance relative to healthy reference populations. Traditional norms often compare individuals within predefined groups, such as age bands. This is useful and easy to interpret, but it can lose information because variables such as age change continuously and because age, sex, and education may contribute jointly to performance. Regression-based norms estimate the expected score for each individual from their specific covariates and then express the difference between the observed and expected score as a normative Z-score. Therefore, the key methodological question is not simply whether a more complex model can be fitted, but whether that added complexity changes the Z-score in a meaningful way. Methods: We implemented a comparative framework and fitted ordinary least squares (OLS), generalized additive models (GAM), and generalized additive models for location, scale, and shape (GAMLSS) to the seven public reference datasets distributed in the NormData R package. The datasets span processing speed, verbal memory, verbal fluency, academic achievement, personality, and anxiety. For each dataset we compared each regression model with the classic subgroup norm, and then compared the regression models with one another. Metrics included Pearson r, residual RMSE, and the percentage of participants whose model-based Z-score agreed with the classic Z-score. Results: All three models reproduced the classic Z-scores closely (r = 0.964-1.000). OLS and GAM produced nearly identical Z-scores throughout (r = 0.996-1.000), indicating that the observed age trajectories were smooth enough for a quadratic term to capture. GAMLSS diverged from OLS mainly in datasets with non-constant residual variance (Fluency, sigma-ratio = 1.79; TMAS, sigma-ratio = 1.50), where modeling the scale parameter recovered dispersion differences that the classic subgroup method encodes implicitly. Conclusions: Across seven heterogeneous reference datasets, OLS provides a sufficient normative Z-score computation when the sample size is large enough and residual variance is approximately constant. GAM is useful when the mean trajectory is strongly nonlinear; GAMLSS is useful when residual variance changes across covariate profiles. The practical message is deliberately simple: add model complexity only when the data show what that complexity contributes to the individual Z-score.
Matching journals
The top 9 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Multi-Level Multi-Growth Models: New opportunities for addressing developmental theory using longitudinal designs 91%
- Neurocognitive reorganization between crystallized intelligence, fluid intelligence and white matter microstructure in two age-heterogeneous developmental cohorts 91%
- Modeling differences in neurodevelopmental maturity of the reading network using support vector regression on functional connectivity data 90%
Similar papers in this journal
- Cardiorespiratory fitness and cardiometabolic health are associated with distinct cognitive domains in cognitively healthy older adults. 92%
- Distinct components of cardiovascular health are linked with age-related differences in cognitive abilities 91%
- Linking individual differences in cognitive control and perception: Meta-perception in older and younger adults 90%
Similar papers in this journal
Similar papers in this journal
- Large Reaching Datasets Quantify the Impact of Age, Sex/Gender, and Experience on Motor Control 90%
- Children exhibit a developmental advantage in the offline processing of a learned motor sequence 89%
- The vertical position of visual information conditions spatial memory performance in healthy aging 88%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.