Back

Precise Language Responses Challenge Easy Rating Scales - Comparing Clinicians and Respondents Views

Sikström, S.; Palsson Höök, A.; Kjell, O.

2022-04-27 psychiatry and clinical psychology
10.1101/2022.04.23.22274132 medRxiv
Show abstract

BackgroundClosed-ended rating scales are the most used response format for researchers and clinicians to quantify mental states, whereas in natural contexts people communicate with natural language. The reason for using such scales is that they are typically argued to be more precise in measuring mental constructs, whereas the respondents views as to what best communicates mental states are frequently ignored. MethodsWe assessed respondents (N = 304) degree of depression using rating scales, descriptive words, selected words, and free text responses and probed the respondents and clinicians (N = 40) for their attitudes to the response formats across twelve dimensions related to the precision of communicating their mental states and the ease of responding. ResultsRespondents found free text to be more precise (e.g., precision d = .88, elaboration d = 2.0) than rating scales, whereas rating scales were rated as easier to respond to (e.g., easier d = - .67, faster d = -1.13). Respondents preferred the free text responses to a greater degree than rating scales compared to clinicians. ConclusionsThese finding supports the idea that future assessment of mental health can be aided by computational method based on text data.

Matching journals

The top 8 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.