Investigating the Interplay Between Affective, Phonatory and Motoric Subsystems in Autism Spectrum Disorder Using a Multimodal Dialogue Agent
Kothare, H.; Ramanarayanan, V.; Roesler, O.; Neumann, M.; Liscombe, J.; Burke, W.; Cornish, A.; Habberstad, D.; Sakallah, A.; Markuson, S.; Kansara, S.; Faerman, A.; Bensidi-Slimane, Y.; Fry, L.; Portera, S.; Suendermann-Oeft, D.; Pautler, D.; Demopoulos, C.
Show abstract
We explore the utility of an on-demand multimodal conversational platform in extracting speech and facial metrics in children with Autism Spectrum Disorder (ASD). We investigate the extent to which these metrics correlate with objective clinical measures, particularly as they pertain to the interplay be-tween the affective, phonatory and motoric subsystems. 22 participants diagnosed with ASD engaged with a virtual agent in conversational affect production tasks designed to elicit facial and vocal affect. We found significant correlations between vocal pitch and loudness extracted by our platform during these tasks and accuracy in recognition of facial and vocal affect, as-sessed via the Diagnostic Analysis of Nonverbal Accuracy-2 (DANVA-2) neuropsychological task. We also found significant correlations between jaw kinematic metrics extracted using our platform and motor speed of the dominant hand assessed via a standardised neuropsychological finger tapping task. These findings offer preliminary evidence for the usefulness of these audiovisual analytic metrics and could help us better model the interplay between different physiological subsystems in individuals with ASD.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Identifying Neuroanatomical and Behavioral Features for Autism Spectrum Disorder Diagnosis in Children using Machine Learning 94%
- Study protocol for the EYEdentify project: An examination of gaze behaviour in autistic adults using a virtual reality-based paradigm 94%
- Early screening of autism spectrum disorder using cry features 93%
Similar papers in this journal
- Development and testing of a game-based digital intervention for working memory training in autism spectrum disorder 93%
- Can you affect me? The influence of vitality forms on action perception and motor response 92%
- Ocular dynamics reveal articulatory processing at single-phoneme level during silent reading 91%
Similar papers in this journal
- Interactive Psychometrics for Autism with the Human Dynamic Clamp: Interpersonal Synchrony from Sensory-motor to Socio-cognitive Domains 92%
- Social Perception and Interaction Database - a novel tool to study social cognitive processes with point-light displays. 91%
- Understanding Psychiatric Illness Through Natural Language Processing (UNDERPIN): Rationale, Design, and Methodology 90%
Similar papers in this journal
- Identification of social engagement indicators associated with autism spectrum disorder using a game-based mobile application 95%
- Validation of Visual and Auditory Digital Markers of Suicidality in Acutely Suicidal Psychiatric In-Patients 91%
- Tracking private WhatsApp discourse about COVID-19: A longitudinal infodemiology study in Singapore 89%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.