Impact of AI-Powered Cognitive Behavioral Therapy Chatbot Access on Anxiety and Depressive Symptoms Among Primary Care Patients in Brazil: A Fuzzy Regression Discontinuity Design
Ferreira, C.; Lim, A.
Show abstract
Background: AI powered cognitive behavioral therapy CBT chatbots represent a scalable approach to addressing the global mental health treatment gap However causal evidence on their population level effectiveness in low and middle income countries LMICs remains limited and patient perspectives on acceptability and engagement are critical determinants of sustained use Brazils Estrategia de Saude da Familia ESF deployed an AI powered CBT chatbot Saude Mental Digital SMD to registered patients aged 18 and older at participating primary care units with eligibility determined by a composite vulnerability score exceeding a predetermined threshold Objective: To estimate the causal effect of AI powered CBT chatbot access on anxiety and depressive symptoms among primary care patients in Minas Gerais Brazil leveraging the eligibility score threshold as an exogenous source of variation Methods: We conducted a fuzzy regression discontinuity design fuzzy RDD study using linked administrative and clinical data from 312 ESF primary care units across Minas Gerais N 43287 patients January 2022 December 2024 The running variable was the composite vulnerability score with a threshold of 60 points determining chatbot eligibility The primary outcome was the 12 week change in the Patient Health Questionnaire Anxiety and Depression Scale PHQ ADS composite score Two stage least squares 2SLS estimation was used with local polynomial regression and triangular kernel weighting Bandwidth selection followed the Calonico Cattaneo Titiunik CCT optimal procedure Results: The fuzzy RDD estimated a local average treatment effect LATE of 473 points 95 CI 691 to 255 p 0001 on the PHQ ADS composite score at the eligibility threshold indicating clinically meaningful symptom reduction among compliers First stage estimates confirmed a strong 312 percentage point jump in chatbot uptake at the threshold F statistic 1274 Subgroup analyses revealed larger treatment effects among patients in rural municipalities 618 95 CI 902 to 334 those with lower educational attainment 582 95 CI 844 to 320 and women 537 95 CI 761 to 313 McCrary density tests confirmed no evidence of running variable manipulation p 067 Results were robust across alternative bandwidths polynomial orders and kernel specifications Conclusions: AI powered CBT chatbot access causally reduces anxiety and depressive symptoms among primary care patients near the eligibility threshold in Brazil with particularly pronounced benefits for rural less educated and female populations These findings provide quasi experimental evidence supporting the scalable deployment of AI powered CBT tools within public primary care systems in LMICs while underscoring the importance of incorporating patient perspectives on acceptability to maximize engagement and sustained therapeutic benefit
Matching journals
The top 6 journals account for 50% of the predicted probability mass.