Towards Understanding Bipolar Disorder Through Social Media and Transformer Models: Challenges and Insights
Srivastava, V.; Boggavarapu, L.; Shin, A.; Datta, A.; Lu, Y.; Bhaumik, R.
Show abstract
Social media presents a promising avenue for monitoring mental health, yet detecting bipolar disorder (BD) remains significantly underexplored. The complexity arises from the overlap of linguistic patterns associated with depression and anxiety, making accurate identification challenging. This study aims to benchmark the performance of various transformer models trained on Reddit posts, to distinguish BD from other mental health conditions. Using a high-performing generative AI model (GPT-4o) as a benchmark, the analysis reveals that certain open small models (ex. MISTRAL, LLAMA) excel in capturing subtle linguistic cues linked to BD, achieving an F1 score of up to 0.86 with high precision and recall. However, BD was frequently misclassified as depression (23%-51%), normal (2%-41%), and anxiety (1%-7%), underscoring the need for improved approaches. The study highlights the importance of domain-specific data and the development of more nuanced models to enhance BD detection accuracy, paving the way for more effective mental health monitoring and timely interventions.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Machine Learning Models Predict the Emergence of Depression in Argentinean College Students during Periods of COVID-19 Quarantine 93%
- Understanding Psychiatric Illness Through Natural Language Processing (UNDERPIN): Rationale, Design, and Methodology 92%
- Computational Psychiatry Research Map (CPSYMAP): a New Database for Visualizing Research Papers 92%
Similar papers in this journal
- Developing an automatic system for classifying chatter about health services from Twitter: A case study for Medicaid 93%
- Uncovering social states in healthy and clinical populations using digital phenotyping and Hidden Markov Models 92%
- COHD-COVID: Columbia Open Health Data for COVID-19 Research 91%
Similar papers in this journal
- Listening to mental health crisis needs at scale: using Natural Language Processing to understand and evaluate a mental health crisis text messaging service 96%
- Remote digital measurement of visual and auditory markers of Major Depressive Disorder severity and treatment response. 90%
- Precision Digital Intervention for Depression Based on Social Rhythm Principles Adds Significantly to Outpatient Treatment 90%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.