Back

Language Models Learn Sentiment and Substance from 11,000 Psychoactive Experiences

Friedman, S. F.; Ballentine, G.

2022-08-10 neuroscience
10.1101/2022.06.02.494544 bioRxiv
Show abstract

With novel hallucinogens poised to enter psychiatry, we lack a unified framework for quantifying which changes in consciousness are optimal for treatment. Using transformers (i.e. BERT) and 11,816 publicly-available drug testimonials, we first predicted 28-dimensions of sentiment across each narrative, validated with psychiatrist annotations. Secondly, BERT was trained to predict biochemical and demographic information from testimonials. Thirdly, canonical correlation analysis (CCA) linked 52 drugs receptor affinities with testimonial word usage, revealing 11 latent receptor-experience factors, mapped to a 3D cortical atlas. Together, these 3 machine learning methods elucidate a neurobiologically-informed, temporally-sensitive portrait of drug-induced subjective experiences. Different models results converged, revealing a pervasive distinction between lucid and mundane phenomena. MDMA was linked to "Love", DMT and 5-MeO-DMT to "Mystical Experiences", and other tryptamines to "Surprise", "Curiosity" and "Realization". Applying these models to real-time biofeedback, practitioners could harness them to guide the course of therapeutic sessions.

Matching journals

The top 9 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.