The Online Health Safety Gap: Consensus Alignment Does Not Imply Safety in Peer-to-Peer Health Narratives.
Clark, O.; Joshi, K.; Ahmed, Z.
Show abstract
Online health information systems evaluate content by its alignment with medical consensus, treating that alignment as a reliable signal of safety. In peer-to-peer health discourse, that assumption fails: advice that is factually accurate is not necessarily safe to act on. This paper identifies and empirically validates the Online Health Safety Gap, a structural misspecification in which medically accurate content can carry substantial health risk. Across 704 health narratives (699 classified), two scores computed from non-overlapping feature sets, Narrative Truth Distance for epistemic divergence and Narrative Risk Score for health risk potential, share only 4.9% of their variance (r=0.222, p<0.001). Consequently, 39.6% of narratives fall in the two off-diagonal quadrants that single-axis systems mishandle by construction: aligned-but-risky content (25.2%) invisible to fact-checking, and divergent-but-safe content (14.4%) incorrectly suppressed. The same independence constrains what existing benchmarks can measure. On an expert-labeled misinformation benchmark of 437 posts containing 127 misinformation instances, the highest discrimination attained is Youdens J of 0.349, by a supervised classifier trained on those labels directly, which neither frozen biomedical embeddings nor a prompted large language model improves upon. Labels encoding factual accuracy therefore carry little signal about behavioral risk, and benchmarks of this construction cannot evaluate risk-aware assessment. To operationalize the gap, we introduce the Classification Quadrant, which maps epistemic divergence and health risk potential onto four governance categories with distinct intervention implications, and argue for a shift from fact-centric evaluation to risk-aware assessment.
Matching journals
The top 1 journal accounts for 50% of the predicted probability mass.
Similar papers in this journal
- Interpretable Fine-tuned Large Language Models Facilitate Making Genetic Test Decisions for Rare Diseases 92%
- Large language models improve transferability of electronic health record-based predictions across countries and coding systems 92%
- Zero Shot Health Trajectory Prediction Using Transformer 92%
Similar papers in this journal
- Optimal policy determination in sequential systemic and locoregional therapy of oropharyngeal squamous carcinomas: A patient-physician digital twin dyad with deep Q-learning for treatment selection 90%
- Quantifying the online news media coverage of the COVID-19 pandemic 89%
- Structured Codes and Free-Text Notes: Measuring Information Complementarity in Electronic Health Records 89%
Similar papers in this journal
- Achieving Inclusive Healthcare through Integrating Education and Research with AI and Personalized Curricula 90%
- Pretrained Patient Trajectories for Adverse Drug Event Prediction Using Common Data Model-based Electronic Health Records 90%
- Systematic Review of Large Language Models for Patient Care: Current Applications and Challenges 90%
Similar papers in this journal
- Beyond Metrics to Methods: A Scoping Review of Large Language Models for Detection of Social Drivers of Health in Clinical Notes 92%
- Analysis of Eligibility Criteria Clusters Based on Large Language Models for Clinical Trial Design 92%
- Empowering Personalized Pharmacogenomics with Generative AI Solutions 90%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.