Towards a Social Media-based Disease Surveillance System for Early Detection of Influenza-like Illnesses: A Twitter Case Study in Wales
Drakesmith, M.; Antypas, D.; Brown, C.; Camacho-Collados, J.; Song, J.
Show abstract
Social media offers the potential to provide detection of outbreaks or public health incidents faster than traditional reporting mechanisms. In this paper, we developed and tested a pipeline to produce alerts of influenza-like illness (ILI) using Twitter data. Data was collected from the Twitter API, querying keywords referring to ILI symptoms and geolocated to Wales. Tweets that described first-hand descriptions of symptoms (as opposed to non-personal descriptions) were classified using transformer-based language models specialised on social media (BERTweet and TimeLMs), which were trained on a manually labelled dataset matching the above criteria. After gathering this data, weekly tweet counts were applied to the regression-based Noufaily algorithm to identify exceedances throughout 2022. The algorithm was also applied to counts of ILI-related GP consultations for comparison. Exceedance detection applied to the classified tweet counts produced alerts starting four weeks earlier than by using GP consultation data. These results demonstrate the potential to facilitate advanced preparedness for unexpected increases in healthcare burdens.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- TRACKing Excess Deaths (TRACKED): an interactive online tool to monitor excess deaths associated with COVID-19 pandemic in the United Kingdom 92%
- Forecasting influenza incidence as an ordinal variable using machine learning 91%
- Improving modelling for epidemic responses: reflections from members of the UK infectious disease modelling community on their experiences during the COVID-19 pandemic 89%
Similar papers in this journal
Similar papers in this journal
- Using Twitter To Generate Signals For The Enhancement Of Syndromic Surveillance Systems: Semi-Supervised Classification For Relevance Filtering in Syndromic Surveillance 93%
- Towards a COVID-19 symptom triad: The importance of symptom constellations in the SARS-CoV-2 pandemic 92%
- Sickness Absence Rates in NHS England Staff during the COVID-19 Pandemic: insights from multivariate regression and time series modelling 92%
Similar papers in this journal
- Users’ Reactions on Announced Vaccines against COVID-19 Before Marketing in France: Analysis of Twitter posts 94%
- Developing an automatic system for classifying chatter about health services from Twitter: A case study for Medicaid 93%
- Using rapid online surveys to assess perceptions during infectious disease outbreaks: a cross-sectional survey on Covid-19 among the general public in the United States and United Kingdom 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.