Fine-tuned large language models enhance influenza forecasting
Li, C.; Zhang, Q.; Zhang, Y.; Zhao, B.; Yang, J.; Qi, L.; Ding, J.; Tian, D.
Show abstract
Influenza-like illness (ILI) continues to present significant challenges to global health, highlighting the need for accurate forecasting to guide timely public health responses. Traditional statistical and deep learning models, though widely applied, often face difficulties in capturing complex nonlinear dynamics and addressing data scarcity. This study examines the potential of fine-tuned large language models (LLMs), including Llama2 and GPT2, for multi-step influenza forecasting. A specialized fine-tuning framework is introduced, incorporating custom embeddings and a prediction block, and evaluated on seven real-world ILI surveillance datasets. Extensive benchmarking against SARIMA, LSTM, and PatchTST demonstrates that fine-tuned LLMs consistently deliver superior accuracy and stability, with particular advantages in long-term forecasts. Pre-trained LLMs, while able to capture broad temporal patterns in zero-shot scenarios comparable with SARIMA, gain substantial improvements in precision through fine-tuning. These results establish fine-tuned LLMs as practical and robust solutions for influenza forecasting, offering new opportunities to enhance epidemic modeling in data-limited public health environments.
Matching journals
The top 9 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- An adaptive weight ensemble approach to forecast influenza activity in the context of irregular seasonality 97%
- CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cells 94%
- Audit to Forget: A Unified Method to Revoke Patients' Private Data in Intelligent Healthcare 93%
Similar papers in this journal
- Spatial Transcriptomics Expression Prediction from Histopathology Based on Cross-Modal Mask Reconstruction and Contrastive Learning 93%
- Transformer with Convolution and Graph-Node co-embedding: An accurate and interpretable vision backbone for predicting gene expressions from local histopathological image 92%
- Clinical Validation of Saliency Maps for Understanding Deep Neural Networks in Ophthalmology 92%
Similar papers in this journal
- Inferring global-scale temporal latent topics from news reports to predict public health interventions for COVID-19 95%
- Federated Learning for multi-omics: a performance evaluation in Parkinson's disease 93%
- Generating hard-to-obtain information from easy-to-obtain information: applications in drug discovery and clinical inference 93%
Similar papers in this journal
- Uncovering the effects of model initialization on deep model generalization: A study with adult and pediatric chest X-ray images 94%
- Modular Clinical Decision Support Networks (MoDN)—Updatable, Interpretable, and Portable Predictions for Evolving Clinical Environments 94%
- Enhancing Fairness in Disease Prediction by Optimizing Multiple Domain Adversarial Networks 92%
Similar papers in this journal
- Fast and Trustworthy Nowcasting of Dengue Fever: A Case Study Using Attention-Based Probabilistic Neural Networks in Sao Paulo, Brazil 95%
- A prospective real-time transfer learning approach to estimate Influenza hospitalizations with limited data 95%
- Foundation time series models for forecasting and policy evaluation in infectious disease epidemics 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.