From Research to Impact: Assessing a Decade of CDCs Public Health Science by Topic Area, 2014-2023
Ortega, J.; Knuth, M.; Dunkley, V. E.; Kim, C.; Meites, E.; Yoo, B. B.; Wainwright, K.; Zhu, B.-P.; Reynolds, M. G.
10.1101/2025.03.07.25323572 medRxivShow abstract
ObjectivesThis study provides an objective, in-depth overview of a large body of science output addressing public health. We apply topic modeling and bibliometric tools to explore the relevance and impact of a decade of CDC-authored publications. MethodsWe identified 34,104 scientific publications from 2014-2023 with [≥]1 CDC-affiliated author using Science Clips, a CDC library database. We applied a large language modeling framework using BERTopic to publication titles and abstracts to identify public health topic themes. We obtained data from Altmetric, Dimensions, and BMJ Impact Analytics for these publications to bibliometric indicators. We assessed the percent with attention, academic citations, and policy citations using appropriate publication year ranges. We assessed the median Altmetric attention score, median academic citations, and the percent with policy citations for publications by topic area. ResultsOf publications from 2014-2020, 95% were cited by academic papers and 52% were cited in clinical guidance or policy. Of publications from 2014-2023, 84% garnered online attention. CDC-authored publications clustered into 46 public health topic themes. Among these, fungal infections had the highest median number of academic citations (36.5), mining safety and health had the highest proportion of papers with policy citations (92.5%), and substance abuse or opioids received the highest median public attention (Altmetric Attention Score = 14). Nearly a third of topics ranked highly (in the top 5) for at least one bibliometric indicator. ConclusionsPublications in this collection addressed an array of public health topic themes and demonstrated resonance within academic and policy arenas as well as with the public. SUMMARY1) What is the current understanding of this subject?Public health science should address strategic priorities and translate to public health impact. CDCs scientists publish over 3,400 articles per year on average, making it difficult to summarize the breadth of topics covered by these articles and how they affect downstream health outcomes. 2) What does this report add to the literature?We used cutting-edge large language modeling techniques to categorize CDC-authored publications into 46 topic themes. These topic themes span both infectious and non-infectious disease, and cover topics involved in strategic priorities like emergency response. We assess simple indicators like academic citations, policy citations, and media attention by topic area to show that all topic themes have had measurable impact. Across all topic areas, CDC-authored publications are also highly cited in policy and clinical guidance, an indicator of translation to public health impact. 3) What are the implications for public health practice?Public health research programs can use advances in large language modeling as well as simple indicators of reach and impact to better understand whether their publications address priority topics and translate to improving health outcomes. This overview of CDC research additionally promotes transparency about the activities of the nations foremost public health agency.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- COVID-19-related research data availability and quality according to the FAIR principles: A meta-research study 94%
- Introducing the EMPIRE Index: A novel, value-based metric framework to measure the impact of medical publications 94%
- The Rise of Open Data Practices Among Bioscientists at the University of Edinburgh 93%
Similar papers in this journal
- Diversity and inclusion: A hidden additional benefit of Open Data 94%
- Artificial Intelligence's Contribution to Biomedical Literature Search: Revolutionizing or Complicating? 93%
- Natural language processing to evaluate texting conversations between patients and healthcare providers during COVID-19 Home-Based Care in Rwanda at scale 91%
Similar papers in this journal
- Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers 94%
- Finding Long-COVID: Temporal Topic Modeling of Electronic Health Records from the N3C and RECOVER Programs 91%
- Adoption of the OMOP CDM for Cancer Research using Real-world Data: Current Status and Opportunities 91%
Similar papers in this journal
- Publishing at any cost: a cross-sectional study of the amount that medical researchers spend on open-access publishing each year 95%
- NIH Funding of COVID-19 Research in 2020: a Cross Sectional Study 92%
- Protocol for Development of a Reporting Guideline for Causal and Counterfactual Prediction Models 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.