Gaming the Metrics? Bibliometric Anomalies and the Integrity Crisis in Global University Rankings
Meho, L. I.
10.1101/2025.05.09.653229 bioRxivShow abstract
This study explores how global university rankings incentivize institutions to prioritize bibliometric indicators at the expense of research integrity. Analyzing 98 fast-growing universities, we identified 18 with sharp declines in first and corresponding authorship roles, an early warning sign of potential metric manipulation. These institutions additionally exhibited unusually high publication surges in STEM fields, dense co-authorship networks, reciprocal citation behavior, and rising rates of self-citations, retractions, and publications in delisted journals. To assess these risks globally, the author developed the Research Integrity Risk Index (RI{superscript 2}), a composite profiling metric combining retraction rates and reliance on delisted journals into a single score and ranking. The index effectively identifies institutions with atypical research performance patterns that deviate from global norms, highlighting systemic vulnerabilities in current evaluation frameworks. The findings underscore the need to rethink how research performance is measured to safeguard academic integrity and mitigate gaming behaviors.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Trends in Self-citation Rates in High-impact Neurology, Neuroscience, and Psychiatry Journals 95%
- Gender differences in submission behavior exacerbate publication disparities in elite journals 94%
- Female-dominated disciplines have lower evaluated research quality and funding success rates, for men and women 94%
Similar papers in this journal
Similar papers in this journal
- Research productivity and collaboration of the NIH-funded HIV Vaccine Trials Network: a bibliometric analysis 88%
- Twitter and Census Data Analytics to Explore Socioeconomic Factors for Post-COVID-19 Reopening Sentiment 88%
- Cloud-controlled microscopy enables remote project-based biology education in Latinx communities in the United States and Latin America 86%
Similar papers in this journal
- Working groups, gender and publication impact of Canada's ecology and evolution faculty 95%
- If this title is funny, will you cite me? Citation impacts of humour and other features of article titles in ecology and evolution 93%
- Navigating methodological decisions: Balancing rigor and data volume of the Canadian Living Planet Index 83%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.