Continuous Integration and Software Quality in Scientific Software: A Large-Scale Empirical Analysis of GitHub Repositories
Compton Mellon, W. J.; Sy, M.; Gangrade, N.; Jakobi, T.
Show abstract
Bioinformatics software plays a central role in biological research, yet many academic projects lack robust testing and continuous integration (CI) practices. This absence can compromise reproducibility, accessibility, and long-term maintainability. In this study, we conduct an empirical analysis of GitHub repositories spanning bioinformatics and other scientific software domains to examine the relationship between CI, software testing, and software quality. Repository discovery was performed using domain-specific search terms via GitHub's Application Programming Interface (API). This was followed by a layered data extraction pipeline, which included a Large Language Model (LLM) validation step, that connected repositories to published works, institutions, authors, funding, and citation counts. By integrating repository activity, community engagement, and backlog health into a composite Repository Quality Index (RQI), we find that the presence of CI and software tests is significantly associated with higher repository quality. Additionally, repositories with higher academic citation counts tend to cluster in higher RQI tiers, suggesting that software quality, which is driven by proper testing and integration, is associated with academic impact and funding status. These results demonstrate that adopting industry-standard development practices, such as CI and software testing, is a tractable path toward more sustainable and impactful academic software and funding opportunities.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Quantitative monitoring of nucleotide sequence data from genetic resources in context of their citation in the scientific literature 92%
- Tool recommender system in Galaxy using deep learning 91%
- Extraction of biological terms using large language models enhances the usability of metadata in the BioSample database 91%
Similar papers in this journal
Similar papers in this journal
- Academic Tracker: Software for Tracking and Reporting Publications Associated with Authors and Grants 95%
- The Mastery Rubric for Bioinformatics: supporting design and evaluation of career-spanning education and training 93%
- The Rise of Open Data Practices Among Bioscientists at the University of Edinburgh 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.