Supporting Reanalysis and Reuse of Clinical Trial Data: A Case Study
Burgwinkel, C.; Chiam, H. C.; Tai, K. H.; Wang, J.; Ali, M. H.; Fallah, S. S.; Matbouriahi, M.; Obinwanne, T.; Papapostolou, G.; Riedha, M.; Varvara, G.; Zalai, Y.; Mansmann, U.; Sax, U.; Held, L.
Show abstract
BackgroundReproducing published findings from clinical trials is a critical component of scientific transparency, yet it remains a challenging and under-practiced task. Despite increasing emphasis on reproducibility and data reuse in research policies, few real-world examples exist where independent teams have reproduced complex analyses using clinical trial data. In this case study, the aim was to independently reproduce the key findings of a high-impact clinical trial on rectal cancer treatment using shared trial data. MethodWe organized a multi-team datathon, where each team was provided with the same dataset and supporting material, and was tasked to reproduce the results of the CAO/ARO/AIO-04 trial, with optional additional analysis. We contacted the original investigators for data access and reuse, and consulted them to understand the study, clinically and scientifically. ResultsFive teams used R or Python to reproduce the statistical results, and the corresponding scripts can be found on Gitlab. All teams reproduced the analyses for primary outcome--disease-free survival (DFS). The key findings on DFS were consistently reproduced, reinforcing confidence in the trial main conclusions. Result robustness was investigated using a different analytical software or statistical models. Nevertheless, challenges were encountered when the supplementary materials were not easily identified. Minor reporting issues were noticed in the reproduced paper. ConclusionReproduction of a major oncology clinical trial confirmed the reliability of its main conclusions. Divergences highlighted reporting gaps--such as incomplete protocols and broken links --that future trials should address. This case study demonstrates the value of systematic reproducibility checks for clinical research transparency and challenges in data sharing for reproducibility.
Matching journals
The top 1 journal accounts for 50% of the predicted probability mass.
Similar papers in this journal
- Trials that turn from retrospectively registered to prospectively registered: A cohort study of ‘retroactively prospective’ clinical trial registration using history data 97%
- UKCTOCS Update: Applying insights of delayed effects in cancer screening trials to the long-term follow-up mortality analysis 95%
Similar papers in this journal
- Results dissemination from clinical trials conducted at German university medical centres was delayed and incomplete 97%
- The use of the Registered Reports format for publication of randomized clinical trials: a cross-sectional study 96%
- Results reporting for clinical trials led by medical universities and university hospitals in the Nordic countries was often missing or delayed 96%
Similar papers in this journal
- Exploring scalable assessment methods for terminated trials in ClinicalTrials.gov: A cohort analysis of German and Californian trials 96%
- Analysis of clinical trial registry entry histories using the novel R package cthist 96%
- Using numerical modelling and simulation to assess the ethical burden in clinical trials and how it relates to the proportion of responders in a trial sample 95%
Similar papers in this journal
Similar papers in this journal
- The Proportion of Randomized Controlled Trials That Inform Clinical Practice: A Longitudinal Cohort Study of Trials Registered on ClinicalTrials.gov 95%
- Multicenter preclinical studies as an innovative method to enhance translation: a systematic review of published studies 92%
- An Experimental Test of the Effects of Redacting Grant Applicant Identifiers on Peer Review Outcomes 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.