Cross-Sectional Analysis: Interpretation Of Non-Statistically Significant Results In Randomised Controlled Clinical Trials In Rehabilitation
Mugnai, C.; Falsiroli Maistrello, L.; Fiacca, G.; Perucchini, M.; Corbetta, N.; Amateis, F.; Salvioli, S.
Show abstract
IntroductionDespite the CONSORT guidelines, which aim to improve the quality of studies, authors often formulate conclusions based on the dichotomous distinction of the p-value, declaring differences between statistically significant and non-significant. This approach confuses the identification of the real efficacy of the studied treatment. To solve this problem, CONSORT guidelines recommend using confidence intervals, which offer a more complete view of possible effects. However, authors conclusions often remain based on a binary approach, confusing the absence of evidence with the evidence of absence. This error can influence clinical practice and future research, leading to the identification of negative treatments based on statistical insignificance, which reflects a lack of evidence of absence, not the absence of evidence. ObjectivesTo assess the prevalence of misinterpretation of non-statistically significant results, both in the abstract and in the article, in a sample of all randomised controlled trials (RCTs) with non-statistically significant primary outcomes published in 5 rehabilitation journals with the highest impact factor (IF) published between 2019 and 2023 and to assess whether the primary outcome result is reported according to CONSORT guidelines. MethodsWe will conduct a cross-sectional analysis of all Rcts with non-statistically significant primary outcomes in 5 general rehabilitation journals with the highest IF published between 2019 and 2023. We will determine the prevalence of trials in which non-significance is interpreted as absence of evidence, evidence of absence, or advice to use the intervention in clinical practice in the abstract and article conclusions, and the prevalence of trials that adhered to CONSORT guidelines for reporting the primary outcome.
Matching journals
The top 1 journal accounts for 50% of the predicted probability mass.
Similar papers in this journal
- The devil is in the details: Reporting and transparent research practices in sports medicine and orthopedic clinical trials 96%
- Effectiveness and clinical relevance of kinesio taping in musculoskeletal disorders: A protocol for an overview of systematic reviews and evidence mapping 96%
- Strategies used to manage overlap of primary study data by exercise-related overviews. Protocol for a systematic methodological review 96%
Similar papers in this journal
- The impact of retracted randomised controlled trials on systematic reviews and clinical practice guidelines: a meta-epidemiological study 96%
- The use of the Registered Reports format for publication of randomized clinical trials: a cross-sectional study 95%
- Use and appropriateness of Reporting Guidelines in physical therapy research: a protocol for a meta-research study 95%
Similar papers in this journal
- Efficacy of Acupuncture on Lower Limb Motor Dysfunction Following Stroke: A Systematic Review and Meta-Analysis of Randomized Controlled Trials. 96%
- Effectiveness of aerobic physical exercise on depression symptoms in adults: A protocol for a systematic review and meta-analysis of randomized clinical trials 95%
- Menopause education of healthcare professionals: A scoping review protocol 94%
Similar papers in this journal
- The effect of osteotomy technique (flat-cut vs wedge-cut Weil) on pain relief and complication incidence following surgical treatment for patients presenting with metatarsalgia in a private metropolitan clinic: Protocol for a randomised controlled trial 94%
- Development of a consensus extension of the estimands framework for cluster randomised trials (CRT-estimands): results from an international Delphi study 92%
- Trials that turn from retrospectively registered to prospectively registered: A cohort study of ‘retroactively prospective’ clinical trial registration using history data 92%
Similar papers in this journal
- A cross-sectional audit and survey of Open Science and Data Sharing practices at The Montreal Neurological Institute-Hospital 93%
- Taxonomy of interventions at academic institutions to improve research quality 92%
- Inflated citations and metrics of journals discontinued from Scopus for publication concerns: the GhoS(t)copus Project 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.