Design characteristics of Sequential Multiple Assignment Randomized Trials (SMARTs) for human health: a scoping review of studies between 2009-2024
Freeman, N. L. B.; Browder, S. E.; Rowland, B. T.; Jones, E. P.; Hoch, M.; Kim, A. H.; Zhou, C. W.; Kahkoska, A. R.; McGinigle, K. L.; Ivanova, A.; Kosorok, M. R.; Anstrom, K. J.
Show abstract
STRUCTURED ABSTRACTO_ST_ABSObjectiveC_ST_ABSTo characterize the reporting practices of sequential multiple assignment randomized trials (SMARTs) in human health research. DesignScoping review of protocol and primary analysis papers describing SMARTs published between January 2009 and February 2024. BackgroundSMARTs are innovative trial designs that allow for multiple stages of randomization to treatment based on a patients responses to previous treatments. They are uniquely designed to develop sequential adaptive interventions (dynamic treatment regimes) to support clinical decision-making over time. Previous reviews have identified inconsistencies in how the design, implementation, and results have been reported in published studies. A comprehensive assessment of SMART reporting practices is lacking and is necessary for developing standardized SMART-specific reporting guidelines. MethodsWe systematically searched multiple databases for SMART-related protocol and primary analysis papers published between January 2009 and February 2024. Title, abstract, and full-text screenings were performed by pairs of reviewers, with disagreements resolved by consensus. Data extraction included study characteristics, design elements, and analytic approaches for embedded or tailored dynamic treatment regimes (DTRs). Results were synthesized qualitatively and presented descriptively. ResultsFrom 5486 screened studies, 103 (59 protocol papers, 16 primary analysis papers, 14 protocol papers with corresponding primary analysis papers) met the inclusion criteria. Most studies targeted adults (62.7% protocols, 62.5% primary analyses, 42.9% protocol + primary analyses) and were primarily conducted in the United States. Behavioral and mental health constituted the most frequent therapeutic domain. While intervention descriptions and re-randomization criteria were consistently reported, operational characteristics such as blinding (protocols: 64.4%, primary analyses: 62.5%, protocols + primary analyses: 71.4%) and randomization details (protocols: 55.9%, primary analyses: 37.5%, protocols + primary analyses: 50.0%) were inconsistently documented. Only 46.7% of primary analyses evaluated embedded DTRs, and none explored deeply tailored DTRs. ConclusionsDespite the increased adoption of SMART designs, substantial reporting variability persists. Most primary analyses underutilize the capability of SMARTs to generate data for developing dynamic treatment regimes. SMART-specific standardized reporting guidelines can help accelerate the scientific and clinical impact of SMARTs. Strengths and limitations of this studyO_ST_ABSStrengthsC_ST_ABSO_LIThis is the most comprehensive review of SMARTs in human health to date, spanning studies published since SMARTS were introduced and over a 15-year period (2009-2024). C_LIO_LIRigorous methodology, including dual independent screening and extraction, enhances the reliability of the findings. C_LIO_LIThe granularity of our assessment of design elements provides specific targets for developing SMART reporting guidelines. C_LI LimitationsO_LIThis study only included protocol and primary analysis papers, missing SMARTs described in trial registries alone as well as analyses of SMARTs in secondary analysis papers. C_LIO_LIThis review included only English-language publications, potentially missing relevant studies published in other languages C_LIO_LIThis review did not assess the quality of the included SMARTs themselves, focusing instead on reporting practices. C_LI
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- The use of the Registered Reports format for publication of randomized clinical trials: a cross-sectional study 97%
- Results reporting for clinical trials led by medical universities and university hospitals in the Nordic countries was often missing or delayed 96%
- Results dissemination from clinical trials conducted at German university medical centres was delayed and incomplete 96%
Similar papers in this journal
- Trials that turn from retrospectively registered to prospectively registered: A cohort study of ‘retroactively prospective’ clinical trial registration using history data 96%
- Development of a consensus extension of the estimands framework for cluster randomised trials (CRT-estimands): results from an international Delphi study 94%
- Controlled evaLuation of Angiotensin Receptor Blockers for COVID-19 respIraTorY disease (CLARITY): Statistical analysis plan for a randomised controlled Bayesian adaptive sample size trial 93%
Similar papers in this journal
- Investigating the use of a one-page infographic to improve recruitment and retention to the BASIL+ Randomised Controlled Trial: A Study Within a Trial (SWAT) 96%
- Exploring scalable assessment methods for terminated trials in ClinicalTrials.gov: A cohort analysis of German and Californian trials 95%
- How Informative Were Early SARS-CoV-2 Treatment and Prevention Trials? A longitudinal cohort analysis of trials registered on clinicaltrials.gov 94%
Similar papers in this journal
- Investigator-initiated versus industry-sponsored trials – Visibility and relevance of randomized controlled trials in clinical practice guidelines (IMPACT) 95%
- Improving research transparency with individualized report cards: A feasibility study in clinical trials at a large university medical center 95%
- Approaches in Analyzing Predictors of Trial Failure: A Scoping Review and Meta-epidemiological study 95%
Similar papers in this journal
- Use of estimands in cluster randomised trials: a review 93%
- Dynamic methods for ongoing assessment of site-level risk in risk-based monitoring of clinical trials: a scoping review 93%
- A modular pipeline for natural language processing-screened human abstraction of a pragmatic trial outcome from electronic health records 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.