Back

Design characteristics of Sequential Multiple Assignment Randomized Trials (SMARTs) for human health: a scoping review of studies between 2009-2024

Freeman, N. L. B.; Browder, S. E.; Rowland, B. T.; Jones, E. P.; Hoch, M.; Kim, A. H.; Zhou, C. W.; Kahkoska, A. R.; McGinigle, K. L.; Ivanova, A.; Kosorok, M. R.; Anstrom, K. J.

2025-06-08 epidemiology
10.1101/2025.06.06.25329149 medRxiv
Show abstract

STRUCTURED ABSTRACTO_ST_ABSObjectiveC_ST_ABSTo characterize the reporting practices of sequential multiple assignment randomized trials (SMARTs) in human health research. DesignScoping review of protocol and primary analysis papers describing SMARTs published between January 2009 and February 2024. BackgroundSMARTs are innovative trial designs that allow for multiple stages of randomization to treatment based on a patients responses to previous treatments. They are uniquely designed to develop sequential adaptive interventions (dynamic treatment regimes) to support clinical decision-making over time. Previous reviews have identified inconsistencies in how the design, implementation, and results have been reported in published studies. A comprehensive assessment of SMART reporting practices is lacking and is necessary for developing standardized SMART-specific reporting guidelines. MethodsWe systematically searched multiple databases for SMART-related protocol and primary analysis papers published between January 2009 and February 2024. Title, abstract, and full-text screenings were performed by pairs of reviewers, with disagreements resolved by consensus. Data extraction included study characteristics, design elements, and analytic approaches for embedded or tailored dynamic treatment regimes (DTRs). Results were synthesized qualitatively and presented descriptively. ResultsFrom 5486 screened studies, 103 (59 protocol papers, 16 primary analysis papers, 14 protocol papers with corresponding primary analysis papers) met the inclusion criteria. Most studies targeted adults (62.7% protocols, 62.5% primary analyses, 42.9% protocol + primary analyses) and were primarily conducted in the United States. Behavioral and mental health constituted the most frequent therapeutic domain. While intervention descriptions and re-randomization criteria were consistently reported, operational characteristics such as blinding (protocols: 64.4%, primary analyses: 62.5%, protocols + primary analyses: 71.4%) and randomization details (protocols: 55.9%, primary analyses: 37.5%, protocols + primary analyses: 50.0%) were inconsistently documented. Only 46.7% of primary analyses evaluated embedded DTRs, and none explored deeply tailored DTRs. ConclusionsDespite the increased adoption of SMART designs, substantial reporting variability persists. Most primary analyses underutilize the capability of SMARTs to generate data for developing dynamic treatment regimes. SMART-specific standardized reporting guidelines can help accelerate the scientific and clinical impact of SMARTs. Strengths and limitations of this studyO_ST_ABSStrengthsC_ST_ABSO_LIThis is the most comprehensive review of SMARTs in human health to date, spanning studies published since SMARTS were introduced and over a 15-year period (2009-2024). C_LIO_LIRigorous methodology, including dual independent screening and extraction, enhances the reliability of the findings. C_LIO_LIThe granularity of our assessment of design elements provides specific targets for developing SMART reporting guidelines. C_LI LimitationsO_LIThis study only included protocol and primary analysis papers, missing SMARTs described in trial registries alone as well as analyses of SMARTs in secondary analysis papers. C_LIO_LIThis review included only English-language publications, potentially missing relevant studies published in other languages C_LIO_LIThis review did not assess the quality of the included SMARTs themselves, focusing instead on reporting practices. C_LI

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.