Operationalization of Cochrane's risk of bias 2 tool (RoB 2) in the context of psychotherapy trials
Miguel, C.; Harrer, M.; Karyotaki, E.; Sahker, E.; Sakata, M.; Furukawa, T.; Cuijpers, P.
Show abstract
BackgroundEvaluating risk of bias (RoB) is a crucial step in systematic reviews and meta-analyses to ensure trustworthy evidence. Cochranes RoB 2 tool is the most widely used approach for assessing risk of bias in randomized controlled trials. However, its application can be challenging, particularly in fields like psychotherapy, where standard trial procedures such as double blinding are often unfeasible. ObjectiveThis article presents a context-specific operationalization and implementation guideline for applying RoB 2 to psychotherapy trials, addressing common challenges and ambiguities in this field. MethodThis guideline was developed based on empirical evidence, an expert consensus process, and iterative piloting. It provides a structured interpretation of all RoB 2 domains and signalling questions, adapted to the common methodological features of psychotherapy trials. ResultsThe operationalization resulted in 24 standardized RoB items with a harmonized scoring logic, accompanied by a practical handbook offering domainspecific advice and examples relevant to psychotherapy research. To support its use, two open-access digital assistant tools (web-based and spreadsheet formats) were developed to guide users through the rating process and facilitate integration with systematic review workflows (metapsy.org/rob). ConclusionThis guidance offers a practical approach for applying RoB 2 in psychotherapy outcome research. It is intended to be used alongside the Cochrane manual and may help improve the transparency and reproducibility of RoB 2 assessments for psychotherapy trials.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.