Back

Protocol for developing the reporting guidelines for the use CHatbots and other gEnerative AI tools in mEdical Research (CHEER)

Luo, X.; Tham, Y. C.; Daher, M.; Bian, Z.; Chen, Y.; Estill, J.; the CHEER working group,

2024-10-16 health systems and quality improvement
10.1101/2024.10.15.24315506 medRxiv
Show abstract

BackgroundThe integration of artificial intelligence (AI) has revolutionized medical research, offering innovative solutions for data collection, patient engagement, and information dissemination. Powerful generative AI (GAI) tools like ChatGPT and other similar chatbots have emerged, facilitating user interactions with virtual conversational agents. However, the increasing use of GAI tools in medical research presents challenges, including ethical concerns, data privacy issues, and the potential for generating false content. These issues necessitate standardization of reporting to ensure transparency and scientific rigor. ObjectiveThe development of the chatbots and other Generative AI tools in MEdical Research (GAMER) reporting guidelines aims to establish a comprehensive, standardized guideline for reporting the use of GAI tools in medical research. MethodsThe GAMER guidelines are being developed following the methodology recommended by the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network, involving scoping reviews and expert Delphi consensus. The process consists of three stages: preparatory work, Delphi survey, and testing and dissemination. The study is approved by the Ethics Committee of the Institute of Health Data Science at Lanzhou University (approval number: HDS-202406-01). Expected resultsThe GAMER project was launched in July 2023 by the Evidence-Based Medicine Center of Lanzhou University and the WHO Collaborating Centre for Guideline Implementation and Knowledge Translation, and is scheduled to conclude in July 2024. The expected outcome of the GAMER project is a reporting checklist, accompanied by relevant terminology, examples, and explanations, to guide stakeholders in better reporting the use of GAI tools. ConclusionGAMER aims to guide researchers, reviewers, and editors in the transparent and scientific application of GAI tools in medical research. By providing a standardized reporting framework, GAMER seeks to enhance the clarity, completeness, and integrity of research involving GAI tools, promoting collaboration, comparability, and cumulative knowledge generation in AI-driven healthcare technologies. Trial RegistrationWe registered this protocol on the EQUATOR Network (https://www.equator-network.org/library/reporting-guidelines-under-development/reporting-guidelines-under-development-for-other-study-designs/#CHEER).

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.