Validation of an Assessment Scale for a Low-Tech Laparoscopic Appendectomy Simulation and Its Relevance for Formative Self-Assessment
Tumameu Kouam, T. H.; Renoult, L.; Poitevin, M.; Jourdin, L.; Herve, C.; Meignan, P.; Podevin, G.; Schmitt, F.
Show abstract
Introduction: Laparoscopic appendectomy is an ideal procedure for acquiring laparoscopic skills through simulation. Nevertheless, technical training is time consuming for surgical trainers to provide constructive feedback, but this could be improved by the development of validated tools that enable appropriate formative self-assessment. For this reason, we developed a structured assessment scale for a laparoscopic appendectomy exercise using a low-fidelity simulator. The objective of this study was to validate the scale for use in formative self-assessment. Methods: During laparoscopic simulation sessions in 2025-2026, participants with varying levels of experience performed a standardized laparoscopic appendectomy (LAP) exercise on a low-fidelity simulator. Performance was assessed through formative self- and external assessment using a specific scale derived from the OSATS (Objective Structured Assessment of Technical Skills) score. Content and construct validity, internal consistency, reproducibility, and reliability in both hetero- and self-assessment were analyzed. Results: Thirty-two participants were included in the validation study of the LAP scale, including 7 medical students, 17 residents in pediatric, visceral, urological, and gynecological surgery, and 8 practicing surgeons. The content of the scale was deemed relevant by 80% of the users. It demonstrated excellent construct validity, with scores increasing according to level of experience: 9.9 +/- 0.7 among students, 12.7 +/- 3.3 among junior residents, 16.6 +/- 3.3 among experienced residents, and 18.8 +/- 0.9 among practicing surgeons (p < 0.0001). Reproducibility and internal consistency were significant, while inter and intrarater reliability were excellent (correlation coefficients r = 0.90 and 0.91; p < 0.0001), as was the correlation between external and self-assessment (r = 0.81; p < 0.0001). Self-assessment was more reliable among experienced learners than among novices. Conclusion: This standardized LAP scale is validated for both external and self-assessment, the latter requiring prior training to be reliable and formative.
Matching journals
The top 1 journal accounts for 50% of the predicted probability mass.