Implementation Outcomes of a Web-Based Platform for Reporting and Monitoring Continuous Quality Improvement (CQI) Activities: A Mixed-Methods Evaluation

Background Continuous Quality Improvement (CQI) is a core strategy for strengthening health systems, yet documentation and monitoring of CQI activities remain fragmented in many low- and middle-income country (LMIC) settings. In Jamaica, CQI has been institutionalized across priority programs, but it largely relies on paper-based tools and basic digital platforms that limit timely learning and oversight. To address these gaps, Jamaicas Ministry of Health and Wellness (MOHW), in collaboration with the Caribbean Training and Education Centre for Health (C-TECH), adapted a web-based CQI application using a participatory, human-centered design approach. Methods We conducted a formative, convergent mixed-methods evaluation across 24 healthcare facilities to assess early-stage implementation of the CQI app. Guided by the Implementation Outcomes Framework, we examined acceptability, adoption, appropriateness, and feasibility. Quantitative data were collected through a structured survey of healthcare workers (n=43), and qualitative data were gathered through five focus group discussions (n=33) and three key informant interviews with CQI leads. Survey data were summarized descriptively, and qualitative data were analyzed using rapid qualitative analysis. Findings were integrated using joint displays. Results Survey findings indicated moderate to high perceived acceptability and appropriateness of the CQI app, with 70% of participants reporting that it saved time and 67% noting that it aligned with facility goals. However, 19% reported never using it. Qualitative findings highlighted the apps value for improving CQI documentation, visualizing trends, and supporting supervisory oversight. Key barriers to sustained adoption included inconsistent internet connectivity, limited follow-up training, unclear team roles, and challenges integrating app use into routine workflows. Leadership engagement and alignment with existing CQI structures emerged as critical enablers. Conclusion This formative evaluation suggests that a digitally enabled CQI platform can strengthen documentation and oversight of quality improvement activities in resource-constrained health systems when embedded within supportive organizational and infrastructural contexts. Addressing foundational system readiness, including leadership engagement, capacity-building, and workflow integration, will be essential to realizing the CQI apps potential in Jamaica and similar LMIC settings.