Assessing the Intervention's Effectiveness and Health System Efficiency During COVID-19 Crisis using A Signal-to-Noise Ratio Index

During COVID-19 nearly everyone around the globe was monitoring the situation on a daily, if not hourly, basis by tracking a set of numbers that were reported by different institutions through multiple platforms: either official, or informal. Irrespective of the sources from which the data was pulled, many researchers, reporters and professionals made the effort to represent the data in different ways in an effort to explain: what happened, what was happening, and what might happen; with the hope of seeing a sign of slowing down the spread of the virus (SARS-CoV-2). A subset of these reported numbers included: the confirmed cases, number of deaths, number of recovered cases along with the number of tests being carried out by each country. Each of these numbers (metrics) was able to reveal only one side of the reality ignoring the messages that might come from other metrics (numbers). Focusing only on one single metric to reflect on the situation opened the doors for emergent opinions, theories speculations, and even confusion among the professionals before the public. In fact, all of these efforts to explain and describe the situation through the same available numbers did not manage to see clearly or shed the light on the performance and the efficiency of the countrys health system in dealing with the ongoing COVID-19 outbreak. It was evident that none of these numbers could reconstruct the full picture about the virus spread behavior nor about the capability and capacity of the health system in dealing with the pandemic. A combined metric should have been developed to best reflect the performance of the health system during the crisis. In this paper, a signal to noise ratio like index, snr was introduced in an attempt to evaluate the efficiency of the health system as well as the effectiveness of the interventions taken by the stakeholders in an effort to control the virus spread during any health-related crisis. Using this proposed index (snr), it was possible to carry out a data-driven comparison among different countries in their efforts of dealing with the crisis. The primary focus of this study was to assess the interventions effectiveness by the decision makers along with the health systems efficiency of the countries that experienced a relatively high pressure and stress on their systems. In this study, 19 countries were selected based on predefined criteria that included: (1) the reported total confirmed cases should exceed 5,000, and (2) the total confirmed cases per 1 million people should exceed 200, at the time this study was concluded. According to the proposed snr index, the findings showed that Germany and South Korea were ahead of the game, by far, compared to other countries such as the USA, Spain, Italy, Belgium, Netherlands, and UK. Some other countries, such as Canada, Austria, Switzerland managed to slightly pivot their interventions at a later stage in effective manners according to the snr index. The study explains the foundation, and the underlying calculations of the proposed snr index. Moreover, the study shows how reliably the snr index measures the interventions effectiveness and health systems efficiency during the crisis or during any health related crisis. An additional, yet interesting finding from this study, was that the snr curve showed a persistent four episode (segment) structure or pattern during the pandemic. This finding could suggest a benchmark of the expected pattern of the fight against the virus spread during the pandemic that could offer a significant tool, or approach, for the decision makers. Finally, it is worth mentioning that the implementation of this proposed index is only valid and meaningful during a crisis. In a none crisis time, the required data to calculate the snr index is not available and rather mathematically misleading.