Back

Cohen's kappa statistics as a convenient means to identify accurate SARS-CoV-2 rapid antibody tests

Iseki, H.

2020-06-16 infectious diseases
10.1101/2020.06.13.20130070 medRxiv
Show abstract

There are many available rapid antibody tests, but the performance of such tests remains unclear. Moreover, it is difficult to compare among the various devices regarding their sensitivity & specificity. In order to compare the performance of such devices, we used Cohen kappa statistics to assess the level of agreement between RT-PCR and rapid antibody tests. In doing this study, we considered the term of validity after symptom-onset to compare two tests. It takes more than a week to produce antibodies in the body, and RT-PCR thus gives negative result in the convalescent period. On ELISA data from the literature kappa statistics was calculated as 1.0 beyond 10 days after symptom-onset. By taking these factors into consideration, we evaluated agreement with samples collected beyond 10 days of symptom-onset during the active period. We calculated the data from 9 devices, and the kappa statistics for English data were calculated as 0.64 on average. The same finding was 0.75 for Chinese data. These results corresponded with the values from sensitivity & specificity of their reports. Both reports had no details about the collection procedures. Kappa statistics might become even more accurate, if samples could be restricted to ones collected beyond 10 days. Regarding the data from our hospital, the kappa statistics was 0.97 when restricted to samples collected beyond 10 days, which thus showed excellent agreement. By using kappa statistics, the performances of rapid antibody tests can be shown as one figure, so that their comparison becomes easy to carry out. Highlights{blacksquare} Using kappa statistics, agreement between PCR and ELISA was perfect from the data beyond 10 days of symptom-onset. {blacksquare}The results of kappa statistics corresponded with the values from sensitivity & specificity of the English and the Chinese literatures. {blacksquare}Kappa statistics was calculated as 0.97 from the data beyond 10 days of symptom-onset, and sensitivity & specificity were 95.2% and 100% in our hospital. {blacksquare}Kappa statistics is a convenient means to identify accurate rapid antibody tests.

Matching journals

The top 8 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.