Back

A Big Data COVID-19 literature pattern discovery using NLP

Petousis, P.; Stylianou, V.

2022-06-03 bioinformatics
10.1101/2022.06.01.494451 bioRxiv
Show abstract

As our collective knowledge about COVID-19 continues to grow at an exponential rate, it becomes more difficult to organize and observe emerging trends. In this work, we built an open source methodology that uses topic modeling and a pretrained BERT model to organize large corpora of COVID-19 publications into topics over time and over location. Additionally, it assesses the association of medical keywords against COVID-19 over time. These analyses are then automatically pushed into an open source web application that allows a user to obtain actionable insights from across the globe.

Matching journals

The top 8 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.