Large Language Models to process, analyze, and synthesize biomedical texts - a scoping review
Doneva, S. E.; Qin, S.; Sick, B.; Ellendorff, T.; Goldman, J.-P.; Schneider, G.; Ineichen, B. V.
Show abstract
The advent of large language models (LLMs) such as BERT and, more recently, GPT, is transforming our approach of analyzing and understanding biomedical texts. To stay informed about the latest advancements in this area, there is a need for up-to-date summaries on the role of LLM in Natural Language Processing (NLP) of biomedical texts. Thus, this scoping review aims to provide a detailed overview of the current state of biomedical NLP research and its applications, with a special focus on the evolving role of LLMs. We conducted a systematic search of PubMed, EMBASE, and Google Scholar for studies and conference proceedings published from 2017 to December 19, 2023, that develop or utilize LLMs for NLP tasks in biomedicine. LLMs are being applied to a wide array of tasks in the biomedical field, including knowledge management, text mining, drug discovery, and evidence synthesis. Prominent among these tasks are text classification, relation extraction, and named entity recognition. Although BERT-based models remain prevalent, the use of GPT-based models has substantially increased since 2023.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Strategies and Techniques for Quality Control and Semantic Enrichment with Multimodal Data: A Case Study in Colorectal Cancer with eHDPrep 94%
- Knowledge Graph-based Thought: a knowledge graph enhanced LLMs framework for pan-cancer question answering 93%
- Extraction of biological terms using large language models enhances the usability of metadata in the BioSample database 93%
Similar papers in this journal
Similar papers in this journal
- OncoPubMiner: A platform for oncology publication mining 92%
- scaLR: a low-resource deep neural network-based platform for single cell analysis and biomarker discovery 91%
- Interpretable and Generalizable Attention-Based Model for Predicting Drug-Target Interaction Using 3D Structure of Protein Binding Sites: SARS-CoV-2 Case Study and in-Lab Validation 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.