Back
#1
23.7%
Top 0.6%
15.6%
Top 2%
6.9%
Top 1%
6.9%
Top 0.8%
6.9%
Top 3%
6.4%
Top 3%
6.4%
Top 39%
6.4%
Top 2%
3.0%
Top 91%
2.1%
Top 1%
2.1%
Top 3%
2.1%
Top 3%
1.4%
Top 1%
1.0%
Top 3%
0.8%
Top 6%
0.8%
GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records
2022-02-28
health informatics
Title + abstract only
View on medRxiv
Show abstract
ObjectiveTo develop a large pretrained clinical language model from scratch using transformer architecture; systematically examine how transformer models of different sizes could help 5 clinical natural language processing (NLP) tasks at different linguistic levels. MethodsWe created a large corpus with >90 billion words from clinical narratives (>82 billion words), scientific literature (6 billion words), and general English text (2.5 billion words). We developed GatorTron models from scratch ...
Predicted journal destinations
1
Journal of Biomedical Informatics
37 training papers
2
Journal of the American Medical Informatics Association
53 training papers
3
Journal of Medical Internet Research
81 training papers
4
JAMIA Open
35 training papers
5
BMC Medical Informatics and Decision Making
36 training papers
6
npj Digital Medicine
85 training papers
7
PLOS Digital Health
88 training papers
8
Scientific Reports
701 training papers
9
International Journal of Medical Informatics
25 training papers
10
PLOS ONE
1737 training papers
11
JMIR Medical Informatics
16 training papers
12
Computers in Biology and Medicine
39 training papers
13
BMC Medical Research Methodology
41 training papers
14
Patterns
15 training papers
15
Frontiers in Digital Health
18 training papers
16
JMIR Formative Research
31 training papers