Back

Test Development with Content Validity in Pediatric Hematology

Armijo, B. M.; Abusin, G. A.; Kreiter, C. D.; Barlow, P. B.; Lentz, S. R.

2023-01-23 hematology
10.1101/2023.01.21.23284870 medRxiv
Show abstract

Content validity is often lacking in tools for the assessment of competency in medical specialty and subspecialty trainees. The primary aim of this study was to develop a protocol for early test assessment in pediatric hematology using iterative rounds of expert evaluation in the context of explicit knowledge goals. We used the pediatric hematology content of the American Board of Pediatrics as a test case for assessment protocol development. We found that the use of expert input and three rounds of test development increased test content validity. The instrument developed here has the potential to improve assessment of competency in pediatric hematology. This approach also may be useful in the development of competency assessment tools for other medical subspecialties.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
PLOS ONE
● 5266 papers in training set
Top 5%
28.7%
Similar papers in this journal
2
British Journal of Haematology
○ 15 papers in training set
Top 0.1%
10.6%
Similar papers in this journal
3
BMC Medical Informatics and Decision Making
○ 43 papers in training set
Top 0.3%
5.6%
Similar papers in this journal
4
Medicine
○ 31 papers in training set
Top 0.3%
3.8%
Similar papers in this journal
5
BMC Medical Education
○ 21 papers in training set
Top 0.2%
3.5%
Similar papers in this journal
50% of probability mass above
6
Pharmacoepidemiology and Drug Safety
○ 18 papers in training set
Top 0.1%
3.5%
7
Tropical Medicine & International Health
○ 14 papers in training set
Top 0.1%
2.6%
8
Cureus
○ 68 papers in training set
Top 2%
2.6%
9
Public Health in Practice
○ 13 papers in training set
Top 0.1%
2.3%
10
Blood Advances
● 62 papers in training set
Top 0.6%
2.3%
11
Transfusion
○ 21 papers in training set
Top 0.1%
2.1%
12
PLOS Computational Biology
● 1863 papers in training set
Top 13%
2.1%
13
Physiological Reports
○ 40 papers in training set
Top 0.5%
1.9%
14
Annals of the American Thoracic Society
● 11 papers in training set
Top 0.2%
1.8%
15
BMJ Nutrition, Prevention & Health
● 11 papers in training set
Top 0.2%
1.8%
16
Scientific Reports
○ 3612 papers in training set
Top 56%
1.6%
17
Journal of The Royal Society Interface
● 235 papers in training set
Top 3%
1.6%
18
Clinical Epidemiology
○ 10 papers in training set
Top 0.2%
1.2%
19
Frontiers in Medicine
○ 120 papers in training set
Top 3%
1.1%
20
Cytometry Part A
○ 33 papers in training set
Top 0.2%
1.1%
21
Transplantation
○ 13 papers in training set
Top 0.1%
0.9%
22
Frontiers in Immunology
○ 638 papers in training set
Top 10%
0.7%
23
Transactions of The Royal Society of Tropical Medicine and Hygiene
◐ 18 papers in training set
Top 0.7%
0.5%
24
Heliyon
○ 152 papers in training set
Top 10%
0.5%
25
Vaccines
○ 198 papers in training set
Top 4%
0.5%
26
BMC Public Health
○ 158 papers in training set
Top 6%
0.5%

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.