Back

Implicit bias is strongest when assessing top candidates

Andersson, E. R.; Hagberg, C.; Hagg, S.

2019-12-03 scientific communication and education
10.1101/859298 bioRxiv
Show abstract

BackgroundAcademic life is highly competitive and expectations of fair competition underlie the assumption that academia is a meritocracy. However, implicit bias reinforces gender inequality in all peer review processes, unfairly eliminating outstanding individuals and depleting academia of diversity. Here, we ask whether applicant gender biases reviewer assessments of merit in Sweden, a country that is top ranked for gender equality. MethodsWe analyzed the peer review procedure for positions awarded at a Swedish medical University, Karolinska Institutet (KI), during four consecutive years (2014-2017) for Assistant Professor (n=207) and Senior Researcher (n=153). We derived a composite bibliometric score to compute productivity, and compared this to subjective external (non-KI) peer reviewer scores on applicants merits to test their association for men and women, separately. ResultsMen and women with equal merits are not scored equally by reviewers. Men generally have stronger associations (steeper slopes) between computed productivity and subjective external scores, meaning that peer reviewers suitably "reward" mens productivity with increased merit scores. However, for each additional composite bibliometric score point, women applying for Assistant Professor positions only receive 58% (79% for Senior Researcher) of the external reviewer score that men received, confirming that implicit bias affects external reviewers assessments. As productivity increases, the difference in merit scores between men and women increases. ConclusionsAccumulating bias impacts most strongly in the highest tier of competition, the pool from which successful candidates are ultimately chosen. Gender bias is apparent in external peer review processes of applications for academic positions in Sweden, and is likely to reinforce the unbalanced numbers of professorships in Sweden.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
PLOS ONE
5266 papers in training set
Top 9%
18.9%
2
Scientific Reports
3612 papers in training set
Top 2%
12.7%
3
Heliyon
152 papers in training set
Top 0.2%
7.4%
4
FASEB BioAdvances
18 papers in training set
Top 0.1%
7.4%
5
eLife
5828 papers in training set
Top 23%
5.3%
50% of probability mass above
6
FEBS Open Bio
31 papers in training set
Top 0.1%
4.4%
7
F1000Research
88 papers in training set
Top 0.5%
3.2%
8
FACETS
14 papers in training set
Top 0.1%
2.8%
9
Ecology and Evolution
267 papers in training set
Top 3%
2.7%
10
BMC Medical Research Methodology
47 papers in training set
Top 0.4%
2.7%
11
Frontiers in Psychology
56 papers in training set
Top 0.5%
2.4%
12
Proceedings of the Royal Society B: Biological Sciences
393 papers in training set
Top 3%
2.2%
13
Sustainability
10 papers in training set
Top 0.1%
2.2%
14
Animals
23 papers in training set
Top 0.3%
1.9%
15
Communications Biology
993 papers in training set
Top 13%
1.8%
16
Open Heart
21 papers in training set
Top 0.8%
1.5%
17
Royal Society Open Science
214 papers in training set
Top 4%
1.5%
18
The FASEB Journal
194 papers in training set
Top 4%
1.2%
19
Frontiers in Bioinformatics
49 papers in training set
Top 1%
0.9%
20
BMJ Open
601 papers in training set
Top 12%
0.9%
21
Journal of Clinical Pathology
15 papers in training set
Top 0.5%
0.9%
22
International Journal of Environmental Research and Public Health
128 papers in training set
Top 5%
0.9%
23
PeerJ
308 papers in training set
Top 11%
0.9%
24
Journal of Clinical Epidemiology
31 papers in training set
Top 0.9%
0.6%
25
Bioinformatics
1204 papers in training set
Top 9%
0.6%