Back

Implicit bias is strongest when assessing top candidates

Andersson, E. R.; Hagberg, C.; Hagg, S.

2019-12-03 scientific communication and education
10.1101/859298 bioRxiv
Show abstract

BackgroundAcademic life is highly competitive and expectations of fair competition underlie the assumption that academia is a meritocracy. However, implicit bias reinforces gender inequality in all peer review processes, unfairly eliminating outstanding individuals and depleting academia of diversity. Here, we ask whether applicant gender biases reviewer assessments of merit in Sweden, a country that is top ranked for gender equality. MethodsWe analyzed the peer review procedure for positions awarded at a Swedish medical University, Karolinska Institutet (KI), during four consecutive years (2014-2017) for Assistant Professor (n=207) and Senior Researcher (n=153). We derived a composite bibliometric score to compute productivity, and compared this to subjective external (non-KI) peer reviewer scores on applicants merits to test their association for men and women, separately. ResultsMen and women with equal merits are not scored equally by reviewers. Men generally have stronger associations (steeper slopes) between computed productivity and subjective external scores, meaning that peer reviewers suitably "reward" mens productivity with increased merit scores. However, for each additional composite bibliometric score point, women applying for Assistant Professor positions only receive 58% (79% for Senior Researcher) of the external reviewer score that men received, confirming that implicit bias affects external reviewers assessments. As productivity increases, the difference in merit scores between men and women increases. ConclusionsAccumulating bias impacts most strongly in the highest tier of competition, the pool from which successful candidates are ultimately chosen. Gender bias is apparent in external peer review processes of applications for academic positions in Sweden, and is likely to reinforce the unbalanced numbers of professorships in Sweden.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

1
PLOS ONE
4510 papers in training set
Top 3%
29.5%
2
Philosophical Transactions of the Royal Society B
51 papers in training set
Top 0.1%
13.3%
3
JAMA Network Open
127 papers in training set
Top 0.3%
6.8%
4
Scientific Reports
3102 papers in training set
Top 21%
5.2%
50% of probability mass above
5
eLife
5422 papers in training set
Top 16%
5.2%
6
FEBS Letters
42 papers in training set
Top 0.1%
4.2%
7
eneuro
389 papers in training set
Top 2%
4.2%
8
Proceedings of the Royal Society B: Biological Sciences
341 papers in training set
Top 2%
3.8%
9
FASEB BioAdvances
15 papers in training set
Top 0.1%
2.0%
10
Journal of General Internal Medicine
20 papers in training set
Top 0.4%
1.9%
11
FACETS
11 papers in training set
Top 0.1%
1.8%
12
FEBS Open Bio
29 papers in training set
Top 0.1%
1.8%
13
PLOS Biology
408 papers in training set
Top 11%
1.6%
14
The FEBS Journal
78 papers in training set
Top 0.5%
1.0%
15
PeerJ
261 papers in training set
Top 11%
0.9%
16
Journal of Evolutionary Biology
98 papers in training set
Top 0.8%
0.9%
17
Clinical Microbiology and Infection
60 papers in training set
Top 1%
0.8%
18
Nature Human Behaviour
85 papers in training set
Top 4%
0.8%
19
Bioinformatics
1061 papers in training set
Top 9%
0.8%
20
Journal of Microbiology & Biology Education
11 papers in training set
Top 0.1%
0.8%
21
F1000Research
79 papers in training set
Top 6%
0.5%
22
Royal Society Open Science
193 papers in training set
Top 6%
0.5%
23
Social Science & Medicine
15 papers in training set
Top 1%
0.5%