Back

Agreement And Error Rates In Antimicrobial Susceptibility Testing For Three Commercial Automated Systems: A Systematic Literature Review And Meta-Analysis

Van Benten, K. R.; Cooper, L.; Kirby, K.; Kruer, S.; Byron, K.

2026-03-26 infectious diseases
10.64898/2026.03.24.26349209 medRxiv
Show abstract

BACKGROUNDAutomated antimicrobial susceptibility testing (AST) systems are crucial for accurate, timely detection of drug-resistant microbial isolates. This meta-analysis assessed the performance of the BD Phoenix ("Phoenix", BD Diagnostic Solutions), Vitek(R) 2 ("Vitek 2", bioMerieux), and DxM MicroScan WalkAway ("MicroScan", Beckman Coulter, Inc.) AST systems relative to common reference methodology. METHODSA systematic literature search in Ovid (MEDLINE and Embase) yielded 275 unique (not duplicated) records, with 44 additional records retrieved from handsearching; 39 studies met inclusion criteria. Categorical agreement (CA), essential agreement (EA), very major errors (VMEs), and major errors (MEs) for the three instruments were compared to a common reference method. Ratios of proportions were analyzed using random-effect meta-regression. RESULTSThe instruments did not differ significantly in CA, EA, or ME. Vitek 2 showed a higher overall VME rate than Phoenix ([~]44% higher; Vitek 2-to-Phoenix ratio = 1.44; p=0.062 [approaching significance]) and MicroScan (74% higher; ratio = 1.74; p=0.045). No appreciable difference was observed for VME between Phoenix and MicroScan. Subgroup analyses should be interpreted cautiously due to limited overall significance indicating varying performance across systems. Vitek 2 generally had higher relative VMEs for gram-negative organisms and lower relative VMEs for gram-positive organisms, whereas Phoenix showed the opposite pattern. MicroScan had relatively low VMEs when stratified by Clinical and Laboratory Standards Institute (CLSI) criteria; no differences in VMEs were observed using European Committee on Antimicrobial Susceptibility Testing (EUCAST) criteria. CONCLUSIONAlthough some VME differences were noted, overall performance of the three systems was comparable. Organism- and drug-specific VME patterns--and updates to CLSI criteria over time--highlight the importance of continued monitoring of current breakpoints for all three instruments.

Matching journals

The top 9 journals account for 50% of the predicted probability mass.

1
Journal of Clinical Microbiology
120 papers in training set
Top 0.2%
14.1%
2
PLOS ONE
4510 papers in training set
Top 26%
6.7%
3
Journal of Medical Microbiology
20 papers in training set
Top 0.1%
6.2%
4
Journal of Hospital Infection
27 papers in training set
Top 0.1%
4.8%
5
Journal of Antimicrobial Chemotherapy
43 papers in training set
Top 0.1%
4.2%
6
JAC-Antimicrobial Resistance
13 papers in training set
Top 0.1%
4.2%
7
Microbiology Spectrum
435 papers in training set
Top 0.9%
3.6%
8
European Journal of Clinical Microbiology & Infectious Diseases
15 papers in training set
Top 0.1%
3.5%
9
Infection Control & Hospital Epidemiology
17 papers in training set
Top 0.1%
3.5%
50% of probability mass above
10
The Lancet Microbe
43 papers in training set
Top 0.3%
3.5%
11
Clinical Microbiology and Infection
60 papers in training set
Top 0.3%
2.5%
12
BMC Infectious Diseases
118 papers in training set
Top 2%
2.0%
13
Journal of Infection
71 papers in training set
Top 0.9%
2.0%
14
Eurosurveillance
80 papers in training set
Top 0.5%
2.0%
15
Journal of Clinical Virology
62 papers in training set
Top 0.3%
1.8%
16
Antibiotics
32 papers in training set
Top 0.8%
1.7%
17
Scientific Reports
3102 papers in training set
Top 60%
1.7%
18
International Journal of Antimicrobial Agents
15 papers in training set
Top 0.3%
1.6%
19
Frontiers in Medicine
113 papers in training set
Top 4%
1.6%
20
Antimicrobial Agents and Chemotherapy
167 papers in training set
Top 1%
1.5%
21
The Journal of Infectious Diseases
182 papers in training set
Top 3%
1.3%
22
Open Forum Infectious Diseases
134 papers in training set
Top 2%
1.3%
23
Clinical Infectious Diseases
231 papers in training set
Top 3%
1.3%
24
Frontiers in Microbiology
375 papers in training set
Top 7%
1.2%
25
Antimicrobial Resistance & Infection Control
10 papers in training set
Top 0.2%
1.2%
26
Diagnostic Microbiology and Infectious Disease
21 papers in training set
Top 0.1%
1.1%
27
American Journal of Infection Control
12 papers in training set
Top 0.2%
0.9%
28
Diagnostics
48 papers in training set
Top 2%
0.9%
29
Frontiers in Cellular and Infection Microbiology
98 papers in training set
Top 5%
0.9%
30
BMJ Open
554 papers in training set
Top 12%
0.8%