Med-ICE: Enhancing Factual Accuracy in Medical AI through Autonomous Multi-Agent Consensus
Chen, Z.; Wu, R.; Liu, Y.; Li, R.; Duprey, A.
Show abstract
The integration of Large Language Models into high-stakes clinical workflows is critically hampered by their lack of verifiable reliability and tendency to generate hallucinations. This paper introduces Med-ICE, an autonomous framework designed to enhance the reliability of LLMs for medical applications. Med-ICE adapts the Iterative Consensus Ensemble paradigm, enabling a group of peer LLM agents to collaboratively converge on a final answer through iterative rounds of generation and peer review, thereby eliminating the need for an external arbiter and its associated scalability bottleneck. Our work makes three key contributions: (1) a novel semantic consensus mechanism that determines agreement based on semantic similarity, crucial for nuanced clinical language; (2) demonstration of state-of-the-art performance, where Med-ICE significantly outperforms both direct single-LLM generation and the Self-Refinement technique on challenging medical benchmarks; and (3) a highly efficient and scalable architecture, as our Semantic Consensus Monitor is computationally lightweight. This research establishes a new standard for developing safer, more trustworthy LLM systems, paving the way for their responsible integration into medicine.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- MelAnalyze: Fact-Checking Melatonin claims using Large Language Models and Natural Language Inference 94%
- Ontology-based expansion of virtual gene panels to improve diagnostic efficiency for rare genetic diseases 94%
- Causal Analysis for Multivariate Integrated Clinical and Environmental Exposures Data 93%
Similar papers in this journal
- Evaluating Explanations from AI Algorithms for Clinical Decision-Making: A Social Science-based Approach 95%
- Deep Sentiment Classification and Topic Discovery on Novel Coronavirus or COVID-19 Online Discussions: NLP Using LSTM Recurrent Neural Network Approach 95%
- Effective clustering for single cell sequencing cancer data 93%
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.