Facial Foundational Model Advances Early Warning of Coronary Artery Disease from Live Videos with DigitalShadow
Zhou, J.; Han, Z.; Xin, M.; He, X.; Wang, G.; Song, J.; Luo, G.; He, W.; Li, X.; Chu, Y.; Chen, J.; Wang, B.; Wu, X.; Duan, W.; Guo, Z.; Bai, L.; Pan, Y.; Bi, X.; Liu, L.; Feng, L.; He, X.; Gao, X.
Show abstract
Global population aging presents increasing challenges to healthcare systems, with coronary artery disease (CAD) responsible for approximately 17.8 million deaths annually, making it a leading cause of global mortality. As CAD is largely preventable, early detection and proactive management are essential. In this work, we introduce DigitalShadow, an advanced early warning system for CAD, powered by a fine-tuned facial foundation model. The system is pre-trained on 21 million facial images and subsequently fine-tuned into LiveCAD, a specialized CAD risk assessment model trained on 7,004 facial images from 1,751 subjects across four hospitals in China. DigitalShadow functions passively and contactlessly, extracting facial features from live video streams without requiring active user engagement. Integrated with a personalized database, it generates natural language risk reports and individualized health recommendations. With privacy as a core design principle, DigitalShadow supports local deployment to ensure secure handling of user data.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- A Deep Learning Based Smartphone Application for Early Detection of Nasopharyngeal Carcinoma Using Endoscopic Images 94%
- Zero Shot Health Trajectory Prediction Using Transformer 93%
- FedWeight: Mitigating Covariate Shift of Federated Learning on Electronic Health Records Data through Patients Re-weighting 93%
Similar papers in this journal
- Uncovering the effects of model initialization on deep model generalization: A study with adult and pediatric chest X-ray images 94%
- Evaluating and mitigating unfairness in multimodal remote mental health assessments 94%
- Enhancing Fairness in Disease Prediction by Optimizing Multiple Domain Adversarial Networks 93%
Similar papers in this journal
- Dual-Field Microvascular Segmentation: Hemodynamically-Consistent Attention Learning for Retinal Vasculature Mapping 93%
- pathCLIP: Detection of Genes and Gene Relations from Biological Pathway Figures through Image-Text Contrastive Learning 93%
- SimSearch: A Human-in-the-Loop Learning Framework for Fast Detection of Regions of Interest in Microscopy Images 92%
Similar papers in this journal
- Ruling In and Ruling Out COVID-19: Computing SARS-CoV-2 Infection Risk From Symptoms, Imaging and Test Data. 92%
- Accurately Differentiating COVID-19, Other Viral Infection, and Healthy Individuals Using Multimodal Features via Late Fusion Learning 91%
- High-Resolution Digital Phenotypes from Consumer Wearables Enhance Prediction of Cardiometabolic Risk Markers 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.