MuSTAF: Clinically Relevant Multi-task Spatiotemporal Attention Fusion Framework for Breast Cancer Detection with Longitudinal Mammography

Recent NCCN guideline highlighted AI-based mammographic risk prediction, but AI-based breast cancer detection remains questionable to translation. One barrier is current models often do not match routine clinical reasoning, which may add decision burden than benefits. In practice, radiologists compare current and prior mammograms while assessing breast density, bilateral symmetry, and lesion laterality. To align AI with this reasoning, we developed MuSTAF, a multi-task spatiotemporal attention fusion model for patient-level breast cancer classification from longitudinal full-field digital mammography. MuSTAF uses up to three recent mammograms, integrates temporal and cross-view information, refines suspicious-region features, and jointly predicts cancer status, breast density, and bilateral symmetry, with a separate laterality classifier for cancer-positive cases. In an internal case-control cohort (n = 351), MuSTAF achieved a cancer classification (AUC=0.84) exceeding all architecture-level baselines and published mammography AI models adapted to the same task (AUC [≤] 0.81). Simultaneously, it achieved AUCs of 0.83/0.80 for density/laterality assessments, and removing these auxiliary tasks reduced cancer detection performance. On the external CSAW-CC dataset (n = 8,723), model performance improved from 0.72 to 0.88 when restricting cancer cases to those with latest exams within 60 days before diagnosis, showing that temporally distant labels may shift detection evaluation toward risk prediction. Longitudinal analysis further showed that three recent exams outperformed five exams internally (AUC = 0.84 vs 0.80) and externally (0.72 vs 0.66), indicating recent imaging evidence mattered more than remote history. Overall, MuSTAF model improved longitudinal mammographic cancer classification while providing auxiliary outputs, and clarified temporal factors for applying AI to screening detection.