Back

Abnormality Detection in Time-Series Bio-Signals using Kolmogorov-Arnold Networks for Resource-Constrained Devices

Huang, Z.; Cui, J.; Yu, L.; Herbozo Contreras, L. F.; Kavehei, O.

2024-06-04 cardiovascular medicine
10.1101/2024.06.04.24308428 medRxiv
Show abstract

This study investigates Kolmogorov-Arnold Networks (KANs) for biosignal analysis, using electrocardiogram signals as a case study. KANs provide flexibility and require few parameters, making them suitable for wearable and edge devices. A simple KAN model with one hidden layer of 64 neurons was trained on the TNMG dataset and tested on the CPSC 2018 dataset, achieving an F1-score of 0.75 and AUROC of 0.95 on TNMG, and an F1-score of 0.62 and AUROC of 0.84 on CPSC. The model also showed robustness to missing channels, maintaining reasonable performance with only a single ECG lead. Compared with traditional Multi-Layer Perceptrons (MLPs) and Neural Circuit Policies (NCPs), KANs demonstrated greater flexibility, adaptability, interpretability, and efficiency. Additionally, a shallow network (CKAN) that integrates a single Conv2dLSTM layer with a small set of KAN neurons, mirroring two architectures built with different NCP neurons for TinyML, achieved an F1-score of 0.84 and an AUROC of 0.97 on TNMG, and an F1-score of 0.72 and an AUROC of 0.92 on CPSC. Incorporating learnable sparsity, a key feature of NCP neurons, into KAN neurons surprisingly enhanced both performance and generalization. Even after pruning sparse weights, the model maintained strong performance, surpassing the counterpart without sparsity.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.