Back

Tissue-specific transfer-learning enables retasking of a general comprehensive model to a specific domain

Li, Q.; Perera, D.; Chen, Z.; Wen, W.; Wang, D.; Yan, J.; Shu, X.-o.; Zheng, W.; Guo, X.; Long, Q.

2023-09-15 bioinformatics
10.1101/2023.09.11.557208 bioRxiv
Show abstract

Machine learning (ML) has proven successful in biological data analysis. However, may require massive training data. To allow broader use of ML in the full spectrum of biology and medicine, including sample-sparse domains, re-directing established models to specific tasks by add-on training via a moderate sample may be promising. Transfer learning (TL), a technique migrating pre-trained models to new tasks, fits in this requirement. Here, by TL, we retasked Enformer, a comprehensive model trained by massive data, tailored to breast cancers using breast-specific data. Its performance has been validated through statistical accuracy of predictions, annotation of genetic variants, and mapping of variants associated with breast cancer. By allowing the flexibility of adding dedicated training data, our TL protocol unlocks future discovery within specific domains with moderate add-on samples by standing on the shoulders of giant models.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.