Back

Fine-Tuning the Llama2 Large Language Model Using Books on the Diagnosis and Treatment of Musculoskeletal System in Physical Therapy

Kim, J.-h.

2023-11-23 rehabilitation medicine and physical therapy
10.1101/2023.11.23.23298943 medRxiv
Show abstract

BackgroudGenerative language models (GLM) utilize machine learning algorithms to perform various tasks such as text generation, question response, and sentence completion by imitating the language that humans understand and use. PurposeThis study was to fine-tune the Llama2 language model using text data from books on the diagnosis and treatment of musculoskeletal system in physical therapy and compare it to the base model to determine its usability in medical fields. ResultsCompared to the base model, the fine-tuned model consistently generated answers specific to the musculoskeletal system diagnosis and treatment, demonstrating improved understanding of the specialized domain. ConclusionThe model fine-tuned for musculoskeletal diagnosis and treatment books provided more detailed information related to musculoskeletal topics, and the use of this fine-tuned model could be helpful in medical education and the acquisition of specialized knowledge.

Matching journals

The top 7 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.