Medibeng Whisper Tiny: A Fine-Tuned Code-Switchedbengali-English Translator For Clinical Applications
Ghosh, P.; Talukder, S.
Show abstract
Code-switching in multilingual healthcare settings challenges automated transcription systems as facilities adopt AI documentation tools. To tackle this issue, we developed a cost-effective solution using the MediBeng Whisper Tiny model, a fine-tuned version of the Whisper Tiny model specifically designed for code-switched Bengali-English conversations in healthcare contexts. The model was fine-tuned on MediBeng, a synthetic dataset created to simulate the types of bilingual interactions often found in healthcare environments. The fine-tuning process involved using just 20% of the dataset, making it highly efficient in terms of computational resources and data usage. Despite the limited data, our model achieved an exceptional 0.01 Word Error Rate (WER), reflecting near-perfect transcription accuracy. Additionally, the model attained a 0.98 BLEU score, indicating its ability to accurately translate mixed-language input into English. These impressive results demonstrate that even with minimal data and resources, the model can handle complex code-switching tasks effectively. This model improves information processing for healthcare professionals, allowing doctors to save time on paperwork and focus more on patient care. It also ensures patient records are more accurate and accessible, aiding better healthcare decision-making.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- From theoretical models to practical deployment: A perspective and case study of opportunities and challenges in AI-driven healthcare research for low-income settings 94%
- Evaluating Knowledge Fusion Models on Detecting Adverse Drug Events in Text 94%
- Evaluating Anti-LGBTQIA+ Medical Bias in Large Language Models 93%
Similar papers in this journal
- Deep Sentiment Classification and Topic Discovery on Novel Coronavirus or COVID-19 Online Discussions: NLP Using LSTM Recurrent Neural Network Approach 94%
- Evaluating Explanations from AI Algorithms for Clinical Decision-Making: A Social Science-based Approach 92%
- Time-adaptive Unsupervised Auditory Attention Decoding Using EEG-based Stimulus Reconstruction 92%
Similar papers in this journal
- Building Large-Scale Registries from Unstructured Clinical Notes using a Low-Resource Natural Language Processing Pipeline 93%
- Enriching Representation Learning Using 53 Million Patient Notes through Human Phenotype Ontology Embedding 92%
- Deep ensemble multitask classification of emergency medical call incidents combining multimodal data improves emergency medical dispatch 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.