Back

Development and Utilization of 3D Anatomy Education Content using Metaverse and XR for Remote Telemedicine Education

Choi, D. H.; Choi, S. Y.; Ahn, S.; Lee, R.; Cho, S. H.; Han, S. H.

2024-06-07 scientific communication and education
10.1101/2024.06.05.597650 bioRxiv
Show abstract

The objective of this study is to explore innovative integration within the field of anatomy education by leveraging HoloLens 2 Augmented Reality Head-Mounted Display (AR HMD) technology and real-time cloud rendering. Initial 3D datasets, comprising extensive anatomical information for each bone, were obtained through the 3D scanning of a full-body cadaver of Korean male origin. Subsequently, these datasets underwent refinement processes aimed at enhancing visual fidelity and optimizing polygon counts, utilizing Blender software. Unity was employed for the development of the Metaverse platform, incorporating tailored 3D User Experience (UX) and User Interface (UI) components to facilitate interactive anatomy education via imported cadaver models. Integration with real-time remote rendering cloud servers, such as Azure, was implemented to augment the performance and rendering capabilities of the HoloLens 2 AR HMD. The extended reality (XR) content uses the Photon Cloud network for real-time data synchronization and HoloLens 2 voice functionality. The metaverse platform supports user interaction through room creation and joining, with various tools for bone manipulation, color differentiation, and surface output. Collaboration features enable sharing and synchronization of model states. The study highlights the importance of technological innovation in anatomy education for future medical professionals. The proposed content aims to address limitations of traditional methods and enhance learning experiences. Continued efforts in developing and improving such technologies are crucial to equip learners with essential skills for adaptation in the evolving healthcare landscape. keyword: Metaverse, Anatomy, Cadaver, Extended Reality(XR), Virtual Reality(VR)

Matching journals

The top 1 journal accounts for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.