Three-dimensional holographic visualization of high-resolution myocardial scar on HoloLens

by Jihye Jang, Cory M. Tschabrunn, Michael Barkagan, Elad Anter, Bjoern Menze, Reza Nezafat

Visualization of the complex 3D architecture of myocardial scar could improve guidance of radio-frequency ablation in the treatment of ventricular tachycardia (VT). In this study, we sought to develop a framework for 3D holographic visualization of myocardial scar, imaged using late gadolinium enhancement (LGE), on the augmented reality HoloLens. 3D holographic LGE model was built using the high-resolution 3D LGE image. Smooth endo/epicardial surface meshes were generated using Poisson surface reconstruction. For voxel-wise 3D scar model, every scarred voxel was rendered into a cube which carries the actual resolution of the LGE sequence. For surface scar model, scar information was projected on the endocardial surface mesh. Rendered layers were blended with different transparency and color, and visualized on HoloLens. A pilot animal study was performed where 3D holographic visualization of the scar was performed in 5 swines who underwent controlled infarction and electroanatomic mapping to identify VT substrate. 3D holographic visualization enabled assessment of the complex 3D scar architecture with touchless interaction in a sterile environment. Endoscopic view allowed visualization of scar from the ventricular chambers. Upon completion of the animal study, operator and mapping specialist independently completed the perceived usefulness questionnaire in the six-item usefulness scale. Operator and mapping specialist found it useful (usefulness rating: operator, 5.8; mapping specialist, 5.5; 1–7 scale) to have scar information during the intervention. HoloLens 3D LGE provides a true 3D perception of the complex scar architecture with immersive experience to visualize scar in an interactive and interpretable 3D approach, which may facilitate MR-guided VT ablation.