We have developed an automated markerless registration method for seamlessly integrating CT data and segmented models into the patient. This method addresses the switching-focus problem, providing surgeons with a direct 2D-to-3D mapping of CT data and enabling surgical navigation in a cost-effective manner.
Gsaxner C, Pepe A, Wallner J, Schmalstieg D, Egger J. Markerless Image-to-Face Registration for Untethered Augmented Reality in Head and Neck Surgery. In: Medical Image Computing and Computer Assisted Intervention — MICCAI 2019. p. 236–44. Article
Watch the demonstration on YouTube — markerless patient registration using the depth sensors of the HoloLens 2.