We have developed an automated markerless registration method that overlays CT data and segmented models on the patient. This method addresses the switching-focus problem, providing surgeons with a direct 2D-to-3D mapping of CT data and enabling surgical navigation in a cost-effective manner.
Gsaxner C, Pepe A, Wallner J, Schmalstieg D, Egger J. Markerless Image-to-Face Registration for Untethered Augmented Reality in Head and Neck Surgery. In: Medical Image Computing and Computer Assisted Intervention — MICCAI 2019. p. 236–44. Article
Watch the demonstration on YouTube: markerless patient registration using the depth sensors of the HoloLens 2.