We explore the potential of Diminished Reality (DR) in medicine, a modality that removes real objects from the environment by virtually replacing them with their background. DR holds huge potential in medical applications, providing surgeons with an unobstructed view of the operation site in scenarios where space constraints or disruptive instruments hinder visibility.
We hosted the DREAMING challenge — Diminished Reality for Emerging Applications in Medicine through Inpainting — as an accepted challenge at ISBI 2024. The challenge is registered at Zenodo, the dataset is published there as well, and the challenge website carries the full details.
Watch an example on YouTube — example usage of the dataset. Watch the winning solution on YouTube.
Baseline paper: van Meegdenburg T, Luijten G, Kleesiek J, Puladi B, Ferreira A, Egger J, et al. A Baseline Solution for the ISBI 2024 DREAMING Challenge. In: Proceedings of the IEEE International Symposium on Biomedical Imaging (ISBI) 2024.
Winning method: Wu ZJ, Seshimo R, Saito H, Isogawa M. Divide and Conquer: Video Inpainting for Diminished Reality in Low-Resource Settings. In: Proceedings of the IEEE International Symposium on Biomedical Imaging (ISBI) 2024.
