Realistic endoscopic image generation method using virtual-to-real image-domain translation

15Citations
Citations of this article
35Readers
Mendeley users who have this article in their library.

Abstract

A realistic image generation method for visualisation in endoscopic simulation systems is proposed in this study. Endoscopic diagnosis and treatment are performed in many hospitals. To reduce complications related to endoscope insertions, endoscopic simulation systems are used for training or rehearsal of endoscope insertions. However, current simulation systems generate non-realistic virtual endoscopic images. To improve the value of the simulation systems, improvement of the reality of their generated images is necessary. The authors propose a realistic image generation method for endoscopic simulation systems. Virtual endoscopic images are generated by using a volume rendering method from a CT volume of a patient. They improve the reality of the virtual endoscopic images using a virtual-to-real image-domain translation technique. The image-domain translator is implemented as a fully convolutional network (FCN). They train the FCN by minimising a cycle consistency loss function. The FCN is trained using unpaired virtual and real endoscopic images. To obtain high-quality image-domain translation results, they perform an image cleansing to the real endoscopic image set. They tested to use the shallow U-Net, U-Net, deep U-Net, and U-Net having residual units as the image-domain translator. The deep U-Net and U-Net having residual units generated quite realistic images.

Cite

CITATION STYLE

APA

Oda, M., Tanaka, K., Takabatake, H., Mori, M., Natori, H., & Mori, K. (2019). Realistic endoscopic image generation method using virtual-to-real image-domain translation. In Healthcare Technology Letters (Vol. 6, pp. 214–219). Institution of Engineering and Technology. https://doi.org/10.1049/htl.2019.0071

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free