A visual information retrieval system for radiology reports and the medical literature

Abstract

The enormous amount of visual data in Picture Archival and Communication Systems (PACS) and in the medical literature is growing exponentially. In the proposed demo, the medical image search of the KHRESMOI project is presented to solve some of the challenges of medical data management and retrieval. The system allows searching for visual information by combining content-based image retrieval (CBIR) and text retrieval in several languages using semantic concepts. 3D visual retrieval in internal hospital sources is supported by marking volumes of interest (VOI) in the data and connection to the medical literature are established to allow further investigating interesting cases. The system is demonstrated on 5TB of radiology reports with associated images and articles of the biomedical literature with over 1.7M images. © 2014 Springer International Publishing.